首页 > 编程语言 > 详细

05_Kafka Python_Consumer模拟

时间:2017-12-09 23:23:03      阅读:245      评论:0      收藏:0      [点我收藏+]

Python客户端:  Kafka-python

安装:  pip install kafka-python

Consumer端模拟代码

"""
Kafka Consumer Test
Client: Kafka-Python
"""
# Consumer
from kafka import KafkaConsumer


def main():

    # A message iterator generated, start reading message from the beginning of the topic
    consumer = KafkaConsumer("ctopic", group_id="cg-1", bootstrap_servers=["192.168.229.100:9092", "192.168.229.101:9092"],
                             auto_offset_reset=earliest)

    for msg in consumer:
        topic = msg.topic
        partiton = msg.partition
        # can explained as msg id, starting from 0
        offset = msg.offset
        key = str(msg.key, encoding=utf-8)
        value = str(msg.value, encoding=utf-8)

        print("Topic: "+ topic + "From Partion: " + str(partiton))
        print("Offset: " + str(offset))
        print("Msg key: " + key + " Msg value: " + value)
        print("*"*20)

    consumer.close()

if __name__ == "__main__":
    main()

 

 启动该Consumer,并多次运行Producer, 由于消息的key相同,会被存入同一个partition, 从Consumer端解析出的partition也可以确认

技术分享图片

 

05_Kafka Python_Consumer模拟

原文:http://www.cnblogs.com/shay-zhangjin/p/8012869.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!