kafka集群安装（独立zookeeper集群）

1 集群环境

192.168.100.200

192.168.100.201

192.168.100.202

2 按照步骤

[root@localhost local]# tar -zxvf kafka_2.11-0.10.1.0.tgz

[root@localhost local]# cd kafka_2.11-0.10.1.0/


[root@localhost kafka_2.11-0.10.1.0]# mkdir logs


[root@localhost kafka_2.11-0.10.1.0]# cd config/

[root@localhost config]# vi server.properties


         broker.id=0

         listeners=PLAINTEXT://192.168.100.200:9092

         advertised.listeners=PLAINTEXT://192.168.100.200:9092

         log.dirs=/usr/local/kafka_2.11-0.10.1.0/logs/
         zookeeper.connect=192.168.100.200:2181,192.168.100.201:2181,192.168.100.202:2181
[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.201:/usr/local/
[root@localhost local]# scp -r /usr/local/kafka_2.11-0.10.1.0 192.168.100.202:/usr/local/
在其它两个节点上修改
         broker.id=1
         listeners=PLAINTEXT://192.168.100.201:9092

         advertised.listeners=PLAINTEXT://192.168.100.201:9092

         broker.id=2

         listeners=PLAINTEXT://192.168.100.202:9092

         advertised.listeners=PLAINTEXT://192.168.100.202:9092

启动（每一个节点）
[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-server-start.sh -daemon /usr/local/kafka_2.11-0.10.1.0/config/server.properties &

[root@localhost kafka_2.11-0.10.1.0]# jps
进程名为Kafka

3 验证

创建一个主题wangyl，备份3，分区2

[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --create --topic wangyl  --replication-factor 3 --partitions 2 --zookeeper 192.168.100.200:2181

查看主题
[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --list --zookeeper 192.168.100.200:2181

生产消费模式验证
生产端
[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-producer.sh --broker-list 192.168.100.200:9092 --sync --topic wangyl

消费端
[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-console-consumer.sh --zookeeper 192.168.100.200:2181 --topic  wangyl --from-beginning
列出该主题的详细信息
[root@localhost kafka_2.11-0.10.1.0]# bin/kafka-topics.sh --describe --zookeeper 192.168.100.200:2181 --topic wangyl