Kafka单机伪分布式安装

前提条件：安装好zookeeper，见下文

http://blog.csdn.net/jameshadoop/article/details/49621709

环境：

centos 6.5 x64

kafka_2.9.2-0.8.1.1

1.解压

tar -xzf kafka_2.9.2-0.8.1.1.tgz

2.配置

copy两个副本：

cp config/server.properties  config/server-1.properties
cp config/server.properties  config/server-2.properties

$kafka_home/config文件夹中配置下面几个文件：

vim server.properties

broker.id=0
port=9092
log.dir=/tmp/kafka-logs-0
host.name=cent
zookeeper.connect=cent:2181

vim server-1.properties

broker.id=1
port=9093
log.dir=/tmp/kafka-logs-1
host.name=cent
zookeeper.connect=cent:2181

vim server-2.properties

broker.id=2
port=9094
log.dir=/tmp/kafka-logs-2
host.name=cent
zookeeper.connect=cent:2181

3.启动

要先启动zookeeper

sh $zookeeper_home/bin/zkServer.sh start

然后启动三个broker

bin/kafka-server-start.sh config/server.properties &

bin/kafka-server-start.sh config/server-1.properties &

bin/kafka-server-start.sh config/server-2.properties &

4.测试

创建一个拥有3个副本的topic:

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic

查看每个节点信息

bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic my-replicated-topic个拥有3个副本的topic:

生产消息：

bin/kafka-console-producer.sh --broker-list localhost:9092 --topic my-replicated-topic

*在停留的shell窗口中随便输入，按回车发送

I’m kafka

kafka helloworld*

消费消息：

bin/kafka-console-consumer.sh –zookeeper localhost:2181 –from-beginning –topic my-replicated-topic

结束