CM添加kafka服务
2016-02-27 11:22
274 查看
下载所需的包:
在http://archive.cloudera.com/kafka/parcels/latest/ 选择合适parcel下载:
ubuntu14.04的cdh5.5.1对应包
http://archive.cloudera.com/kafka/parcels/latest/KAFKA-2.0.0-1.kafka2.0.0.p0.12-trusty.parcel
http://archive.cloudera.com/kafka/parcels/latest/KAFKA-2.0.0-1.kafka2.0.0.p0.12-trusty.parcel.sha1
http://archive.cloudera.com/kafka/parcels/latest/manifest.json
在http://archive.cloudera.com/csds/kafka/ 下载
http://archive.cloudera.com/csds/kafka/KAFKA-1.2.0.jar
在cm server主机:
进入网页:http://ha0:7180
菜单栏–主机–parcel–检查新的parcel–分配–激活
如果启动时出现内存溢出错误
在kafka配置中修改Java Heap Size of Broker 512即可
测试:
在http://archive.cloudera.com/kafka/parcels/latest/ 选择合适parcel下载:
ubuntu14.04的cdh5.5.1对应包
http://archive.cloudera.com/kafka/parcels/latest/KAFKA-2.0.0-1.kafka2.0.0.p0.12-trusty.parcel
http://archive.cloudera.com/kafka/parcels/latest/KAFKA-2.0.0-1.kafka2.0.0.p0.12-trusty.parcel.sha1
http://archive.cloudera.com/kafka/parcels/latest/manifest.json
在http://archive.cloudera.com/csds/kafka/ 下载
http://archive.cloudera.com/csds/kafka/KAFKA-1.2.0.jar
在cm server主机:
mv KAFKA-1.2.0.jar /opt/cloudera/csd/KAFKA-1.2.0.jar mv KAFKA-2.0.0-1.kafka2.0.0.p0.12-trusty.parce* /opt/cloudera/parcel-repo/ mv manifest.json /opt/cloudera/parcel-repo/
进入网页:http://ha0:7180
菜单栏–主机–parcel–检查新的parcel–分配–激活
如果启动时出现内存溢出错误
在kafka配置中修改Java Heap Size of Broker 512即可
Fatal error during KafkaServerStartable startup. Prepare to shutdown java.lang.OutOfMemoryError: Java heap space at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57) at java.nio.ByteBuffer.allocate(ByteBuffer.java:335) at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:43) at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:186) at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83) at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) at scala.collection.immutable.Range.foreach(Range.scala:166) at scala.collection.TraversableLike$class.map(TraversableLike.scala:245) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at kafka.log.LogCleaner.<init>(LogCleaner.scala:83) at kafka.log.LogManager.<init>(LogManager.scala:64) at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:601) at kafka.server.KafkaServer.startup(KafkaServer.scala:180) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:37) at kafka.Kafka$.main(Kafka.scala:67) at com.cloudera.kafka.wrap.Kafka$.main(Kafka.scala:76) at com.cloudera.kafka.wrap.Kafka.main(Kafka.scala)
测试:
kafka-topics --create --zookeeper ha0 --topic ggz --partitions 1 --replication-factor 1 kafka-console-producer --broker-list ha1:9092 --topic ggz kafka-console-consumer --zookeeper ha0 --topic ggz --from-beginning
相关文章推荐
- srebmuNfaeLottooRmuS.129
- 自定义类型转化
- CM添加kafka服务
- TOM启动报错:java.lang.ClassNotFoundException: org.springframework.web.context.ContextLoaderListe
- ubuntu12.04交叉编译opencv移植到arm板
- Docker教程:docker的概念及安装
- MySQL 高可用架构在业务层面细化分析研究
- 多线程系列原创文章的说明
- 【leetcode】【13】Roman to Integer
- Docker教程:docker的概念及安装
- 如何解决内存溢出
- Plus One--JavaScript
- 斯坦福大学IOS开发课程笔记(第七课第一部分)
- 设置button大小同文字一样大
- mysql workBeach 简单实用
- iOS CAShapeLayer精讲
- Eclipse配置JavaWeb环境
- 以in-memory方式运行的canopy生成算法
- 求助大神!怎样批量删除数据库表中某个字段中同样的一段字符!
- 大型网站架构文章