【问题】kafka.common.KafkaException: fetching topic metadata for topics
2016-10-26 11:39
656 查看
2016-10-26 11:05:29,716 WARN [flume_dx2.zdp.ol-1477451127056-e2015d55-leader-finder-thread] kafka.consumer.ConsumerFetcherManager$LeaderFinderThread (line 89) [flume_dx2.zdp.ol-1477451127056-e2015d55-leader-finder-thread], Failed to find leader for Set([v4-avail-service-request,0]) kafka.common.KafkaException: fetching topic metadata for topics [Set(v4-avail-service-request)] from broker [ArrayBuffer(BrokerEndPoint(0,ip-192-168-110-4.cn-north-1.compute.internal,9092))] failed at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:72) at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93) at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) Caused by: java.nio.channels.ClosedChannelException at kafka.network.BlockingChannel.send(BlockingChannel.scala:110) at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:76) at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:75) at kafka.producer.SyncProducer.send(SyncProducer.scala:120) at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58) ... 3 more
Flume从Kafka订阅数据报错Failed to find leader for Set
Flume部署在本地,Kafka集群部署在AWS云上。
解决办法
Consume端服务器配置/etc/hosts文件,其中机器名从要同Kafka服务端私有DNS名称相同(这个名称可以在报错信息中看到)
123.123.123.123 ip-192-168-110-4.cn-north-1.compute.internal
相关文章推荐
- error[No partition metadata for topic test-1 due to kafka.common.LeaderNotAvailableException]
- No partition metadata for topic test due to kafka.common.LeaderNotAvailableException
- 【storm kafka】RROR fetching topic metadata for topics [Set(order)] from broker [ArrayBuffer(id:0,host
- [异常处理]class kafka.common.UnknownTopicOrPartitionException (kafka.server.ReplicaFetcherThread)
- [异常处理]class kafka.common.UnknownTopicOrPartitionException (kafka.server.ReplicaFetcherThread)
- kafka创建topic报错:KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/ids
- kafka.common.OffsetOutOfRangeException 问题处理
- kafka 运行问题:kafka.common.KafkaException: Failed to acquire lock on file .lock 的处理
- 修改kafka源码,编译kafka 0.8.2.2,解决bug kafka.common.InvalidTopicException
- Kafka java client 连接异常(org.apache.kafka.common.errors.TimeoutException: Failed to update metadata )
- Kafka:ZK+Kafka+Spark Streaming集群环境搭建(二十六)Structured Streaming:WARN clients.NetworkClient: Error while fetching metadata with correlation id 1 : {my-topic=LEADER_NOT_AVAILABLE}
- Kafka巨坑:org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 60000 ms.
- 【问题】kafka.common.errors.RecordTooLargeException,kafka.common.MessageSizeTooLargeException
- Kafka kafka.common.OffsetOutOfRangeException 问题处理
- Fixing “selenium.common.exceptions.WebDriverException: Message: ‘Can\’t load the profile.” 分类: 问题总结 python下载 ubuntu python基础学习 2014-01-20 15:28
- 关于org.apache.jasper.JasperException: Unable to compile class for JSP问题的解决
- SpringMVC3+Hibernate4问题:org.hibernate.HibernateException: No Session found for current thread
- SSH框架问题——hbm.xml配置出现的org.hibernate.MappingException: Could not determine type for:(貌似叫数据类型转换错误)问题
- hive 终端产生的问题 (Failed to start database 'metastore_db', see the next exception for details.)
- solr - org.apache.solr.common.SolrException: Could not load config for solrconfig.xml