FLUME启动报错ERROR - org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirect
2019-03-12 20:32
375 查看
昨晚做项目,一切正常,今天重新执行,报错如下
[ERROR - org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:256)] FATAL: Spool Directory source source1: { spoolDir: /home/hdp01/apps-log }: Uncaught exception in SpoolDirectorySource thread. Restart or reconfigure Flume to continue processing. java.nio.charset.MalformedInputException: Input length = 1 at java.nio.charset.CoderResult.throwException(CoderResult.java:281) at org.apache.flume.serialization.ResettableFileInputStream.readChar(ResettableFileInputStream.java:195) at org.apache.flume.serialization.LineDeserializer.readLine(LineDeserializer.java:133) at org.apache.flume.serialization.LineDeserializer.readEvent(LineDeserializer.java:71) at org.apache.flume.serialization.LineDeserializer.readEvents(LineDeserializer.java:90) at org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:252) at org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:228) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
百度后发现是flume上次文件字符集问题,FLUME默认UTF-8。
解决方法,统一字符集。
下面是配置字符集方法
agent1.sources.source1.inputCharset = GBK
相关文章推荐
- Flume启动报错[ERROR - org.apache.flume.sink.hdfs. Hit max consecutive under-replication rotations (30); will not continue rolling files under this path due to under-replication解决办法(图文详解)
- nginx启动报错:nginx: [error] open() "/var/run/nginx/nginx.pid" failed (2: No such file or directory) 的解决办法
- 【Java】【Fulme】Flume-NG源码阅读之SpoolDirectorySource
- flume启动Could not find or load main class org.apache.flume.node.Application
- Kafka报错:org.apache.flume.ChannelException: Take failed due to IO error [channel=c1]
- (tomcat启动报错)org.apache.catalina.core.StandardContext.startInternal Error listenerStart
- flume启动报错 Could not find or load main class org.apache.flume.node.Application
- flume spoolDirectory Source原生代码流程及其拓展
- Spark-shell启动的时候报Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionStateBuilder’错误
- error1 org.apache.struts2.dispatcher.ng.filter.StrutsPrepareAndExecuteFilter 无法启动导致tomcat
- 【Java】【Fulme】Flume-NG源代码阅读之SpoolDirectorySource
- HBase shell 启动出错 org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = Con
- eclipse,maven启动报错(非命令启动):JRebel: ERROR Class 'org.apache.catalina.loader.WebappClassLoader' could no
- ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2997: Encountered IOException. File or directory null
- linux 启动tomcat报错Error: Could not find or load main class org.apache.catalina.startup.Bootstrap等
- hadoop错误org.apache.hadoop.util.DiskChecker$DiskErrorException Could not find any valid local directory for
- Flume-NG源码阅读之SpoolDirectorySource
- 【Java】【Fulme】Flume-NG源码阅读之SpoolDirectorySource
- Apache启动错误:No such file or directory httpd: could not open error log file......