apache flume 配置存储在Linux本地服务器
2016-06-07 17:16
477 查看
原文链接:https://www.geek-share.com/detail/2676290963.html
在Linux上flume的配置:
agent.channels = ch-1 agent.sources = src-1 agent.sinks = sink-1 agent.sources.src-1.interceptors = i1 agent.sources.src-1.interceptors.i1.type = timestamp agent.channels.ch-1.type = memory agent.channels.ch-1.capacity = 10000000 agent.channels.ch-1.transactionCapacity = 1000 #agent.sinks.sink-1.type = file_roll #agent.sinks.sink-1.sink.directory=/opt/log/data #agent.sinks.sink-1.sink.rollInterval = 0 #agent.sinks.sink-1.sink.batchSize=100 #agent.sinks.sink-1.sink.serializer=text #agent.sinks.sink-1.sink.serializer.appendNewline = false agent.sinks.sink-1.type = com.baidu.unbiz.flume.sink.RollingByTypeAndDayFileSink agent.sinks.sink-1.sink.directory=/opt/log/data agent.sinks.sink-1.channel = ch-1 agent.sinks.sink-1.sink.serializer.appendNewline = false agent.sources.src-1.type = avro agent.sources.src-1.bind = 192.168.1.130 agent.sources.src-1.port = 41414 agent.sinks.sink-1.channel = ch-1 agent.sources.src-1.channels= ch-1
程序的log4j.properties的配置:
log4j.appender.flume = org.apache.flume.clients.log4jappender.Log4jAppender log4j.appender.flume.Hostname = 192.168.1.130 log4j.appender.flume.Port = 41414 log4j.appender.flume.UnsafeMode = true log4j.appender.flume.layout=org.apache.log4j.PatternLayout log4j.appender.flume.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %p [%c:%L] - %m%n # configure a class's logger to output to the flume appender log4j.logger.com.cloudera.flume.flumelog4jtest.LogTestApp = INFO,flume
项目maven的pom.xml 添加配置:
<dependency> <artifactId>log4j</artifactId> <groupId>log4j</groupId> <version>1.2.16</version> </dependency> <dependency> <groupId>org.apache.flume.flume-ng-clients</groupId> <artifactId>flume-ng-log4jappender</artifactId> <version>1.6.0</version> </dependency> <dependency> <groupId>org.slf4j</groupId> <artifactId>slf4j-jdk14</artifactId> <version>1.7.2</version> </dependency>
转载于:https://www.geek-share.com/detail/2676290963.html
相关文章推荐
- apache flume 配置存储在Linux本地服务器
- Linux-Web服务器综合测试(配置本地YUM源,DNS,Apache,Nginx,ab测试网站压力)
- Linux下jsp开发环境,apache,tomcat服务器配置过程
- Linux(CentOS)下的apache服务器配置与管理
- 在linux系统下安装配置apache服务器
- LINUX系统下apache+svn服务器安装配置全过程
- 本地apache服务器配置多域名
- Linux 配置Apache服务器 上 (安装,虚拟目录)
- LINUX/APACHE/MYSQL/PHP服务器配置
- 在 Linux/Apache 2.2 上配置SVN服务器
- CentOS(Linux)下的apache服务器配置与管理方法分享
- Linux配置Apache服务器全攻略
- 独立服务器linux系统apache配置站点的方法
- Linux -- Web服务器配置之整合Apache和Tomcat
- 配置Linux开源地图服务器(配置jdk、Apache、tomcat、GeoServer)
- linux 下eclipse配置apache服务器,选中server时server name为灰色状态
- 配置Netscreen的Syslog存储到Linux Syslog服务器 推荐
- linux中DNS+apache服务器配置
- Linux Apache Web服务器配置教程
- Linux配置Apache服务器