Hadoop实战-Flume之Hdfs Sink(十)
2017-05-16 22:40
148 查看
a1.sources = r1 a1.sinks = k1 a1.channels = c1 # Describe/configure the source a1.sources.r1.type = netcat a1.sources.r1.bind = localhost a1.sources.r1.port = 44444 # Describe the sink #a1.sinks.k1.type = logger a1.sinks.k1.type = hdfs a1.sinks.k1.hdfs.path = /flume/events/%y-%m-%d/%H%M/%S #官方缺少一个配置 a1.sinks.k1.hdfs.useLocalTimeStamp = true a1.sinks.k1.hdfs.filePrefix = events- a1.sinks.k1.hdfs.round = true a1.sinks.k1.hdfs.roundValue = 10 a1.sinks.k1.hdfs.roundUnit = minute # Use a channel which buffers events in memory a1.channels.c1.type = memory a1.channels.c1.capacity = 1000 a1.channels.c1.transactionCapacity = 100 # Bind the source and sink to the channel a1.sources.r1.channels = c1 a1.sinks.k1.channel = c1
相关文章推荐
- Hadoop实战-Flume之自定义Sink(十九)
- Hadoop硬实战之一:使用flume将系统日志文件导入HDFS
- Hadoop实战-Flume之Sink Failover(十六)
- Hadoop实战-Flume之Sink Load-balancing(十七)
- Flume 收集Nginx日志到Hdfs Tail-to-hdfs sink
- Docker内flume http source & hdfs sink
- Hadoop实战-Flume之自定义Source(十八)
- Flume中hdfs sink配置参数详解
- Hadoop HDFS——Hadoop实战初级部分学习笔记
- Hadoop实战-初级部分 之 HDFS
- Flume Source Exec Sink To Hdfs
- Flume中hdfs sink配置参数详解
- Flume-ng HDFS sink原理解析
- hadoop基础----hadoop实战(二)-----hadoop操作hdfs---hdfs文件系统常用命令
- Flume监听文件目录sink至hdfs配置
- Hadoop实战-中高级部分 之 HDFS原理 架构和副本机制
- flume的原理及介绍 线上数据-》flume-》kafka->hdfs/hadoop
- Hadoop维护实战-设置hdfs副本数 dfs.replication
- Hadoop实战-初级部分 之 HDFS API
- Flume中hdfs sink配置参数详解