Hadoop实战-Flume之自定义Source(十八)
2017-05-16 22:55
357 查看
import java.nio.charset.Charset; import java.util.HashMap; import java.util.Random; import org.apache.flume.Context; import org.apache.flume.EventDeliveryException; import org.apache.flume.PollableSource; import org.apache.flume.conf.Configurable; import org.apache.flume.event.EventBuilder; import org.apache.flume.source.AbstractSource; public class MySouce extends AbstractSource implements Configurable, PollableSource { @Override public long getBackOffSleepIncrement() { // TODO Auto-generated method stub return 0; } @Override public long getMaxBackOffSleepInterval() { // TODO Auto-generated method stub return 0; } @Override public Status process() throws EventDeliveryException { try { while (true) { int max = 20; int min = 10; Random random = new Random(); int s = random.nextInt(max) % (max - min + 1) + min; HashMap<String, String> header = new HashMap<String, String>(); header.put("id", Integer.toString(s)); this.getChannelProcessor().processEvent( EventBuilder.withBody(Integer.toString(s), Charset.forName("UTF-8"), header)); Thread.sleep(1000); } } catch (InterruptedException e) { e.printStackTrace(); } return null; } @Override public void configure(Context arg0) { // TODO Auto-generated method stub } }
相关文章推荐
- Hadoop实战-Flume之Source regex_extractor(十二)
- Hadoop实战-Flume之Source regex_filter(十三)
- Hadoop实战-Flume之自定义Sink(十九)
- Hadoop实战-Flume之Source interceptor(十一)(2017-05-16 22:40)
- Hadoop实战-Flume之Source multiplexing(十五)
- Hadoop实战-Flume之Source replicating(十四)
- Hadoop实战-Flume之Sink Failover(十六)
- Hadoop实战-Flume之Sink Load-balancing(十七)
- flume自定义sink source
- 【Hadoop】Flume-ng源码解析之Source组件
- Hadoop应用开发实战(flume应用开发、搜索引擎算法、Pipes、集群、PageRank算法)
- 云星数据---Apache Flink实战系列(精品版)】:Flink流处理API详解与编程实战006-DataStream与MySql自定义sink和source(Scala版)001
- Hadoop 实例15 MultipleInputs实战2:多种自定义文件格式的文件输入处理
- 云星数据---Apache Flink实战系列(精品版)】:Flink流处理API详解与编程实战008-DataStream与MySql自定义sink和source(Scala版)003
- flume学习(八):自定义source
- Flume学习-自定义Source
- Flume自定义Source、Sink和Interceptor(简单功能实现)
- flume自定义source,sink
- flume学习(七)、(八):如何使用event header中的key值以及自定义source
- Hadoop硬实战之一:使用flume将系统日志文件导入HDFS