您的位置：首页 > 其它

从无到有系列之flume的source-channel-sink汇总03

2016-12-08 15:21 316 查看
原文转载至：http://abloz.com/2013/02/26/flume-channel-source-sink-summary.html

Component
 Type
Description
Implementation Class
Channel
memory
In-memory, fast, non-durable event transport
MemoryChannel
Channel
file
A channel for reading, writing, mapping, and manipulating a file
FileChannel
Channel
jdbc
JDBC-based, durable event transport (Derby-based)
JDBCChannel
Channel
recoverablememory
A durable channel implementation that uses the local file system for its storage
RecoverableMemoryChannel
Channel
org.apache.flume.channel.PseudoTxnMemoryChannel
Mainly for testing purposes. Not meant for production use.
PseudoTxnMemoryChannel
Channel
(custom type as FQCN)
Your own Channel impl.
(custom FQCN)
Source
avro
Avro Netty RPC event source
AvroSource
Source
exec
Execute a long-lived Unix process and read from stdout
ExecSource
Source
netcat
Netcat style TCP event source
NetcatSource
Source
seq
Monotonically incrementing sequence generator event source
SequenceGeneratorSource
Source
org.apache.flume.source.StressSource
Mainly for testing purposes. Not meant for production use. Serves as a continuous source of events where each event has the same payload. The payload consists of some number of bytes (specified bysize property,
defaults to 500) where each byte has the signed value Byte.MAX_VALUE (0x7F, or 127).
org.apache.flume.source.StressSource
Source
syslogtcp
SyslogTcpSource
Source
syslogudp
SyslogUDPSource
Source
org.apache.flume.source.avroLegacy.AvroLegacySource
AvroLegacySource
Source
org.apache.flume.source.thriftLegacy.ThriftLegacySource
ThriftLegacySource
Source
org.apache.flume.source.scribe.ScribeSource
ScribeSource
Source
(custom type as FQCN)
Your own Source impl.
(custom FQCN)
Sink
hdfs
Writes all events received to HDFS (with support for rolling, bucketing, HDFS-200 append, and more)
HDFSEventSink
Sink
org.apache.flume.sink.Hbase.HBaseSink
A simple sink that reads events from a channel and writes them to HBase.
org.apache.flume.sink.hbase.HBaseSink
Sink
org.apache.flume.sink.hbase.AsyncHBaseSink
org.apache.flume.sink.hbase.AsyncHBaseSink
Sink
logger
Log events at INFO level via configured logging subsystem (log4j by default)
LoggerSink
Sink
avro
Sink that invokes a pre-defined Avro protocol method for all events it receives (when paired with an avro source, forms tiered collection)
AvroSink
Sink
file_roll
RollingFileSink
Sink
irc
IRCSink
Sink
null
/dev/null for Flume – blackhole all events received
NullSink
Sink
(custom type as FQCN)
Your own Sink impl.
(custom FQCN)
ChannelSelector
replicating
ReplicatingChannelSelector
ChannelSelector
multiplexing
MultiplexingChannelSelector
ChannelSelector
(custom type)
Your own ChannelSelector impl.
(custom FQCN)
SinkProcessor
default
DefaultSinkProcessor
SinkProcessor
failover
FailoverSinkProcessor
SinkProcessor
load_balance
Provides the ability to load-balance flow over multiple sinks.
LoadBalancingSinkProcessor
SinkProcessor
(custom type as FQCN)
Your own SinkProcessor impl.
(custom FQCN)
Interceptor$Builder
host
HostInterceptor$Builder
Interceptor$Builder
timestamp
TimestampInterceptor
TimestampInterceptor$Builder
Interceptor$Builder
static
StaticInterceptor$Builder
Interceptor$Builder
regex_filter
RegexFilteringInterceptor$Builder
Interceptor$Builder
(custom type as FQCN)
Your own Interceptor$Builder impl.
(custom FQCN)
EventSerializer$Builder
text
BodyTextEventSerializer$Builder
EventSerializer$Builder
avro_event
FlumeEventAvroEventSerializer$Builder
EventSerializer
org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
SimpleHbaseEventSerializer
EventSerializer
org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
SimpleAsyncHbaseEventSerializer
EventSerializer
org.apache.flume.sink.hbase.RegexHbaseEventSerializer
RegexHbaseEventSerializer
HbaseEventSerializer
Custom implementation of serializer for HBaseSink.
(custom type as FQCN)
Your own HbaseEventSerializer impl.
(custom FQCN)
AsyncHbaseEventSerializer
Custom implementation of serializer for AsyncHbase sink.
(custom type as FQCN)
Your own AsyncHbaseEventSerializer impl.
(custom FQCN)
EventSerializer$Builder
Custom implementation of serializer for all sinks except for HBaseSink and AsyncHBaseSink.
(custom type as FQCN)
Your own EventSerializer$Builder impl.
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 点击这里给我发消息
标签： 
相关文章推荐
新的分享
章节导航