Logstash收集Syslog日志
2016-05-17 20:48
567 查看
准备条件:1)rsyslog服务器端,Centos6.5 、IP地址192.168.174.129
2)rsyslog客户端端,Centos6.5 、IP地址192.168.174.120
3)logstash部署在rssyslog服务端,部署目录是/usr/local/loggstash
4)rsyslog配置文件rsyslog.conf所在的目录是/etc/rssyslog.conf
1、rsyslog服务端配置
2、rsyslog客户端配置
5、测试方法:在客户端机器上进行ssh Master(rsyslog服务器主机名)
6、查看rsyslog服务器/var/log/mysyslog.log里面内容如下:
2)rsyslog客户端端,Centos6.5 、IP地址192.168.174.120
3)logstash部署在rssyslog服务端,部署目录是/usr/local/loggstash
4)rsyslog配置文件rsyslog.conf所在的目录是/etc/rssyslog.conf
1、rsyslog服务端配置
# rsyslog v5 configuration file # For more information see /usr/share/doc/rsyslog-*/rsyslog_conf.html # If you experience problems, see http://www.rsyslog.com/doc/troubleshoot.html #### MODULES #### $ModLoad imuxsock # provides support for local system logging (e.g. via logger command) $ModLoad imklog # provides kernel logging support (previously done by rklogd) #$ModLoad immark # provides --MARK-- message capability # Provides UDP syslog reception $ModLoad imudp $UDPServerRun 514 # Provides TCP syslog reception #$ModLoad imtcp #$InputTCPServerRun 514 $template RemoteLogs,"/var/log/mysyslog.log" * *.* ?RemoteLogs & ~ #### GLOBAL DIRECTIVES #### # Use default timestamp format $ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat # File syncing capability is disabled by default. This feature is usually not required, # not useful and an extreme performance hit #$ActionFileEnableSync on # Include all config files in /etc/rsyslog.d/ $IncludeConfig /etc/rsyslog.d/*.conf #### RULES #### # Log all kernel messages to the console. # Logging much else clutters up the screen. #kern.* /dev/console # Log anything (except mail) of level info or higher. # Don't log private authentication messages! *.info;mail.none;authpriv.none;cron.none /var/log/messages # The authpriv file has restricted access. authpriv.* /var/log/secure # Log all the mail messages in one place. mail.* -/var/log/maillog # Log cron stuff cron.* /var/log/cron # Everybody gets emergency messages *.emerg * # Save news errors of level crit and higher in a special file. uucp,news.crit /var/log/spooler # Save boot messages also to boot.log local7.* /var/log/boot.log # ### begin forwarding rule ### # The statement between the begin ... end define a SINGLE forwarding # rule. They belong together, do NOT split them. If you create multiple # forwarding rules, duplicate the whole block! # Remote Logging (we use TCP for reliable delivery) # # An on-disk queue is created for this action. If the remote host is # down, messages are spooled to disk and sent when it is up again. #$WorkDirectory /var/lib/rsyslog # where to place spool files #$ActionQueueFileName fwdRule1 # unique name prefix for spool files #$ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible) #$ActionQueueSaveOnShutdown on # save messages to disk on shutdown #$ActionQueueType LinkedList # run asynchronously #$ActionResumeRetryCount -1 # infinite retries if host is down # remote host is: name/ip:port, e.g. 192.168.0.1:514, port optional #*.* @@remote-host:514 # ### end of the forwarding rule ### # A template to for higher precision timestamps + severity logging $template SpiceTmpl,"%TIMESTAMP%.%TIMESTAMP:::date-subseconds% %syslogtag% %syslogseverity-text%:%msg:::sp-if-no-1st-sp%%msg:::drop-last-lf%\n" :programname, startswith, "spice-vdagent"<span style="white-space:pre"> </span>/var/log/spice-vdagent.log;SpiceTmpl
2、rsyslog客户端配置
# rsyslog v5 configuration file # For more information see /usr/share/doc/rsyslog-*/rsyslog_conf.html # If you experience problems, see http://www.rsyslog.com/doc/troubleshoot.html #### MODULES #### $ModLoad imuxsock # provides support for local system logging (e.g. via logger command) $ModLoad imklog # provides kernel logging support (previously done by rklogd) #$ModLoad immark # provides --MARK-- message capability # Provides UDP syslog reception #$ModLoad imudp #$UDPServerRun 514 # Provides TCP syslog reception #$ModLoad imtcp #$InputTCPServerRun 514 #### GLOBAL DIRECTIVES #### # Use default timestamp format $ActionFileDefaultTemplate RSYSLOG_TraditionalFileFormat # File syncing capability is disabled by default. This feature is usually not required, # not useful and an extreme performance hit #$ActionFileEnableSync on # Include all config files in /etc/rsyslog.d/ $IncludeConfig /etc/rsyslog.d/*.conf #### RULES #### # Log all kernel messages to the console. # Logging much else clutters up the screen. #kern.* /dev/console # Log anything (except mail) of level info or higher. # Don't log private authentication messages! *.info;mail.none;authpriv.none;cron.none /var/log/messages # The authpriv file has restricted access. authpriv.* /var/log/secure # Log all the mail messages in one place. mail.* -/var/log/maillog # Log cron stuff cron.* /var/log/cron # Everybody gets emergency messages *.emerg * # Save news errors of level crit and higher in a special file. uucp,news.crit /var/log/spooler # Save boot messages also to boot.log local7.* /var/log/boot.log # ### begin forwarding rule ### # The statement between the begin ... end define a SINGLE forwarding # rule. They belong together, do NOT split them. If you create multiple # forwarding rules, duplicate the whole block! # Remote Logging (we use TCP for reliable delivery) # # An on-disk queue is created for this action. If the remote host is # down, messages are spooled to disk and sent when it is up again. #$WorkDirectory /var/lib/rsyslog # where to place spool files #$ActionQueueFileName fwdRule1 # unique name prefix for spool files #$ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible) #$ActionQueueSaveOnShutdown on # save messages to disk on shutdown #$ActionQueueType LinkedList # run asynchronously #$ActionResumeRetryCount -1 # infinite retries if host is down # remote host is: name/ip:port, e.g. 192.168.0.1:514, port optional #*.* @@remote-host:514 # ### end of the forwarding rule ### # A template to for higher precision timestamps + severity logging $template SpiceTmpl,"%TIMESTAMP%.%TIMESTAMP:::date-subseconds% %syslogtag% %syslogseverity-text%:%msg:::sp-if-no-1st-sp%%msg:::drop-last-lf%\n" :programname, startswith, "spice-vdagent" /var/log/spice-vdagent.log;SpiceTmpl *.* @192.168.174.129:5143、logstash配置文件
input { file{ path => "/var/log/mysyslog.log" } } output { file{ path => "/home/hadoop/xuguokun/syslog.log" } }4、启动logstash ./logstash -f ../conf/syslog.conf
5、测试方法:在客户端机器上进行ssh Master(rsyslog服务器主机名)
6、查看rsyslog服务器/var/log/mysyslog.log里面内容如下:
2016-05-17T05:48:14.073788-07:00 Master sshd[51654]: Accepted publickey for hadoop from 192.168.174.130 port 47559 ssh2 2016-05-17T05:48:14.248378-07:00 Master sshd[51654]: pam_unix(sshd:session): session opened for user hadoop by (uid=0)
相关文章推荐
- 图像的膨胀与腐蚀、细化
- linux下i2c驱动笔记
- 算法导论之贪心算法:活动选择问题
- 快速幂
- 快速幂
- URL路径中传参
- 数目的游戏
- EventBus 3.0使用详解
- 关于学习C++过程中需要的知识点拓展
- IOS开发中数据持久化的几种方法--NSUserDefaults
- autorelease
- HDU 4638--莫队算法
- hdu2710Max Factor(水题)
- 栈和队用链表实现
- 设计模式之适配器模式
- swift 数据存储
- leetcode_24. Swap Nodes in Pairs C++
- 10.2016物电 电气 辛雅松 15050341033
- Eclipse报错:An internal error has occurred. Widget is disposed
- 互联网企业下沉联姻电视台 未来新趋势能否实现双赢