项目中使用log4j打印的内容同时传输到flume
1、flume端
flume的agent配置内容如下：
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | a1.sources=s1a1.sinks=k1a1.channels=c1a1.sources.s1.channels=c1a1.sinks.k1.channel=c1a1.sources.s1.type=avroa1.sources.s1.bind=vm1a1.sources.s1.port=41414a1.sinks.k1.type=loggera1.channels.c1.type=memorya1.channels.c1.capacity=1000a1.channels.c1.transactionCapacity=100 |
启动这个agent
1 | flume-ng agent --conf conf/ --conf-file conf/a1.conf --name a1 -Dflume.root.logger=INFO,console |
2、java客户端
log4j.properties
1 2 3 4 5 | log4j.rootLogger=INFO,flumelog4j.appender.flume = org.apache.flume.clients.log4jappender.Log4jAppenderlog4j.appender.flume.Hostname = 192.168.1.111log4j.appender.flume.Port = 41414log4j.appender.flume.UnsafeMode = true |
java测试代码如下：
1 2 3 4 5 6 7 8 9 10 11 12 13 14 | package com.test.flume;import org.apache.log4j.Logger;public class Log4jAppenderTest { public static void main(String[] args) { Logger logger = Logger.getLogger(Log4jAppenderTest.class); logger.info("test successful"); logger.error("error"); System.out.println("ok"); }} |
补充：
1、负载均衡的Log4J Appender
修改log4j的配置即可：
1 2 3 | log4j.rootLogger=INFO,flumelog4j.appender.flume = org.apache.flume.clients.log4jappender.LoadBalancingLog4jAppenderlog4j.appender.flume.Hosts = 192.168.1.111:41414 192.168.1.111:41414 |
不同的host用空格分隔
2、Log4J Appender也可以使用layout，如下：
1 2 3 4 5 6 7 8 9 10 11 12 | log4j.rootLogger=INFO,console,flumelog4j.appender.flume = org.apache.flume.clients.log4jappender.Log4jAppenderlog4j.appender.flume.Hostname = 192.168.1.111log4j.appender.flume.Port = 41414log4j.appender.flume.UnsafeMode = truelog4j.appender.flume.layout=org.apache.log4j.PatternLayoutlog4j.appender.flume.layout.ConversionPattern=%-d{yyyy-MM-dd HH:mm:ss,SSS} [%c]-[%p] %m%nlog4j.appender.console=org.apache.log4j.ConsoleAppenderlog4j.appender.console.layout=org.apache.log4j.PatternLayoutlog4j.appender.console.layout.ConversionPattern=%-d{yyyy-MM-dd HH:mm:ss,SSS} [%c]-[%p] %m%n |
Log4J Appender - 将Log4J的日志内容发送到agent的source
原文：http://www.cnblogs.com/lishouguang/p/4560889.html