1）配置flume(flume-kafka.conf)

# definea1.sources = r1a1.sinks = k1a1.channels = c1# sourcea1.sources.r1.type = execa1.sources.r1.command = tail -F -c +0 /opt/module/datas/flume.loga1.sources.r1.shell = /bin/bash -c# sinka1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSinka1.sinks.k1.kafka.bootstrap.servers = hadoop202:9092,hadoop203:9092,hadoop204:9092a1.sinks.k1.kafka.topic = firsta1.sinks.k1.kafka.flumeBatchSize = 20a1.sinks.k1.kafka.producer.acks = 1a1.sinks.k1.kafka.producer.linger.ms = 1# channela1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100# binda1.sources.r1.channels = c1a1.sinks.k1.channel = c1

2） 启动kafkaIDEA消费者

bin/kafka-console-consumer.sh --zookeeper hadoop202:2181 --from-beginning --topic first

3） 进入flume根目录下，启动flume

bin/flume-ng agent -c conf/ -n a1 -f jobs/flume-kafka.conf