Kafka的安装及测试

1、zokeeper的安装及配置

• 在zokeeper的conf目录下新建zoo.cfg文件，在里面配置如下内容

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/opt/app/zookeeper-3.4.5/data
# the port at which the clients will connect
clientPort=2181
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1 

server.1=bigdata.eclipse.com:2888:3888

• 在zokeeper在创建data目录，并在data目录中创建myid文件，文件内容为“1”
• 启动zokkper服务

##启动服务
bin/zkCli.sh start
##查看状态
bin/zkCli.sh status
##进入客户端
bin/zkCli.sh
##查看zokeeper管理的客户端
ls /

1、kafka的安装及测试

• 1) Start the server

bin/kafka-server-start.sh config/server.properties

• 2) Create a topic

bin/kafka-topics.sh --create --zookeeper bigdata.eclipse.com:2181 --replication-factor 1 --partitions 1 --topic test_topic 

bin/kafka-topics.sh --list --zookeeper bigdata.eclipse.com:2181

• 3) Send some messages

bin/kafka-console-producer.sh --broker-list bigdata.eclipse.com:9092 --topic test_topic

This is a message
This is another message

• 4) Start a consumer，可以多开几个窗口接受消息

bin/kafka-console-consumer.sh --zookeeper bigdata.eclipse.com:2181 --topic test_topic --from-beginning