Kafka installation and starting server – Part 2

Here in this blog we will discuss about how to install kafka and will try to show through an example how to start server in up and running mode followed by realtime streaming between producer and consumer accross different kafka-topics(next part)

Kafka installation includes two components to be installed and placed to running mode , i.e., Kafka and zookeeper. Zookeeper is also a component in hadoop Ecosystem which acts like a base layer holding the kafka cluster, in other words Kafka cluster is managed by zookeeper.

As hadoop is most compatible with Unix based OS, it would be the best platform for installation, however if you are using a windows machine, you can go for any virtual machine tools like VMware or VirtualBox so as to launch unix in windows directly ( VMs can launch unix directly without any separate OS installation). Use the link below for downloading kafka.

https://www.apache.org/dvn/closer.cgi?path=/kafka/1.0.0/kafka_2.11-1.0.0.tgzkafka_installation_2

Then run the following commands in the unix

tar -xzf kafka_2.11-1.0.0

cd kafka_2.11-1.0.0

you can also download other versions available, based on the version you download the above command will change accordingly(version name changes)

As we discussed earlier, zookeeper is also required for the running kafka, we need to install zookeeper aswell. Zookeeper needs to be started first before starting kafka server. Follow the link below where you can find the zookeeper installation dump

http://www-eu.apache.org/dist/zookeeper/

kafka_inst_3

Select the version 3.3.6 or any other latest stable version and run the below command

tar -xzf zookeeper-3.3.6.tar.gz

cd zookeeper-3.3.6

bin/zkServer.sh start

OR RUNBELOW COMMANDS

cd kafka_2.11-1.0.0

bin/zookeeper-server-start.sh config/zookeeper.properties

Use the command below for starting the kafka server

bin/kafka-server-start.sh config/server.properties

kafka_inst_4

kafka_inst_5kafka_inst_6

Zookeeper and Kafka servers are now up and running state. Now the next step would be channel establishing and topic creation for realtime streaming.

In the upcoming sessions we will discuss about Realtime Kafka Producer and Consumer Streaming mechanism with an Example.

Keep an eye on this page 🙂

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s