Here in this blog we will discuss about how to install kafka and will try to show through an example how to start server in up and running mode followed by realtime streaming between producer and consumer accross different kafka-topics(next part)
Kafka installation includes two components to be installed and placed to running mode , i.e., Kafka and zookeeper. Zookeeper is also a component in hadoop Ecosystem which acts like a base layer holding the kafka cluster, in other words Kafka cluster is managed by zookeeper.
As hadoop is most compatible with Unix based OS, it would be the best platform for installation, however if you are using a windows machine, you can go for any virtual machine tools like VMware or VirtualBox so as to launch unix in windows directly ( VMs can launch unix directly without any separate OS installation). Use the link below for downloading kafka.
https://www.apache.org/dvn/closer.cgi?path=/kafka/1.0.0/kafka_2.11-1.0.0.tgz
Then run the following commands in the unix
tar -xzf kafka_2.11-1.0.0
cd kafka_2.11-1.0.0
you can also download other versions available, based on the version you download the above command will change accordingly(version name changes)
As we discussed earlier, zookeeper is also required for the running kafka, we need to install zookeeper aswell. Zookeeper needs to be started first before starting kafka server. Follow the link below where you can find the zookeeper installation dump
http://www-eu.apache.org/dist/zookeeper/
Select the version 3.3.6 or any other latest stable version and run the below command
tar -xzf zookeeper-3.3.6.tar.gz
cd zookeeper-3.3.6
bin/zkServer.sh start
OR RUNBELOW COMMANDS
cd kafka_2.11-1.0.0
bin/zookeeper-server-start.sh config/zookeeper.properties
Use the command below for starting the kafka server
bin/kafka-server-start.sh config/server.properties
Zookeeper and Kafka servers are now up and running state. Now the next step would be channel establishing and topic creation for realtime streaming.
In the upcoming sessions we will discuss about Realtime Kafka Producer and Consumer Streaming mechanism with an Example.
Keep an eye on this page 🙂
TechBus 