How To Install Apache Kafka On Ubuntu 22.04

In this tutorial, we will walk you through the step-by-step process of installing Apache Kafka on Ubuntu 22.04, enabling you to leverage its powerful features for your data streaming needs. Apache Kafka is an open-source distributed event streaming platform that allows you to build real-time data pipelines and streaming applications. Let’s dive in!

Table of Contents

Section 1: Prerequisites

Before we begin, let’s ensure that your Ubuntu 22.04 server meets the necessary requirements for installing Apache Kafka:

Ubuntu 22.04 LTS installed and updated.
Java Development Kit (JDK) installed (minimum version 8).
Sudo privileges for executing administrative commands.
Sufficient disk space and memory for optimal performance.

Section 2: Installing Java Development Kit

Apache Kafka on Ubuntu relies on Java, so we need to install the JDK. Follow these steps:

Step 1: Update the package index:

sudo apt update

Step 2: Install the default JDK:

sudo apt install default-jdk

Step 3: Verify the installation:

java -version

Section 3: Downloading and Extracting Apache Kafka

Now, let’s download and extract the Apache Kafka on Ubuntu binaries:

Step 1: Visit the Apache Kafka website (https://kafka.apache.org/downloads) and check for the latest stable release.

Step 2: Download the Kafka binaries using wget or your preferred method:

wget https://downloads.apache.org/kafka/3.4.0/kafka_2.13-3.4.0.tgz

Step 3: Extract the downloaded archive:

tar -xzf kafka_2.13-3.4.0.tgz

Section 4: Configuring Apache Kafka

To configure Apache Kafka, we’ll make some modifications to the default settings:

cd kafka_2.13-3.4.0/

Step 2: Open the server.properties file using a text editor:

nano config/server.properties

Step 3: Adjust the settings according to your requirements, such as changing the broker ID, listeners, and log directories.

Section 5: Starting Apache Kafka

Now, let’s start the Apache Kafka server:

Step 1: Open a new terminal window and navigate to the Kafka directory.

Step 2: Start the ZooKeeper service:

bin/zookeeper-server-start.sh config/zookeeper.properties

How to Install Apache Kafka on Ubuntu 22.04

Step 3: In a separate terminal window, start the Kafka broker:

bin/kafka-server-start.sh config/server.properties

Section 6: Testing Apache Kafka

To ensure Apache Kafka is installed correctly, let’s perform a simple test:

Step 1: Create a new topic:

bin/kafka-topics.sh --create --topic test-topic --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1

Step 2: Produce a test message:

bin/kafka-console-producer.sh --topic test-topic --bootstrap-server localhost:9092

Step 3: Consume the message:

bin/kafka-console-consumer.sh --topic test-topic --bootstrap-server localhost:9092 --from-beginning

Final Thoughts

Congratulations! You have successfully installed Apache Kafka on Ubuntu 22.04. Now, you can harness the power of real-time data streaming for your applications. Explore Kafka’s extensive documentation to discover more advanced features and unlock its full potential.

By following this comprehensive tutorial, you have learned how to install Apache Kafka on Ubuntu, configure its settings, and perform a basic test. Now you can leverage Apache Kafka to build scalable and efficient data pipelines. Enjoy your journey into the world of event streaming!

Remember, the possibilities with Apache Kafka are vast, so keep experimenting and learning to make the most out of this incredible platform.