From version 4 onwards, Apache Kafka uses KRaft for cluster management instead of Apache ZooKeeper. Therefore, you no longer need to bring up and run a container for Apache ZooKeeper as instructed in this tutorial. In this tutorial, I will guide you on how to… Read More

Apache Kafka Connect is an Apache Kafka tool for data integration, which helps us stream data between different data systems with Apache Kafka. It can help you ingest all data from a database or collect metrics information of your application into an Apache Kafka topic,… Read More

Apache Kafka is an open-source distributed event streaming platform that helps us create and process real-time data streams. You can imagine systems where data is generated every second and needs to be processed, such as traffic management systems, weather management systems, data will be generated… Read More

To work with Apache Kafka, you need to understand some basic concepts about: Producer Consumer Broker Cluster Topic Topic Partitions Partition Offset Consumer Group Producer Producers are applications that produce data and send data to Apache Kafka Server. This data will be formatted messages, sent… Read More

After installing Apache Kafka, you can use the Apache Kafka CLI tool to work with topics in the Apache Kafka server. Create a new topic We will use the Apache Kafka CLI’s kafka-topics.sh file to work with topics in the Apache Kafka server. To create… Read More

Apache Kafka from version 4.x onwards only supports KRaft mode, but if you need to work with ZooKeeper mode, you can refer to this tutorial to install Apache Kafka with ZooKeeper mode! Installing Apache Kafka using Docker Compose will help us quickly start up an… Read More

In this tutorial, I will show you how to install Apache Kafka on macOS! First, go to Apache Kafka’s Download page at https://kafka.apache.org/downloads to download its latest version! After the download is complete, please unzip this download file: Apache Kafka depends on Apache ZooKeeper for cluster… Read More