Docker Quick Start Full Docker Compose
Docker Quick Start Update The Ports

On Linux you do something like sudo service docker stop, but this is incompatible with MacOS.

Not the answer youre looking for Browse other questions tagged macos daemons docker.

Does my CPU in Macbook Pro 2010, support the hypervisor framework If so, why does sysctl kern.hvsupport return 0.

This site is not affiliated with or endorsed by Apple Inc.

Kafka is not only a highly-available and fault-tolerant system; it also handles vastly higher throughput compared to other message brokers such as RabbitMQ or ActiveMQ.

Docker with Docker Compose is the quickest way to get started with Apache Kafka and to experiment with clustering and the fault-tolerant properties Kafka provides.

Docker Quick Start Full Docker Compose

A full Docker Compose setup with 3 Kafka brokers and 1 ZooKeeper node can be found here.

Producers and consumers are the main clients that interact with Kafka, which well take a look at once we have a running Kafka broker.

It also helps demonstrate how Kafka brokers utilize ZooKeeper and shows the ports of the running services.

In this tutorial, well start by running one Apache Kafka broker and one ZooKeeper node (seen above in blue).

Later on, well form a three node cluster by adding in two more Kafka brokers (seen above in green).

You can verify this by running the following command; you should see a similar output.

Using your favorite text editor or IDE, create a file named docker-compose.yml in your new directory.

In the Docker Compose YAML file, define a zookeeper service as shown below.

This allows ZooKeeper to persist data even if you destroy the container.

You can verify this utilizing netcat in a new terminal window.

Were calling this kafka2 as it will have a broker id of 2 and run on the default port of 9092.

This is to demonstrate that order does not matter and broker id s are just for identification.

Youll see a lot of logs being printed and then Kafka should be running We can verify this by creating a topic.

Kafka with broker id 2 is exposed on port 9092 and ZooKeeper on port 2181.

To remove the containers if they dont get removed as a part of down, you can run docker-compose rm.

Docker Quick Start Update The Ports

Essentially, we update the ports, the broker ID, and the data directory on the host.

Data is persisted outside of the container on the local machine which means you can delete containers and restart them without losing data.

For next steps, Id suggest playing around with Kafkas fault tolerance and replication features.

Docker For Mac Quick Start