Skip to content

Latest commit

 

History

History
44 lines (35 loc) · 3.53 KB

kafka-setup.md

File metadata and controls

44 lines (35 loc) · 3.53 KB

Install Kafka & schedule brokers

Step 1: In the DC/OS dashboard navigate to 'Universe'. The 'Universe' is where you can manage what packages (mesos frameworks) your cluster can make use of.

Step 2: Scroll down in the 'Universe' package listings to find the 'Kafka' package and click it's corresponding 'Install' button.

Step 3: Click the 'Install Package' button to start the package installation process.

Step 4: Click the 'Advanced Installation' link to fine tune the installation parameters.

Step 5: Click the 'service' parameter group, scroll through it's available options, and keep all defaults.

Step 6: Click the 'brokers' parameter group and scroll through it's available options.

Step 7: Find the 'count' parameter and change the value to the number of brokers you desire, for the purpose of the demo we will keep the default of '3'.

Step 8: Click the 'kafka' parameter group and scroll through it's available options.

Step 9: Find the 'delete.topic.enable' parameter and enable it so that we will be able to delete topics between demo runs.

Step 10: Click the 'Review and Install' button and review the parameters values.

Step 11: Click the 'Install' button to install the package and click the 'Acknowledge (check)' button.

Step 12: In the DC/OS dashboard navigate to 'Services'. The 'Services' tab is where you can monitor what services have been scheduled and are running on the DC/OS cluster. Notice there is a Service named 'kafka' that now appears.

Step 13: Click on 'kafka' in the service listing to open up more information on the 'kafka' service. Here we can see the three brokers, their names, their status, and the resources that have been allocated to them.

Step 14: Install the dcos-cli (Command Line Interface) by grabbing the binaries for your operating system at https://github.com/dcos/dcos-cli/releases

Step 15: Using the dcos-cli we can interact with Kafka. Type 'dcos kafka --help' to see the available commands.


Step 16: You can get a listing of broker names. Type 'dcos kafka broker list'.


Step 17: You can get connection details which is needed information to share with Kafka producers. Type 'dcos kafka connection'.



Congratulations: You now have Kafka installed with three brokers ready to receive data on the DC/OS cluster. Next, we will walk through how to Install & schedule an Elasticsearch cluster