Kafka - Topics CLI 🚿

Refer back to the theories section for more information on topics.

Description 👀

Used for Kafka topic management. (i.e create, delete, list, describe, etc.)

Basic Commands 📝

• get topics functionalities

  kafka-topics.sh
  

• get list of topics

  kafka-topics.sh --bootstrap-server <kafka-broker> --list
  

• create a topic

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --create
  

• create a topic with partitions

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --create --partitions <number-of-partitions>
  

• create a topic with replication-factor

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --create --replication-factor <replication-factor>
  

• create a topic with partitions and replication-factor

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --create --partitions <number-of-partitions> --replication-factor <replication-factor>
  

• describe a topic

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --describe
  

• delete a topic

  kafka-topics.sh --bootstrap-server <kafka-broker> --topic <topic-name> --delete
  

Examples 🧩

• get help for kafka-topics

    kafka-topics --help
  

• list all topics in the cluster

    kafka-topics.sh --bootstrap-server localhost:9092 --list
  

  • --bootstrap-server is the Kafka broker to connect to

• create a topic

    kafka-topics.sh --bootstrap-server localhost:9092 --create --topic first_topic
  

• create a topic with a partition count of 3

    kafka-topics.sh --bootstrap-server localhost:9092 --create --topic second_topic --partitions 3
  

  
  

• create a topic with a partition count of 3 and a replication factor of 2

    kafka-topics.sh --bootstrap-server localhost:9092 --create --topic third_topic --partitions 3 --replication-factor 2
  

  • will error since the replication factor is greater than the number of brokers available

• create a topic with a partition count of 3 and a replication factor of 1

    kafka-topics.sh --bootstrap-server localhost:9092 --create --topic third_topic --partitions 3 --replication-factor 1
  

  • now it works since the replication factor is less than or equal to the number of brokers available

• describe a topic

    kafka-topics.sh --bootstrap-server localhost:9092 --describe --topic third_topic
  

  • output

    🚀  kafka-zero-to-pro ➜ kafka-topics.sh --bootstrap-server localhost:9092 --describe --topic third_topic
    Topic: third_topic      TopicId: ePbXIDTPToa3OP2q_UAqYw PartitionCount: 3       ReplicationFactor: 1    Configs: segment.bytes=1073741824
    Topic: third_topic      Partition: 0    Leader: 1       Replicas: 1     Isr: 1
    Topic: third_topic      Partition: 1    Leader: 1       Replicas: 1     Isr: 1
    Topic: third_topic      Partition: 2    Leader: 1       Replicas: 1     Isr: 1
    

• delete a topic

    kafka-topics.sh --bootstrap-server localhost:9092 --delete --topic first_topic
  

↩️