Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

• The role of Kafka in modern data workflows
• Key distinctions between Apache Kafka and Confluent Kafka
• Essential components: producers, consumers, brokers, topics, and partitions
• Deployment models and scaling strategies for Kafka clusters

Module 2: Configuring Zookeeper Quorums

• Introduction to Zookeeper
• Zookeeper’s function within a Kafka cluster
• Determining appropriate Zookeeper Quorum sizes
• Zookeeper configuration specifics
• Setting up SSH on servers
• Practical session: Configuring Zookeeper (as a team and as a service)
• Utilizing the Zookeeper Command Line Interface (CLI)
• Practical session: Configuring Zookeeper Quorums
• The Zookeeper internal file system
• Performance factors impacting Zookeeper
• Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Configuring Kafka Clusters

• Foundational Kafka concepts
• General Kafka configuration
• Practical session: Configuring Kafka brokers
• Practical session: Executing Kafka commands
• Practical session: Setting up a Kafka Multi-Broker Cluster
• Practical session: Testing the Kafka cluster
• Connectivity checks: Can I connect to my Kafka cluster?
• The Advertised.listeners setting: A critical configuration
• Topic configuration
• Configurations for downloading and ingesting messages in topics
• Practical session: Demonstrating Kafka resilience
• Kafka performance: I/O
• Kafka performance: Network (RED)
• Kafka performance: RAM
• Kafka performance: CPU
• Kafka performance: Operating System (OS)
• Kafka performance: Other factors
• Practical session: Modifying Kafka broker configuration

Module 4: Advanced Kafka Configuration

• Landoop Kafka topic interface, Confluent REST Proxy, and Confluent Schema Registry setup
• Message sending and receiving (via CLI, Java, and Spring framework)
• Monitoring metrics and tools (including Confluent Control Center and Elasticsearch)
• Log files and offset management
• High availability and disaster recovery planning
• Achieving high availability through replication
• Optimizing producer and consumer performance
• Disaster recovery strategies
• Failover management and data recovery
• Connector configuration
• Implementing Kafka Connect
• Kafka security features

Summary and Future Steps