Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • Understanding Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The pivotal role of Kafka in data streaming and messaging workflows
  • Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center
  • Cluster architecture details: brokers, partitions, and replication

Module 2: Configuring the Zookeeper Quorum

  • An introduction to Zookeeper
  • Zookeeper’s function within a Kafka cluster
  • Determining optimal Zookeeper quorum sizes
  • Managing Zookeeper configuration parameters
  • Implementing SSH on server nodes
  • Hands-on: Configuring Zookeeper as both a team and a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing the Zookeeper quorum
  • Exploring Zookeeper’s internal file system structure
  • Key performance factors influencing Zookeeper
  • Demo: Introduction to Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamental concepts of Kafka
  • Basics of Kafka configuration
  • Hands-on: Setting up Kafka on a single broker
  • Hands-on: Running basic Kafka commands
  • Hands-on: Deploying a multi-broker Kafka cluster
  • Hands-on: Testing the stability of the Kafka cluster
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: critical settings
  • Managing topic configurations
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka’s resilience capabilities
  • Performance considerations: I/O, network, RAM, CPU, and OS interactions
  • Kafka performance: additional influencing factors
  • Hands-on: Modifying broker configurations for optimal results

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message transmission and reception methods (CLI, Java, Spring Framework)
  • Employing metrics and monitoring tools (Confluent Control Center, Elasticsearch, etc.)
  • Managing log files and offset controls
  • Strategies for high availability and disaster recovery
  • Ensuring high availability through replication
  • Performance tuning for producers and consumers
  • Developing disaster recovery plans
  • Controlling failover processes and managing data recovery
  • Setting up connectors
  • Implementing Kafka Connect
  • Reviewing Kafka security features

Course Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line interfaces
  • A solid grasp of distributed systems concepts
  • A fundamental understanding of networking and system configuration

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments
  • System administrators overseeing Confluent and Zookeeper environments
  • Kafka developers and architects focused on building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories