קורסים מקצועיים למתקדמים

DevOps

Kafka Zero to Hero

מספר הקורס 35677

למה ללמוד בג'ון ברייס?
  • למידה חדשנית ודינמית עם כלים מתקדמים בשילוב סימולציות, תרגול וסביבות מעבדה
  • מגוון הכשרות טכנולוגיות עם תכנים המותאמים להתפתחות הטכנולוגית ולביקוש בתעשיית ההייטק
  • מובילים את תחום ההכשרות לעולם ההייטק והטכנולוגיה כבר 30 שנה, עם קהילה של עשרות אלפי בוגרים
  • אתם בוחרים איך ללמוד: פרונטאלית בכיתה, מרחוק ב- Live Class או בלמידה עצמית

המועדים הקרובים

קורס לקבוצות

הקורס נפתח במתכונת של קבוצה בלבד, בהתאמה אישית לארגונים.
לפרטים נוספים: Muzman@johnbryce.co.il

משך הקורס

שעות לימוד:

24

מספר מפגשים:

קורס בוקר:

3

מתכונת הקורס

הקורסים המוזמנים לארגונים מותאמים באופן אישי ומלא לצרכי הארגון, מערכי הלימוד גמישים וניתן לשלב בהם תכנים רלוונטיים וייעודיים.

Overview

Welcome to “Kafka from Zero to Hero,” a 3-day course designed for beginners who are eager to learn Apache Kafka. This course will take you on a journey from understanding the basic concepts of Kafka to mastering its advanced features. By the end of this course, you will not only understand the fundamental principles of Kafka but also be able to apply them in real-world scenarios. No prior knowledge of Kafka is required, making this the perfect course for those looking to get started with this powerful streaming platform.

The course will delve into many microservices design discussions, exploring patterns such as Command Query Responsibility Segregation (CQRS) and event sourcing with practical examples and labs. This interactive and engaging course provides plenty of opportunities for participants to apply what they’ve learned, ensuring a thorough understanding of Apache Kafka’s capabilities and best practices

מטרות הקורס

Who Should Attend?

Developers

Architects

DevOps

QA

תכנית הלימודים

Full syllabus

Day 1: Introduction and Kafka Basics

  • Welcome and Introductions
    • Introduction to the Course and Participants
    • Expectations and Goals
    • Pre-requisites and Course Materials
  • Course Overview
    • Scope and Objectives
    • Course Materials and Resources
    • Assessment and Evaluation Criteria
  • Brief History and Introduction to Kafka
    • Evolution of Kafka
    • Use Cases and Applications
    • Industry Adoption and Community Support
  • Messaging vs Streaming Systems
    • Comparison and Contrast
    • When to Use Each
    • Integration with Other Systems
  • Kafka Architecture
    • Kafka’s Architecture and the Need to Know
      • Core Components and Their Roles
      • Data Flow and Processing
      • Scalability and Performance Considerations
    • Diving into Kafka’s Architecture
      • Topics, Partitions, and Offsets
        • Creation and Management
        • Data Retention and Cleanup
      • Brokers and Clusters
        • Broker Responsibilities
        • Cluster Coordination
      • Exploring Brokers and Topics
        • Broker Configuration and Tuning
        • Topic Management and Best Practices
        • Monitoring and Metrics
      • Replication and Producers
        • Replication of Topics
          • How Replication Works
          • Fault Tolerance and Data Integrity
          • Leader Election and Follower Synchronization
        • Understanding Producers
          • Producer Roles and Responsibilities
          • Producer APIs and Libraries
          • Batch Processing and Throughput Optimization
        • Producer Configuration
          • Configuration Options and Defaults
          • Performance Tuning and Best Practices
          • Error Handling and Recovery
        • Message Keys and Acknowledgments (ack all)
          • Importance of Keys in Partitioning
          • Acknowledgment Levels and Their Impact
          • Tuning for Reliability vs Performance
        • Compression Techniques
          • Available Compression Types and Algorithms
          • When and How to Use Compression
          • Impact on Performance and Storage
        • Hands-on with Producers
          • Creating Producers with Different Configurations
          • Sending Messages with Different Formats
          • Monitoring and Debugging Producers
        • Consumer Groups and KRaft
          • Introduction to Consumer Groups
            • Consumer Group Concepts and Architecture
            • Balancing Consumers and Rebalancing
            • Monitoring and Managing Consumer Groups
          • Consumer Configuration
            • Configuration Options and Defaults
            • Performance Tuning and Best Practices
            • Error Handling and Recovery
          • Consumer Types and Offsets
            • Different Types of Consumers and Their Use Cases
            • Offset Management and Storage
            • Offset Commit Strategies and Impact
          • Delivery Semantics
            • At-Least-Once, At-Most-Once, Exactly-Once
            • Pros and Cons of Each Semantics
            • Consumer Configuration for Different Semantics
            • Strategies for Achieving Desired Semantics
          • Hands-on with Consumer Groups
            • Creating and Managing Consumer Groups with Different Configurations
            • Consuming Messages with Different Semantics
            • Monitoring and Debugging Consumer Groups
          • Introduction to KRaft: What it is and Why Kafka Uses it
            • Understanding How KRaft Works Inside Kafka
              • KRaft Mode vs ZooKeeper Mode
              • Benefits and Drawbacks of KRaft
              • Migration from ZooKeeper to KRaft
            • Hands-on with KRaft
              • Setting Up KRaft Mode
              • Basic Operations and Administration
              • Monitoring and Troubleshooting KRaft

Day 2: Kafka CLI, Rebalancing, and Advanced Features

  • Kafka CLI and Administration
    • Overview of Kafka CLI
      • Common CLI Commands and Their Syntax
      • Managing Clusters, Brokers, and Topics
      • Monitoring and Metrics Collection
    • Administrating and Controlling Kafka
      • Broker Management and Maintenance
      • Topic Creation, Deletion, and Configuration
      • Security and Access Control
    • Working with Producer and Consumer CLI
      • Sending and Receiving Messages
      • Monitoring Tools and Utilities
      • Automation and Scripting with CLI
    • Hands-on with Kafka CLI
      • Practical Exercises with CLI Commands
      • Automation and Scripting Exercises
      • Troubleshooting and Debugging with CLI
    • Advanced Topics: Rebalancing, Kafka Patterns, and Best Practices
      • Understanding Rebalancing and its Implications
        • Rebalancing Process and Triggers
        • Impact on Performance and Availability
        • Monitoring and Managing Rebalancing
      • Kafka Patterns in Microservices
        • Common Patterns and Anti-Patterns
        • Integration with Other Microservices Tools
        • Case Studies and Examples
      • Best Practices for Using Consumers and Producers
        • Performance Considerations and Tuning
        • Reliability and Scalability Best Practices
        • Monitoring and Alerting Strategies
      • Hands-on with Advanced Concepts
        • Implementing Patterns and Anti-Patterns
        • Performance Tuning and Optimization
        • Building Monitoring and Alerting Solutions
      • Kafka Security
        • Importance and Implementation of Kafka Security
          • Security Protocols and Mechanisms
          • Authentication and Authorization Strategies
          • Encryption and Data Protection
        • Hands-on with Kafka Security
          • Configuring Security for Different Scenarios
          • Testing Security Measures and Compliance
          • Troubleshooting Security Issues
        • Kafka Connect and Streams
          • Understanding Kafka Connect and Kafka Stream
            • Connectors, Tasks, and Workers
            • Stream Processing Concepts and Architecture
            • Integration with Other Streaming Solutions
          • Overview of KSQL
            • SQL-like Querying for Streams
            • Use Cases and Limitations
            • Performance Considerations and Tuning
          • Kafka Mirroring
            • Mirroring Concepts and Architecture
            • Configuration and Use Cases
            • Monitoring and Troubleshooting Mirroring
          • Hands-on with Kafka Connect and Streams
            • Building Custom Connectors and Streams
            • Querying Data with KSQL
            • Monitoring and Debugging Connect and Streams

Day 3: Kafka in Real World Applications and Design Patterns

 

  • Kafka Connect
    • Moving Data in and out of Kafka Data Lake
      • Connectors, Configuration, and Management
      • Monitoring, Logging, and Alerting
      • Performance Tuning and Scalability
    • Hands-on with Kafka Connect
      • Building and Deploying Custom Connectors
      • Monitoring and Troubleshooting Connectors
      • Performance Tuning and Optimization
  • Kafka Stream and KSQL
    • Event-Driven Architecture with Kafka (In MSA)
      • Concepts, Patterns, and Best Practices
      • Integration with Other Event-Driven Tools
      • Case Studies and Real-world Examples
    • Hands-on with Kafka Stream and KSQL
      • Building Event-Driven Applications
      • Querying and Analyzing Data with KSQL
      • Monitoring and Debugging Streams and KSQL
  • Kafka Case Studies
    • Real-world Examples and Implementations
      • Industry Use Cases and Success Stories
      • Lessons Learned and Common Pitfalls
      • Group Discussions and Analysis
    • Hands-on Case Study Analysis
      • Analyzing Real-world Scenarios and Solutions
      • Group Projects and Presentations
      • Peer Review and Feedback
  • Troubleshooting
    • Common Problems and How to Solve Them
      • Identifying and Diagnosing Issues
      • Debugging Tools and Techniques
      • Recovery and Mitigation Strategies
    • Hands-on with Troubleshooting Techniques
      • Practical Exercises with Common Problems
      • Using Tools and Techniques for Troubleshooting
      • Building Automated Recovery Solutions
  • Kafka Design Patterns and Best Practices
    • Kafka Design Patterns in the World of Microservices
      • Common Patterns and How to Implement Them
      • Anti-Patterns and How to Avoid Them
      • Integration with Other Microservices Patterns
    • Best Practices for Using Kafka in Different Scenarios
      • Performance, Scalability, and Reliability Best Practices
      • Security and Compliance Considerations
      • Monitoring, Logging, and Alerting Strategies
    • Hands-on with Design Patterns and Best Practices
      • Implementing Design Patterns in Real-world Scenarios
      • Applying Best Practices to Existing Solutions
      • Building Comprehensive Kafka Solutions

This syllabus covers a wide range of topics from the basics to more advanced concepts, including hands-on exercises and real-world applications. It’s designed to provide a comprehensive understanding of Kafk

Prerequisites

Participants are expected to have a good understanding of Microservice architecture and prior hands-on experience with the idea of Asynchronous operation would be beneficial

Schedule Appointment

Fill out the form below, and we will be in touch shortly.

לא הצלחנו לאתר את הטופס.