Kafka Operation & Administration

מק"ט: #35659 | משך קורס: 16 שעות אק'
| מספר מפגשים: 2

Kafka is one of the most popular and hot topics in today's software architectures. If you are unfamiliar with Kafka - It’s a scalable, highly available and fault-tolerant Apache distributed streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged streaming platform.

הקורס פעיל לקבוצות מטעם ארגונים בלבד, ניתן לשלוח פנייה רק אם מדובר בקבוצה
*שדות חובה
PDF version

מטרות

  • Master Concepts such as Topics, Partitions, Brokers, Producers, Consumers
  • Learn major CLIs: kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups, kafka-configs
  • Start a personal Kafka development environment
  • Kafka Java Programming 101
  • Real World Twitter Producer & ElasticSearch Consumer
  • Extended APIs Overview (Kafka Connect, Kafka Streams), Case Studies and Architecture

קהל יעד

  • IT Personal
  • DevOps
  • Architecture Experts
  • Developers
  • Team Leaders
  • Anyone considering implementing Kafka

תנאי קדם

  • Familiarity with Linux commands
  • Microservices architecture 

נושאים

  • Why should you use Docker as a developer?
    • What is Docker?
    • Docker benefits
    • Docker tools
    • Docker in Action
  • Kafka Introduction
    • Brief history and intro to the world and idea behind Kafka
    • Our objective in this course
  • Kafka Architecture and need to know
  • Kafka Architecture dive in
    • Topics, Partitions and offsets
    • Brokers and topics
    • Replication of topics
    • Producers and messages keys
      • Consumer groups
    • Offsets and semantics for delivery
    • Multi brokers and discoveries
    • ZooKeeper
      • What is ZooKeeper
      • Why Kafka needs it
      • How it works inside Kafka
    • Kafka data Guarantees
    • Summary
    • Quiz
  • Installing Kafka
    • Linux
    • Dockers
  • Kafka CLI
    • Administrating and controlling Kafka
      • Producer CLI
      • Consumer CLI
      • Groups and Offsets
      • Kafka UI
    • LAB
  • Code example for Kafka with Go
    • Producer, callbacks, KEYS
    • Consumer and Groups and threads
    • Quiz
    • Kafka case stories - Real world examples and implementations
    • Kafka Elasticsearch consumer & configurations
  • Elasticsearch 101
    • Configuring and using a consumer and provider to send information to Elasticsearch


Environment Requirements:
Prerequisites to be installed on each Student laptop, please follow this guide for installation:

If there isn't a way to install Dockers on Student computers, John Bryce can offer a private Cloud with dedicated Linux machine and Docker installed. 

תגיות