Kafka

Books / Articles

• Kafka: The Definitive Guide, Real-Time Data and Stream Processing at Scale - notes for it at book-notes -> kafka
• Apache Kafka in a Nutshell Architecture, Use Cases, and a Getting Started guide — rolled into one
• Effective Kafka, Emil Koutanov - by the author of Kafdrop
• Setting Up Your Local Event-Driven Environment Using Kafka Docker
• Contrasting NATS with Apache Kafka
• 7 part series on, Microservices, Event Systems and Kafka The Data Dichotomy: Rethinking the Way We Treat Data and Services

Installing

• Confluent Docker Images

Demos / POCs / Examples

• Confluent Platform Demo (cp-demo) and the github repo confluentinc/cp-demo
• Confluent Demos - Scripts and samples to support Confluent Platform talks

Monitoring

• Kafdrop – Kafka Web UI
  • Reintroducing Kafdrop 3
  • Kafdrop: I can see you, Protobuf - describing the usage of protobuf schemas in Kafdrop
  • Open-Source Web UI for Apache Kafka - a quick run through of the Kafdrop GUI
• CMAK - previously known as Kafka Manager

Schema Registry

• Github -> Confluent Schema Registry for Kafka
• Schema Registry Overview
• Schema Registry Tutorials
• Add Schema Registry to Kafka in Your Local Docker Environment
  • Tutorial of starting and configuring the Schema Registry in docker compose

Kafka Connect

• How to Use Single Message Transforms in Kafka Connect
• The Simplest Useful Kafka Connect Data Pipeline in the World…or Thereabouts – Part 1
  • streaming data from MySql into kafka and into ElasticSearch
  • a webcast on this POC From Zero to Hero with Kafka Connect - slides and demo code
• Kafka Connect Deep Dive – Error Handling and Dead Letter Queues
• Kafka Connect Deep Dive – JDBC Source Connector
• Debezium
  • connectors for Mysql, PostgreSQL and more based on log based CDC (change data capture)
  • Mysql tutorial