Search

Lessons (20)

• Kafka vs RabbitMQ & the Kafka Ecosystem

  When to choose Kafka and when a traditional broker like RabbitMQ fits better, plus a tour of Kafka …

• What Is Apache Kafka?

  … They don't affect each other. A first taste (Node.js with KafkaJS) js import { Kafka } from "kafkajs …

• Kafka Producers

  … A Kafka producer works the same way: it batches records, compresses them, sends them to the right partition …

• Delivery Guarantees: At-Most, At-Least & Exactly Once

  Can a message be lost? Delivered twice? Learn Kafka's three delivery semantics, idempotent producers, transactions for read …

• Brokers, Replication & Durability

  How Kafka survives server failures. Brokers, leaders and followers, in-sync replicas, min.insync.replicas, leader election and …

• Topics, Partitions & Offsets

  How Kafka organises data. Why topics are split into partitions, how message keys decide the partition and keep …

• Data in Microservices: Sagas & the Outbox Pattern

  … succeeds await kafka.publish("OrderCreated", order); // 2. crashes here → event never sent 😱 mermaid flowchart LR S[Orders service …

• Consumers & Consumer Groups

  … This is the committed offset , saved in Kafka's internal consumer offsets topic. If a consumer crashes, its …

• Scaling & Health Probes

  … scale consumers on Kafka lag triggers: - type: kafka metadata: bootstrapServers: kafka:9092 consumerGroup: email-service topic: shop.orders …

• Event-Driven Architecture

  … store processed event IDs Ordering Partition by entity key (Kafka); include versions/timestamps Lost events when saving + publishing …

• Which Pattern Do I Need?

  … the Microservices and Kafka lessons: Object-level pattern System-level cousin --- --- Observer Pub/Sub, Kafka topics, event-driven …

• Service Communication: Sync vs Async

  … messaging and events A service publishes a message to a broker (Kafka, RabbitMQ, SQS) and moves on. Interested …

• Message Queues & RabbitMQ

  … reply Apache Kafka Distributed append-only log Event streaming, high throughput, replay (see the Kafka lessons) AWS SQS …

• Hexagonal Architecture (Ports & Adapters)

  … controller] CLI[CLI command] Test[🧪 Test] Consumer[Kafka consumer] end subgraph Core["⬡ Application core"] IP{{"Driving port …

• KISS: Keep It Simple, Stupid

  … MS2[Auth service] & MS3[Profile service] MS1 -- K[(Kafka)] -- MS2 MS3 -- R[(Redis)] end subgraph Simple["✅ 3 users …

• Stacks & Queues

  … queue"] Q -- B["📨 Message brokers<br/ RabbitMQ, SQS, Kafka"] Q -- R["🚦 Rate limiting & buffering"] Q -- BFS["🌊 Breadth-first …

• Deployments, ReplicaSets & Rollouts

  … APIs, web frontends Interchangeable pods, rolling updates StatefulSet Databases, Kafka, ZooKeeper, Elasticsearch Stable names ( db-0 , db-1 …

• Behavioral Patterns I: Observer, Strategy, Command, State

  … RxJS, Redux store.subscribe , React state → re-render, Kafka and message queues at a system level. ⚠️ Always unsubscribe …

• CQRS & Event Sourcing

  … fraud detection] Tools: EventStoreDB, Axon, Marten (Postgres), or Kafka as the event log. CQRS + event sourcing together They …

• Choosing an Architecture

  … Hexagonal, Stripe behind an ACL"] b1((core)) -- b2[Stripe adapter] end end Mono -- events via outbox K[(Kafka …