Search

Lessons (15)

• Big Data: ETL, Warehouses and Streaming

  … raw events land durably, ETL/stream processing creates curated lake and warehouse datasets](/img/system-design-l6/big …

• Batch vs Stream and Data Modeling

  … streaming handles events continuously while data modeling controls read and write cost](/img/system-design-l6/batch-stream …

• Kafka vs RabbitMQ & the Kafka Ecosystem

  … Kafka Streams / Flink process streams in real time; Schema Registry keeps event contracts safe. - An event backbone lets …

• Real-Time, Pub/Sub, Webhooks and CDC

  … an event stream can feed pub-sub consumers, webhook delivery, server-sent updates and database change capture](/img …

• Design a Ride-Sharing Service

  … Locations are eventually consistent; ride assignment needs stronger ownership. Watch stale-location age, match latency, conflicts and regional …

• What Is Apache Kafka?

  … key, value, timestamp, headers One newspaper story Topic A named stream of related events, e.g. orders A …

• Next.js Rendering: CSR, SSR, SSG, ISR & Server Components

  … Then JavaScript hydrates it (attaches event handlers) to make it interactive. mermaid sequenceDiagram participant B as Browser participant …

• Design a Social Media Feed

  … Keep likes/comments as separate scalable counters or event streams. It is acceptable for a new post to …

• Delivery Guarantees: At-Most, At-Least & Exactly Once

  … Most business events ✅ Exactly-once (in Kafka) Transactions read committed , sendOffsets in the transaction Stream processing, financial pipelines …

• Message Queues & RabbitMQ

  … request/reply Apache Kafka Distributed append-only log Event streaming, high throughput, replay (see the Kafka lessons) AWS …

• Caching & Redis

  … ZRANGE , ZREVRANK Leaderboards , priority queues, time windows Stream XADD , XREADGROUP Event log with consumer groups Pub/Sub PUBLISH …

• Serverless Architecture

  … create a thumbnail export const handler = async (event: S3Event) = { for (const record of event.Records) { const image = await …

• Topics, Partitions & Offsets

  … svg) Topics A topic is a named stream of related events: orders , payments , page-views , user-signups . bash …

• Data in Microservices: Sagas & the Outbox Pattern

  … Design compensations as business actions . Choreography saga (events) Each service listens for events and reacts. No central coordinator …

• Behavioral Patterns II: Chain, Template, Iterator, Mediator, Memento, Visitor

  … arrays, Map , Set , for await (const chunk of stream) , paginated API helpers. --- 4. Mediator ✈️ Analogy: Planes don't …