Search

Lessons (19)

• Batch vs Stream and Data Modeling

  … streaming handles events continuously while data modeling controls read and write cost](/img/system-design-l6/batch-stream …

• Big Data: ETL, Warehouses and Streaming

  Build reliable analytical pipelines with batch/stream processing, lake and warehouse layers, and explicit freshness contracts. ![Analytics pipeline …

• Premiere-Night Video Streaming

  … Put copies close to viewers before the doors open. ![Premiere streaming splits control-plane APIs from a CDN …

• Kafka vs RabbitMQ & the Kafka Ecosystem

  … processing inside your app A Java library for stateful stream processing : filtering, mapping, joining streams, windowed aggregations, with …

• REST vs GraphQL vs gRPC

  … GetOrder (GetOrderRequest) returns (Order); rpc StreamOrderUpdates (GetOrderRequest) returns (stream OrderStatus); // server streaming } message GetOrderRequest { string order id = 1 …

• Design a Ride-Sharing Service

  … availability, and treat location as a fast-changing stream. ![Ride-sharing: a geo index finds candidates, an atomic …

• Design a Logging and Monitoring Platform

  … agents batch into an ingestion layer, durable streams feed hot search, metrics and cold archival](/img/system-design …

• Real-Time, Pub/Sub, Webhooks and CDC

  … an event stream can feed pub-sub consumers, webhook delivery, server-sent updates and database change capture](/img …

• Next.js Rendering: CSR, SSR, SSG, ISR & Server Components

  … refresh after a CMS edit or mutation import { revalidatePath } from "next/cache"; revalidatePath("/products"); Streaming with Suspense Don …

• Heaps & Priority Queues

  … Top K ⭐ "Find the k largest numbers in a stream of a million numbers." Sorting is O(n …

• What Is Apache Kafka?

  … key, value, timestamp, headers One newspaper story Topic A named stream of related events, e.g. orders A …

• Design a Social Media Feed

  … Keep likes/comments as separate scalable counters or event streams. It is acceptable for a new post to …

• Delivery Guarantees: At-Most, At-Least & Exactly Once

  … Transactions (atomic read-process-write) A stream processor reads from topic A, transforms the record, and writes to …

• Message Queues & RabbitMQ

  … pub-sub Serverless, no ops Redis Streams / BullMQ In-memory streams Lightweight background jobs in Node.js NATS …

• Caching & Redis

  … Stable "popular items" FIFO The oldest item Simple streams TTL Expired items Time-sensitive data In Redis: maxmemory …

• Topics, Partitions & Offsets

  … partitions.svg) Topics A topic is a named stream of related events: orders , payments , page-views , user-signups …

• Serverless Architecture

  … λ nightlyReport"] DB["🗄️ DB change<br/ (DynamoDB stream)"] -- F5["λ updateSearchIndex"] ts // AWS Lambda handler: create an …

• Data in Microservices: Sagas & the Outbox Pattern

  … Debezium read the database's transaction log and stream outbox rows to Kafka, with no polling needed. The …

• Behavioral Patterns II: Chain, Template, Iterator, Mediator, Memento, Visitor

  … arrays, Map , Set , for await (const chunk of stream) , paginated API helpers. --- 4. Mediator ✈️ Analogy: Planes don't …