Search

Lessons (19)

• Topics, Partitions & Offsets

  … orders (3 partitions)"] P0["Partition 0 → Broker 1"] P1["Partition 1 → Broker 2"] P2["Partition 2 → Broker 3 …

• Replication, Partitioning & Sharding

  Scale reads with replicas, split data safely with partitions and shards, and plan for consistency, hot keys and …

• Consumers & Consumer Groups

  How consumers read in parallel with consumer groups, how partitions are assigned and rebalanced, how offsets are committed …

• Capacity, Availability, Latency and CAP

  … load, response time, uptime and partition-time policy. Start with numbers Estimate peak RPS, bytes per request, read …

• What Is Apache Kafka?

  … async ({ partition, message }) = { const order = JSON.parse(message.value.toString()); console.log( partition ${partition} offset ${message.offset}: , order …

• Brokers, Replication & Durability

  … In Kafka, every partition has one leader replica and several follower replicas on different brokers. ![Each partition has …

• Kafka Producers

  … batching, compression, partitioning, the acks setting that trades speed for safety, retries, and the idempotent producer. The big …

• Design a Logging and Monitoring Platform

  … bounded hot window and archive older data cheaply. Partition by tenant/time, enforce quotas and sample high-cardinality …

• Big Data: ETL, Warehouses and Streaming

  … img/system-design-l6/big-data.svg) MapReduce partitions large batch work into map, shuffle and reduce stages …

• Delivery Guarantees: At-Most, At-Least & Exactly Once

  … toLedgerEntry(message.value) }] }); await tx.sendOffsets({ consumerGroupId: "ledger-writer", topics: [{ topic, partitions: [{ partition, offset: (BigInt(message.offset) + 1n …

• Time, Consistency and Distributed Transactions

  … Network partitions can create split brain: two owners act at once. For exclusive work, use a lease plus …

• SQL Interview Query Drills

  … For an average per class, use a correlated subquery or partitioned window function. Q26: Third-highest distinct salary …

• Kafka vs RabbitMQ & the Kafka Ecosystem

  … topic + partition by key Ordering Per queue (with one consumer) Per partition Throughput High (tens of thousands of …

• SQL vs NoSQL Databases

  … keep answering, even with possibly stale data (social feeds). mermaid flowchart TD P["🔌 Network partition happens"] -- C["Choose …

• Sorting Algorithms

  … pick a pivot, partition 🎓 Analogy: A teacher says "everyone shorter than Sam, stand left; taller, stand right." Then …

• What Is Software Architecture?

  … flexible fields - Horizontal write scaling needs work later (partitioning / Citus) Alternatives considered - MongoDB: flexible schema, but weaker multi …

• Event-Driven Architecture

  … store processed event IDs Ordering Partition by entity key (Kafka); include versions/timestamps Lost events when saving + publishing …

• Scaling, Load Balancing & Rate Limiting

  … After a user updates their profile, read their profile from the primary ("read your own writes"). Sharding (partitioning …

• Dynamic Programming

  … sum dp[row][col] Intervals Burst balloons, palindrome partitioning dp[left][right] Bonus: house robber Rob houses in …