Search

Lessons (15)

• Batch vs Stream and Data Modeling

  Choose when work runs and shape data for correctness first, then deliberately denormalize proven read bottlenecks. ![Batch runs …

• Kafka Producers

  … Without it, a retried batch could land after a later batch. Producing from Node.js (KafkaJS) js import …

• Big Data: ETL, Warehouses and Streaming

  Build reliable analytical pipelines with batch/stream processing, lake and warehouse layers, and explicit freshness contracts. ![Analytics pipeline …

• Design a Logging and Monitoring Platform

  … agents batch into an ingestion layer, durable streams feed hot search, metrics and cold archival](/img/system-design …

• N+1 Queries, Loading & Pagination

  … N child lookups becomes a single join or batched child query; cursors avoid deep offsets](/img/database/n …

• Deployments, ReplicaSets & Rollouts

  … migrations, batch processing Retries until it succeeds CronJob Scheduled jobs: nightly reports, cleanups Creates Jobs on a cron …

• Consumers & Consumer Groups

  … finish the current batch, commit, leave the group Key takeaways - A consumer group shares a topic's partitions …

• Debug Latency Like an Investigator

  … GC, pool wait, retries, slow subset. Every morning Batch reports, backup, cache expiry, scheduled work. Restart helps briefly …

• Service Communication: Sync vs Async

  … users/2" U1 O1 -- "… ×50" U1 end subgraph Batched["✅ Batched or replicated"] O2[Orders page] -- "GET /users?ids …

• How Browsers Render a Page

  … Use defer or async . - Changing geometry triggers expensive layout; transform and opacity are cheap. - Batch DOM reads and …

• What Is Apache Kafka?

  … to network without being copied through the application. - Batching and compression: many records are sent and stored together …

• REST vs GraphQL vs gRPC

  … Fix it with DataLoader , which batches those 50 calls into one WHERE author id IN (...) . GraphQL challenges: HTTP …

• Kafka vs RabbitMQ & the Kafka Ecosystem

  … features Priorities, TTL, delays, per-message ack/nack Batches, offsets, compaction Multiple independent readers One queue per reader …

• Serverless Architecture

  … so long jobs need Step Functions, containers or batching Cold starts 100 ms to several seconds, depending on …

• Caching & Redis

  … later, in batches .- D2[(DB)] end The hardest part: invalidation 📘 "There are only two hard things in computer …