Search

Lessons (21)

• Replication, Partitioning & Sharding

  Scale reads with replicas, split data safely with partitions and shards, and plan for consistency, hot keys and …

• Database Internals, Replication and Scaling

  Connect storage-engine choices, durability, replicas, query plans, pooling and data layout to real production behaviour. ![Database path …

• Brokers, Replication & Durability

  … Brokers, leaders and followers, in-sync replicas, min.insync.replicas, leader election and KRaft, drawn step by step …

• Deployments, ReplicaSets & Rollouts

  … A Deployment is that shift manager for your pods.  Deployment → ReplicaSet …

• Kafka Producers

  … fetch + replicate F2- L: fetch + replicate L-- P: ✅ ack (in-sync replicas have it) acks Producer waits for …

• Scaling, Load Balancing & Rate Limiting

  … Copy the data to replicas and send reads there. mermaid flowchart LR App -- writes P[(Primary)] P -- replication …

• Storage Engines & Database Operations

  … a bounded pool protects the primary while WAL, backups and replicas provide recoverability](/img/database/storage-operations.svg …

• Helm, kubectl Cheat Sheet & Best Practices

  … replicas: {{ .Values.replicaCount }} template: spec: containers: - name: api image: "{{ .Values.image.repository }}:{{ .Values.image.tag }}" resources: {{- toYaml .Values …

• Kubernetes Cluster Architecture

  … apply Deployment (replicas: 3) A- E: store desired state C- A: watch: new Deployment → create ReplicaSet → create 3 …

• ACID, Transactions & Locks

  … is recovered from WAL/replication. Consistency is not a promise that every replica is instantly current; it means …

• Scaling & Health Probes

  … shop-api } Spread replicas across nodes and zones, so losing one node or zone doesn't take out …

• Why Kubernetes?

  … 3" Act["start 1 more pod"] Act -- Loop yaml "I want 3 replicas of my API, version 1 …

• Distributed Coordination: Consensus, Heartbeats and Gossip

  … and commits a log entry after a majority replicates it. Use it for a small control plane, not …

• Data Structures for Scale

  … are two sets? Approximate similarity Merkle tree Which replicated blocks differ? Tree maintenance Use an approximation only where …

• Transactions, Indexes & Concurrency

  … deletion and corruption replicate too. Restore-tested independent backups remain necessary.

• Caching & Redis

  … You can use both. - Replication + Sentinel: automatic failover to a replica. - Redis Cluster: shards data across nodes using …

• SQL vs NoSQL Databases

  … SQL databases can scale out too (read replicas, Citus, Vitess, CockroachDB), but it's more work. ACID vs …

• ConfigMaps, Secrets & Storage

  … workloads StatefulSets and storage A StatefulSet gives each replica its own PVC that follows it across restarts and …

• Data in Microservices: Sagas & the Outbox Pattern

  … API composition, replicated data, or CQRS read models.

• Service Communication: Sync vs Async

  … O1 -- "… ×50" U1 end subgraph Batched["✅ Batched or replicated"] O2[Orders page] -- "GET /users?ids=1,2,…,50 …

• Topics, Partitions & Offsets

  … kafka-topics.sh --create --topic orders --partitions 6 --replication-factor 3 --bootstrap-server localhost:9092 Naming tips: use …