12 articles
Build event-driven systems with Apache Kafka and TypeScript. Covers producers, consumers, consumer groups, error handling, schema registry, and production deployment patterns.
Change Data Capture with Debezium reads PostgreSQL WAL logs and MySQL binlogs to stream every insert, update, and delete to Kafka in real time. This guide covers connector configuration, schema evolution, exactly-once delivery, and production operational patterns.
At-least-once delivery is a guarantee, not a bug. Kafka, SQS, and RabbitMQ will deliver the same message more than once under failure conditions. Build idempotent consumers using Redis SET NX, database unique constraints, and Kafka transactional producers to handle duplicates safely.
Decouple services and handle long-running operations with event-driven architecture, using CloudEvents and Kafka for reliable, observable event flows.
Order created at 10:00. Order cancelled at 10:01. Your consumer processes them in reverse — cancellation arrives first, then creation "succeeds." The order is now in an invalid state. Event ordering bugs are subtle, expensive, and entirely avoidable.
Build real-time AI systems with Kafka as your event backbone. Ingest features, trigger training, distribute model outputs, and sync data to vector DBs at scale.
Master consumer groups, offset management, exactly-once semantics, dead-letter queues, and consumer lag monitoring for production Kafka.
Master Kafka partition keys, FIFO queues, sequence numbers, global vs per-entity ordering, and when ordering isn''t worth the cost.
Your queue has 50 million unprocessed messages. Consumers are processing 1,000/second. New messages arrive at 5,000/second. The backlog will never drain. Here''s how queue backlogs form, why they''re dangerous, and the patterns to prevent and recover from them.
Master message queue patterns: SQS FIFO for ordered processing, DLQ setup, Kafka for event streaming with consumer groups, BullMQ for in-process jobs, visibility timeout, deduplication, and backpressure.
Eliminate dual-write problems with the outbox pattern. Learn polling publishers, CDC with Debezium, and building reliable event-driven systems.
Upstash brings Redis, Kafka, and QStash to serverless. Per-request pricing, no idle cost, perfect for Vercel, Netlify, and event-driven apps at scale.