1582 articles
The disk dies at 2 AM. You have backups. But the restore takes 9 hours because nobody tested it, the database is 800GB, the download from S3 is throttled, and pg_restore runs single-threaded by default. You could have restored in 45 minutes with the right setup.
Your service is degraded, returning errors 30% of the time. Smart clients with retry logic start hammering it — 3 retries each means 3x the load on an already failing system. The retry storm amplifies the original failure until full collapse. Here''s how to retry safely.
The codebase is painful. The team wants to rewrite it. The CTO wants to maintain velocity. Both are right. The rewrite vs refactor decision is one of the highest-stakes calls in software — get it wrong and you lose two years of productivity or two more years of compounding debt.
Ownership model for JavaScript developers, Axum HTTP server, async/await with Tokio, error handling, sqlx type-safe SQL, when Rust beats Node.js, and calling Rust from Node.js.
Master choreography and orchestration sagas, compensation transactions, and failure handling for distributed transaction management without 2PC.