3 posts tagged with "Concurrency"

Production patterns for building fast, concurrent AI agents in Rust.

When scraping websites or testing APIs from multiple IPs, you need a proxy that can rotate source addresses automatically. This article explores how to build a production-ready IP rotation proxy using Cloudflare's Pingora framework, achieving lock-free rotation with atomic operations.

Full implementation: github.com/porameht/pingora-forward-proxy

In ML inference servers, choosing the right concurrency pattern can make the difference between 200 RPS and 20,000 RPS. This article analyzes why Arc<RwLock<Option<T>>> is often the optimal choice for shared model state.