High-Concurrency Architecture: C10M & Scaling in Go — Executive Summary

Answer-first: Surviving C10M scale with ten million concurrent sockets and sub-10ms tail latencies requires re-engineering infrastructure across four foundational layers: kernel-bypass I/O via Linux io_uring and eBPF, zero-allocation Go netpoller pipelines using sync.Pool, asynchronous event streaming with Debezium transactional outbox, and tiered caching with singleflight deduplication to shield underlying databases from connection exhaustion. Prerequisite: Advanced knowledge of distributed systems design, Linux kernel networking primitives, Go runtime scheduling internals, database transaction isolation levels, and microservices architecture patterns is recommended for this masterclass series. ...

Chapter 1: How Systems Handle C10M — Linux epoll, io_uring & Go Netpoller

Answer-first: Building a C10M-capable Golang backend requires bypassing OS kernel bottlenecks through three core architectural shifts: replacing standard network syscalls with io_uring and eBPF/XDP, utilizing Go netpoller with fixed worker pools to eliminate unbounded goroutine scheduling overhead, and pre-allocating zero-allocation memory slabs via sync.Pool to keep garbage collection stop-the-world pauses strictly below three hundred microseconds. Prerequisite: Advanced understanding of Linux system calls, network socket lifecycles, operating system memory management, and Go concurrency primitives (goroutines, channels, and runtime netpoller) is required. ...

Flash Sale Architecture: Rate Limiting & Redis

Flash Sale Architecture: Rate Limiting & Redis Answer-first: High-concurrency flash sale systems absorb millions of synchronized user requests using a 5-Tier Traffic Shedding Architecture: Cloudflare CDN edge static asset caching, Envoy API Gateway atomic Token Bucket rate limiting, Redis Cluster Lua inventory reservations with hotkey slot splitting, partitioned Kafka queue buffering, and asynchronous Go worker pools executing batch upserts into TiDB/MySQL. [!NOTE] On sourcing: This article describes flash-sale architecture patterns for C10M-scale events; it is not a disclosure of Shopee’s internal systems, and the figures here are engineering targets rather than published Shopee metrics. Shopee has not publicly documented its flash-sale internals in detail. What is public is its database platform choice — Shopee’s adoption of TiDB is documented in PingCAP’s case studies (How Shopee Chose the Right Database, Shopping on Shopee, the TiDB Way). Treat everything else as a reference pattern to validate against your own workload. ...