High Concurrency

← Series hub | Next Chapter: Part 2 — Golang vs. PHP/Laravel → Answer-first: For internal East-West microservices operating at scale, gRPC over HTTP/2 with Protobuf is non-negotiable, delivering 31x faster serialization, 68.8% lower egress bandwidth, and zero-allocation memory pooling. For external North-South traffic, deploy Go Kratos v2.9.1 dual-protocol servers to expose REST/JSON to web browsers while preserving high-throughput gRPC internally without intermediate proxy network hops. For a foundational breakdown of production Go microservices and Kubernetes cluster architecture, refer to our comprehensive Go Microservices Architecture Guide. ...

← Previous Chapter: Part 1 — HTTP/REST vs. gRPC | Series hub | Next Chapter: Part 3 — Primary Key Showdown: UUIDv7 vs. Snowflake vs. BIGINT → Answer-first: For transactional hotspots (>=5,000 RPS flash-sale checkout, inventory locks), Golang is mandatory, delivering 86.3% lower AWS compute costs ($189,411.48/yr savings at 50,000 RPS) with sub-5ms P99 latency. For backoffice CRM, catalog, and ERP workflows, Laravel 11 with Filament remains vastly superior, making the Strangler-Fig Hybrid Architecture the optimal enterprise design. ...

Prerequisite: Familiarity with the concepts introduced in Executive Summary. Review it first if the terminology in this part is unfamiliar. Answer-first: Handling millions of requests per second (the C10M problem) requires eliminating kernel-space context switching overhead through asynchronous event loops (epoll/kqueue) or kernel-bypass networking (DPDK, io_uring), paired with zero-copy I/O memory buffers, L4 DSR (Direct Server Return) load balancing, and lock-free concurrency structures in Go. Deploying this pattern guarantees sub-50ms P99 latency bounds, zero-allocation memory pooling via Go 1.24 string interning,. ...

← Series hub ← Prev • Next → Answer-first: Alipay’s Double 11 engineering journey evolved over a decade from a centralized monolithic database (2009) to a planet-scale multi-active cloud-native architecture capable of processing over 544,000 TPS at peak. Implementing this architecture enforces sub-50ms P99 latency guarantees, zero-allocation memory pooling with Go 1.24 unique.Handle, and fault-tolerant Dapr 1.15 component orchestration for resilient production scaling. Prerequisite: Executive Summary Overview Answer-first: The Double 11 evolution tracks Alipay journey from monolithic database crashes in 2009 to multi-region active-active unitized architectures. ...

← Previous Chapter: Part 2 — Golang vs. PHP/Laravel | Series hub | Next Chapter: Part 4 — MariaDB vs. MySQL → Answer-first: For distributed write-heavy architectures (≥10,000 writes/s) on MySQL/InnoDB, Snowflake ID (64-bit) is optimal, eliminating the 50% secondary index multiplier tax while preserving B-tree locality. For PostgreSQL, client-generated keys, or coordinate-free distributed topologies, UUIDv7 (RFC 9562) delivers 98% sequential page packing without dedicated coordinator nodes, overcoming random UUIDv4 page thrashing and IOPS cliff failures. ...

Flash Sale Architecture: Rate Limiting & Redis Answer-first: Shopee flash sale architecture handles millions of concurrent requests using Redis Lua token buckets, local memory caches, queue-based order throttling, and optimistic DB updates. Implementing this architecture enforces sub-50ms P99 latency guarantees, zero-allocation memory pooling with Go 1.24 unique.Handle, and fault-tolerant Dapr 1.15 component orchestration for resilient production scaling. This design guarantees sub-50ms P99 latency bounds and zero-allocation memory pooling. [!NOTE] On sourcing: This article describes flash-sale architecture patterns for C10M-scale events; it is not a disclosure of Shopee’s internal systems, and the figures here are engineering targets rather than published Shopee metrics. Shopee has not publicly documented its flash-sale internals in detail. What is public is its database platform choice — Shopee’s adoption of TiDB is documented in PingCAP’s case studies (How Shopee Chose the Right Database, Shopping on Shopee, the TiDB Way). Treat everything else as a reference pattern to validate against your own workload. ...