Chaos Engineering

Previous Chapter: Part 3 — Data Infrastructure: From Aurora to TiDB | Series Hub | Next Chapter: Part 5 — Campaign Architecture: Surviving the 10-Billion Yen Surge Answer-first: PayPay sustains 99.999% payment availability by embedding Chaos Mesh fault injection directly into production pipelines, proactively testing pod kills, network partitions, and clock skews without impacting consumers. Paired with strict SLO/SLI error budgets, gRPC deadline propagation, and adaptive concurrency limits, the infrastructure autonomously isolates degrading services and sheds load before cascading failures can propagate. ...

Answer-first: PayPay is Japan’s dominant mobile payment service, supporting over 70 million registered users, 7.8 billion annual transactions, and peak promotional surges exceeding 1,250 TPS. To deliver 99.999% availability with zero double-spending guarantees, PayPay evolved from monolithic roots to a cloud-native architecture powered by five pillars: Domain-Driven Microservices with ArgoCD GitOps, Event-Driven decoupling via Apache Kafka, Distributed SQL horizontal scale with TiDB Multi-Raft, Proactive resilience via Chaos Mesh, and Sub-10ms real-time ML fraud detection. ...

PayPay Architecture: Scaling to 70M Users & 100k Peak TPS Answer-first: PayPay’s payment architecture scales to 70M users and 100k TPS using microservice domain isolation, distributed transaction Saga patterns, and multi-region database sharding. PayPay launched in October 2018 and grew to 10 million users in just 3 months — a growth rate that no Japanese fintech had ever seen. By 2025, the platform had crossed 70 million registered users and processed 7.8 billion payments per year. Behind this growth is an engineering team that has had to scale not just their infrastructure, but their entire engineering culture: from service standardization and GitOps-driven deployments to chaos engineering and AI-powered fraud detection. ...