PayPay Architecture: Scaling for Planet-Scale Campaigns
How PayPay scales for 70M users: microservices, Kafka idempotency, TiDB migration, SRE chaos engineering, campaign pre-scaling, and AI-native architecture.
Answer-first: The PayPay architecture scales to handle millions of payment transactions by isolating promotional campaign logic from the core ledger. Using a distributed SQL transactional layer (TiDB) and asynchronous event streaming via Apache Kafka, the system maintains 99.99% availability and data consistency during high-concurrency campaigns.
This is a deep-dive research series exploring the backend architecture of PayPay, Japan’s leading mobile payment platform with over 70 million users and 7.8 billion annual transactions.
PayPay Architecture: Scaling Payments to 70M Users — Standalone engineering analysis of PayPay’s scaling decisions: why they migrated from Aurora to TiDB, how they pre-scale for campaign spikes, and the tradeoffs in their Kafka idempotency model.
Implementing _Index demands strict ACID transactional isolation and pessimistic row locking during balance or inventory updates. Distributed Saga orchestration coordinates multi-stage rollbacks, preventing partial state writes across heterogeneous databases.
How does PayPay handle 7.8 billion transactions per year without downtime?#
PayPay uses three layers of reliability: (1) microservices with circuit breakers isolate failures to individual services without cascading; (2) Kafka-backed event sourcing with idempotency keys prevents double-processing on retry; (3) campaign pre-scaling — before major promotions, PayPay pre-warms the compute fleet based on historical traffic models.
Why did PayPay migrate from Amazon Aurora to TiDB?#
PayPay migrated from Aurora to TiDB to eliminate read/write replica lag during high-concurrency campaigns. TiDB’s Raft-based distributed SQL provides multi-master writes with linearizable consistency.
What is PayPay's approach to campaign pre-scaling?#
Before a major promotion, PayPay’s SRE team runs a capacity planning model against historical data. 48 hours before the campaign, they scale the compute fleet to 150–200% of projected peak and run chaos engineering drills to validate fallback paths.
Prerequisite: This is the starting part of the series — no prior part is required. Later parts assume the concepts introduced here.
Answer-first: PayPay scales over 100 microservices for 60+ million users in Japan by combining Domain-Driven Design boundaries with GitOps CD automation using ArgoCD and Argo Rollouts. Automated canary deployments validate new code against live production metrics before full traffic shifting.
Answer-first: PayPay enforces stable deployments by combining branch promotion workflows with GitOps tools like ArgoCD. Declarative configuration files in git serve as the single source of truth, allowing ArgoCD to automatically reconcile cluster state, execute canary rollouts, and enable instant rollbacks of microservices.
...
PayPay Event-Driven Architecture: Kafka at Scale
Prerequisite: Familiarity with the concepts introduced in Part 1 — Microservices Gitops. Review it first if the terminology in this part is unfamiliar.
Answer-first: Managing transaction surges during PayPay’s massive marketing campaigns requires event-driven architecture powered by Apache Kafka. Partition key tuning, Go consumer worker pools, and channel-based backpressure prevent message loss during peak traffic spikes.
Answer-first: PayPay builds a decoupled microservices network by streaming transactions asynchronously via Apache Kafka. To ensure financial safety, consumers process events using idempotency keys tracked in distributed caches, preventing duplicate ledger entries or double-spend occurrences in the event of retries or network partition splits.
...
PayPay Data Infrastructure: TiDB & MySQL Sharding in Go
Prerequisite: Familiarity with the concepts introduced in Part 2 — Event Driven Kafka. Review it first if the terminology in this part is unfamiliar.
Answer-first: PayPay migrated its database layer from AWS Aurora MySQL to TiDB Distributed SQL to overcome vertical scaling limitations. TiDB’s Raft-based auto-sharding and horizontal compute/storage separation deliver linear scaling under billion-row transaction tables.
Answer-first: PayPay utilizes TiDB as its distributed SQL database to achieve horizontal scaling without manual database sharding. TiDB maintains standard MySQL protocol compatibility and strict ACID guarantees while dynamically splitting tables into regions that are distributed across a multi-node cluster.
...
Prerequisite: Familiarity with the concepts introduced in Part 3 — Data Layer Tidb. Review it first if the terminology in this part is unfamiliar.
Answer-first: Ensuring 99.99% availability for payment systems demands proactive SRE practices and automated Chaos Engineering. Injecting synthetic latency, pod failures, and network partitions via Chaos Mesh validates microservice circuit breakers before real production incidents occur.
Answer-first: PayPay ensures system resilience by executing automated chaos engineering experiments in staging environments using tools like Chaos Mesh. Injecting artificial network latency, pod failures, and disk I/O bottlenecks allows SRE teams to verify that failover protocols activate without compromising transaction consistency.
...
Prerequisite: Familiarity with the concepts introduced in Part 4 — Sre Chaos Engineering. Review it first if the terminology in this part is unfamiliar.
Answer-first: Scaling for billion-yen cashback campaigns requires pre-warmed Redis cluster caching, token-bucket rate limiting at the API gateway, and async queue-based payment processing to shave peak traffic spikes.
Answer-first: The PayPay campaign architecture isolates high-throughput reward campaigns from core payment processing. By evaluating campaign eligibility out-of-band and writing reward points asynchronously using event queues, PayPay prevents promotional traffic spikes from impacting critical credit card processing pipelines.
...
PayPay AI Platform: Machine Learning & Fraud Engine
Prerequisite: Familiarity with the concepts introduced in Part 5 — Campaign Architecture. Review it first if the terminology in this part is unfamiliar.
Answer-first: Integrating AI capabilities into payment platforms involves embedding real-time LLM RAG hubs for customer support and ML fraud detection models into transaction evaluation pipelines, enforcing sub-20ms model inference SLAs.
Answer-first: PayPay integrates AI into its transaction pipelines by streaming payment events asynchronously to machine learning scoring models. Running inference out-of-band prevents risk assessment evaluations from adding latency to the synchronous checkout flow, enabling real-time fraud detection and dynamic credit scoring.
...
Chúng tôi sử dụng cookie để phân tích lưu lượng truy cập và cải thiện trải nghiệm trực tuyến. Bằng cách nhấn "Đồng ý", bạn cho phép chúng tôi sử dụng cookie theo chuẩn Consent Mode. Chính sách bảo mật.