PayPay SRE Practices: Chaos Engineering & Resilience

Prerequisite: Familiarity with the concepts introduced in Part 3 — Data Layer Tidb. Review it first if the terminology in this part is unfamiliar. Answer-first: Ensuring 99.99% availability for payment systems demands proactive SRE practices and automated Chaos Engineering. Injecting synthetic latency, pod failures, and network partitions via Chaos Mesh validates microservice circuit breakers before real production incidents occur. Answer-first: PayPay ensures system resilience by executing automated chaos engineering experiments in staging environments using tools like Chaos Mesh. Injecting artificial network latency, pod failures, and disk I/O bottlenecks allows SRE teams to verify that failover protocols activate without compromising transaction consistency. ...

May 5, 2026 · 10 min · Lê Tuấn Anh

MCP Observability & Tracing: Auditing Control Planes

Prerequisite: Familiarity with the concepts introduced in Part 5 — Security. Review it first if the terminology in this part is unfamiliar. Part 6 — MCP Observability & Tracing: Auditing the Control Plane Answer-first: Operating Model Context Protocol (MCP) servers without telemetry logging creates compliance vulnerabilities (violating OWASP MCP08: Lack of Audit & Telemetry). Instrumenting MCP servers with vendor-agnostic OpenTelemetry (OTel) tracing captures JSON-RPC 2.0 tool execution durations, argument metadata, and error rates in real-time Prometheus dashboards. ...

June 8, 2026 · 5 min · Lê Tuấn Anh