checkout-api is slow in eu-west.

Not acknowledged. Level 2 is paged in —.

Triggered
Acknowledged
Under the line
Resolved

Open for 07:36 4.1% of checkouts over 1 s

Instruments

Why it is slow, what it has cost, and where.

Suspected cause

Correlated

Deploy 4f2a91c reached eu-west at —, two minutes before p95 crossed. It doubled the queries per checkout; the orders-db pool went from 52% to 94%.

Error budget · checkout

30 days

Objective: p95 under 300 ms, 99.9%
Left this month: 11 min 40 s
Under 30%: Deploys frozen

checkout-api · every region

Live

People

Who holds the pager, and who is on this incident. Press a card to page them.

Rota board · Payments platform

12 h shifts

On this incident

Log

What has happened, newest first, and the rest of the checkout path.

Timeline

—

Service board · the checkout path

3 of 10 need attention

Choose a header to sort · readings every 2 s

History

Twelve weeks of incidents on this platform, by the hour they fired.

Incidents—

Out of hours—

Median to acknowledge4min 12s

Median to resolve41min