Incident simulation for AI customer service

Your AI service isn't likely to go down. It is more likely to go wrong.

And when it does, the damage doesn't stay where it started. It travels past the AI, onto the few people who take over, and out to the customers left on hold.

One provider hiccup, four hops to a customer nobody answered.

A modelled example: Halden Grocery's phone line, with 2 people behind the AI
Normal day Halden's AI phone line finishes 7 in 10 calls alone, hands 3 in 10 to Service desk · 2 people, keeping up
Minute 0 · failure starts AI model provider replies slow from 0.8s to 6.2s Halden's AI phone line
First sign Halden's AI phone line now hands 7 in 10 calls instead of 3 Service desk · 2 people
Minute 27 Service desk · 2 people get 21 calls an hour, can clear 12, put the rest on hold Shopper · 20 min on hold
Minute 48 Shopper hangs up, one of 7 calls unanswered by minute 48

Every service in that chain was technically up. That is the kind of failure a basic uptime check isn't built to see.

The gap

The time between the break of service and your first customer complaint.

In a typical AI degradation of service, the first signals are the effects: a backed up queue, a ticket spike someone happened to notice, a customer complaint. By then, the fix is being improvised. A team that has rehearsed it recognizes the pattern in seconds.

Illustrative example

0

infrastructure alerts in 48 minutes, in this example. Every service was up, responding, and returning success the entire time.

api-gateway · 200 OK · p95 212ms
voice-ai-service · process up
status page · All Systems Operational
7

calls unanswered after 48 minutes, in this example. The AI passed 17 of the 24 calls to 2 people who can clear about 12 an hour.

calls the AI finishes alone 70% → 30%
answer quality 0.91 → 0.44
callers on hold 1 → 7
01020 30405060 min 4 min in · A rehearsed team recognises it, pulls the fallback 18 min in · Queue alarm wait time already breached 26 min in · Ticket spike noticed someone eyeballs a chart 41 min in · A customer complains Infrastructure monitoring may never alert · everything is up

Illustrative timings from a modelled voice-channel degradation.

Inside the app

What happens when your AI service fails, and how you can fix it.

Pick a service and a failure, then watch it travel through your systems, onto the people who catch what the AI drops, and out to the customer. Every run ends with the fallback that saves it and the control still missing.

COMMARKAI · Incident SimulatorFictional example · illustrative timings

AI voice support

Assumed peak: 80 calls a minute · example topology

Start

Checkpoint · who needs to know

Named roles and timing are in the app.

Each run follows the failure one step at a time.

Ready

Press "Run failure" to begin

Who needs to know now

What the customer sees

People absorbing it

These panels fill in inside the app.

Where this run ended

Where it landed on the fallback ladder

The finding, the missing controls and where it lands on the fallback ladder are in the app.

See plans

How it works

Four steps, and none of them need access to your systems.

Map it

Start from one of our service types, or model your own: the channel your customers use, the AI behind it, the data it reads, the systems it touches, and the people who catch whatever it drops. You describe it. We never plug into it.

→No installation, no credentials, no data leaving your walls
→Every assumption is marked, so a guess is never mistaken for a fact Coming soon
→Owners and capacity recorded for every part of the map
Customer channelvoice, chat, booking, forms
AI servicemodel, provider, backup
Knowledge & datawhat it reads, who owns it
Tools & actionswhat it's allowed to do
Peoplecapacity, shifts, authority

Run a failure

Choose a failure (a slow provider, a leaked source, an unauthorized action, an overwhelmed team) and watch where it goes. Most of these do not take the service down. They make it quietly wrong, unsafe or expensive while it keeps answering.

→Four failure types to start, with more on the way
→Step-by-step, so you see the order things go wrong in
→Run it again with different numbers and compare Coming soon
Provider slowdownavailability
Prompt injectionsecurity
Restricted data exposedprivacy
Unauthorized actionagency
Human queue overloadpeople

Trace it to people

Most tools stop at the system. This one follows the failure to two groups: the customer who feels it, and the staff who absorb it. When the AI hands work back, it lands on a queue, and the people on that queue get tired. Nobody budgets for that. We show it.

→What the customer sees, at every step
→Queue load, shift length and time until the backlog can't recover
→The point where your fallback starts running on exhausted people
Handed to staff72% of requests
Queue18 min wait
Same team on queue3h 10m no relief
Fallback holds for~90 min then fatigue

Plan the response

Every run ends with a plan, not just a red box: which fallback holds, who has the authority to pull it, who needs to know at each point, and how to tell customers in a way that keeps the focus on getting it fixed fast.

→Fallback ladder, from restricted AI down to safe shutdown
→Who-needs-to-know checkpoints, in order
→Take the plan into Slack, Asana or your own dashboard
Channel ownerminute 0 · decide the bypass
Queue leadminute 1 · staff up
Comms leadminute 2 · first customer note
Leadershipif data is exposed · now

Pricing

Model it. Customize it. Rehearse it.

You pay for how closely the model matches your service, and how much of the rehearsal we run with you.

Simulator $75 /mo

See what happens when a standard AI service fails. Our service types, four failure types today, nothing to connect.

  • →Six ready-made service maps
  • →Four failure types, with six more coming
  • →Customer impact and human load traced
  • →Fallback ladder for every scenario
  • →One seat
Subscribe
Studio · model your own service $250 /mo

Model your own service instead of ours: your parts, your people, your numbers.

  • →Everything in Simulator
  • →Your own components, owners and capacity Coming soon
  • →Who-needs-to-know checkpoints Coming soon
  • →Human capacity and fatigue modelling Coming soon
  • →Export plans to Slack, Asana or your dashboard Coming soon
  • →Five seats
Subscribe
Enterprise $750 /mo

Your scenarios built for you, and your team taken through them live.

  • →Everything in Studio
  • →Unlimited self-serve customization Coming soon
  • →A custom scenario pack built for you each quarter
  • →A facilitated tabletop exercise each quarter
  • →Notification map and communication strategy
  • →Written after-action report
  • →Up to 12 seats, plus unlimited observer seats
  • →Custom incident operations builds available.
Subscribe

Prices in USD, plus applicable taxes. Your first subscription comes with a 30-day money-back guarantee; see the refund policy. Plans renew automatically until you cancel.

The taxonomy

How AI services fail, often while they're still "up."

A slowdown is the failure everyone expects. The others can happen while the service keeps responding, which is why uptime monitoring may not catch them. Here are four to start.

01

Provider slowdown or outage

The model provider slows past your time budget or fails outright. Voice agents talk over callers; checkouts stall mid-payment.

Tell: response time over budget

02

Excessive agency

The AI takes actions beyond its authority (refunds, emails, cancellations, access changes) because it had the permission and nothing stopped it.

Tell: actions with no approval trail

03

Sensitive data in answers

Private or internal information shows up in a response or a log. Once it's on someone's screen it cannot be taken back.

Tell: restricted content leaving its channel

04

Human overload and fatigue

Everything the AI can't finish lands on a person. The queue grows, the same people stay on it for hours, and mistakes follow. When people talk about "AI fatigue" they usually mean being worn out by new tools. This is the other kind: the people inside the automation, absorbing its failures, and no dashboard counts what that costs.

Tell: backlog and hours-on-queue rising together

More are coming to the app, including prompt injection, quality drift and biased outcomes. Join the list to get each one explained as it lands.

Stay in the loop

What's breaking in AI customer service.

Real AI failures, what they cost, and how a team could have caught them sooner. Plus early access when new features ship.

  1. 01A real failure, taken apart. Where it started, where it travelled, and who ended up absorbing it.
  2. 02The control that was missing. One thing you can check on your own service this week.
  3. 03First look at what's new. Hear about new scenarios and features before anyone else.

Join the list

Tell us about your company, so what we send fits your needs.