The deflection memo
What the head of support brings to the renewal
One page. The claimed number, the measured number, the tickets a week that went away, and what each of them cost.
billing queue, weeks 27 to 40: what the bot removed
The vendor dashboard reports 35.0% of billing conversations resolved by AI since launch in week 26. Measured against a control built from 4 untreated queues that tracked billing to within 1.6% for the 26 weeks before launch, the bot removed 17.4% of the tickets the queue would otherwise have received: 159 a week against an expected 915. A permutation test puts the chance of a gap this size arising by accident at 0.0020.
billing volume fell 25.0% after launch, which is the figure a before/after read would report. The control fell 9.2% over the same 14 weeks with no bot on it. That drop is the season, it hit every queue, and it is not the bot’s to claim.
The same method applied to account-access, which got no bot, finds 1.9%, inside the noise. Two queues, shipping and integrations, could not be given a control that tracked them and are not reported.
At $72,000 a year, each deflected ticket cost $9 on the measured number and would have cost $4 if the dashboard figure were right. Renew on $9 a ticket, or do not, but that is the number.