Live demo
3 candidate models in. 1 out.
Three models, five hundred graded calibration items each, one quality bar of 0.8. The policy has to refuse the cheap model without being told to.
| Model | Cost / 1k | Quality floor | Clears bar | |
|---|---|---|---|---|
| haiku-class | $0.25 | 0.667 | no | |
| sonnet-class | $1.10 | 0.865 | yes | routed here |
| opus-class | $5.00 | 0.935 | yes |
Cost saved
78.0%
Bar hit rate
100.0%
Promised coverage
90.0%
Guarantee held
yes
The saving is unremarkable; every gateway can route to a cheaper model. The last two numbers are the product: a stated coverage promise, and the realised rate on traffic the policy never saw.