The autonomy policy
Which rung, since when, on what evidence
The document the sign-off points at. Not a feeling about a clean week: the bar, the count, the day, and the guarantee the decision carries.
refund-actions agent · Act with approval
Promoted to Act unsupervised on day 18: 16 errors in 1,472 actions (1.1%). Evidence that the rate is under 2.0% reached 3.00 against a bar of 3.00.
Demoted to Act with approval on day 70, 10 days after the deployment on day 60 reset the evidence: 30 errors in 853 actions since the deployment (3.5%). Evidence that the rate is over 2.0% reached 3.17 against a bar of 3.00.
Guarantee: each decision is a sequential test at alpha 0.05. Checked every day, a promotion of an agent whose true rate is at or over 2.0% happens with probability at most 5.0%, and a demotion of an agent whose true rate is at or under it happens with probability at most 5.0%, per deployment. Evidence restarts on every deployment; a deployment not wired into Ladder is not covered.