The segment review
Two segments, with the arithmetic shown
What the customer success lead receives instead of a sorted table: the segments that are genuinely worse, how far above the population they sit once their sample size is accounted for, and how many dashboard rows were noise.
Segment review
support-answer · 7 days
Population rate
4.5%
Segments
24
Dashboard flags
5
Real
2
real
Japanese lang:ja
44 errors in 400 requests. Raw 11.0%, shrunk 10.1% (7.4% to 12.8%), adjusted p <0.001. Sits 2.2x the population after shrinkage.
real
Enterprise tier:enterprise
169 errors in 1,800 requests. Raw 9.4%, shrunk 9.2% (7.9% to 10.5%), adjusted p <0.001. Sits 2.1x the population after shrinkage.
3 further segments sat above 9.0% on the dashboard and were noise: lang:nl (6 of 50), channel:sms (5 of 45), lang:it (5 of 55). None survives correction; none needs a ticket.