Typed decisions

A typed decision is a small, repeated choice with a fixed set of answers, for example what kind of message just arrived. A rule, a small typed model (an "arm") or a large model can answer it.

• off: a rule, then the large model. No typed arm is asked.
• shadow: the large model decides. A typed arm answers beside it and Agent measures how often they agree.
• primary: confident typed answers are used. The rest go to the large model.
• auto: shadow until the measured agreement is high enough, then primary. It goes back when agreement drops.

Decisions shows, for each purpose over 24 hours, 7 days or 30 days: calls, rule hits, typed answers, agreement, overrides, speed, cost and escalations. Only owners and admins change the mode and the threshold.