Agent Workbench — Sarah's Agents
Customer Facing Agents
Click any row for 12-week trend charts
| Agent | Task Completion | Quality & Accuracy | Safety & Escalation | Customer Impact | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Res% | FCR% | Turns | LLM% | Hum% | Err% | Pol% | HITL% | Guard% | Auth | FP% | CSAT | Cmp% | CES | |
Issues
Auto-detectedConcierge agent looped 3x on insolvency queries this week — steering gap suspected
Energy Concierge v5.2 · 3 occurrences · Billing Dispute handoff failures
Proactive agent hesitated on multi-zone scheduling in 8 contacts
Proactive Intervention v4.0 · Confidence below threshold · A/C zone coordination
Billing agent unnecessary escalation rate +1.2% since green levy launch
Billing Dispute v3.1 · Correlated with Green Levy Explainer absence · 18 contacts
Vulnerability detector over-triggering on payment-discussion keywords
Vulnerability Detector v1.2 · 12 false positives · "can't afford" in routine tariff comparison
Switching handler cooling-off script skipped in 2 remote-initiated contacts
Switching Handler v2.4 · Compliance risk · Consumer Contracts Regulations 2013
Opportunities
From production learningVerbal agreement pathway — auto-check call recordings
Multi-zone setpoint coordination — prevent conflicting schedules
Competitor rate matching — autonomous authority within retention band
Solar export billing — net metering calculation for PV customers
Hardship detection from payment pattern deterioration
Green levy plain-language explanation
Steering Documents
Agent behaviour definitions — the "job description"
Evaluation Coverage
Scenarios covered vs known gaps per agent
| Agent | Covered | Gaps | Coverage |
|---|