CN

SmartSupply AI

Centrica PLC — Demo Access

Sign in to continue

Need access? Email kemphil@amazon.co.uk

Access restricted to amazon.co.uk, amazon.com, and mckinsey.com email addresses.

Agent Workbench — Sarah's Agents

Customer Facing Agents

Click any row for 12-week trend charts

Agent Task Completion Quality & Accuracy Safety & Escalation Customer Impact
Res% FCR% Turns LLM% Hum% Err% Pol% HITL% Guard% Auth FP% CSAT Cmp% CES

Issues

Auto-detected
Last 7 days

Concierge agent looped 3x on insolvency queries this week — steering gap suspected

Energy Concierge v5.2 · 3 occurrences · Billing Dispute handoff failures

Warning

Proactive agent hesitated on multi-zone scheduling in 8 contacts

Proactive Intervention v4.0 · Confidence below threshold · A/C zone coordination

Warning

Billing agent unnecessary escalation rate +1.2% since green levy launch

Billing Dispute v3.1 · Correlated with Green Levy Explainer absence · 18 contacts

Warning

Vulnerability detector over-triggering on payment-discussion keywords

Vulnerability Detector v1.2 · 12 false positives · "can't afford" in routine tariff comparison

Info

Switching handler cooling-off script skipped in 2 remote-initiated contacts

Switching Handler v2.4 · Compliance risk · Consumer Contracts Regulations 2013

Info

Opportunities

From production learning
Improvements identified from HITL decisions, patterns, and eval failures
HITL-2026-07-14-003 Ready for review -3/week

Verbal agreement pathway — auto-check call recordings

HITL-2026-07-12-001 Testing -5/week

Multi-zone setpoint coordination — prevent conflicting schedules

HITL-2026-07-10-002 Deployed -4/week

Competitor rate matching — autonomous authority within retention band

HITL-2026-07-09-004 Ready for review -2/week

Solar export billing — net metering calculation for PV customers

HITL-2026-07-07-002 Testing -3/week

Hardship detection from payment pattern deterioration

PATTERN-2026-07-11-001 Ready for review -12/week

Green levy plain-language explanation

Steering Documents

Agent behaviour definitions — the "job description"

Evaluation Coverage

Scenarios covered vs known gaps per agent

Agent Covered Gaps Coverage