01
📈 Simulation Results Report & Threshold Metrics
We've completely revamped the simulation results experience with a new results report, metric overview, and built-in threshold pass/fail tracking.
What's New:
- Results report — When a simulation run completes, you now get a full report with an overview section (total calls, completion rate, pass rate), a metrics breakdown, and a per-call results summary table
- Threshold results — A dedicated section in the report shows your pass/fail rate across all threshold metrics with a clear visual breakdown of which calls passed and which didn't
- Metric overview — See how every metric performed across your simulation runs with averages, distributions, and per-call breakdowns
- Thresholds in run plans — When building a simulation run plan, select which metrics to evaluate and configure thresholds inline (e.g.,
Customer Satisfaction >= 7,Response Time < 1000ms). After the run, see exactly which calls passed - Thresholds on call detail — Threshold metrics now appear on individual call pages with a dedicated Thresholds section on the Metrics tab and pass/fail cards on the Overview tab
- Metric collection banner — A live banner shows when metrics are actively being collected for a call, with automatic polling so you don't need to refresh
Threshold Configuration:
- Numeric/Scale/Count metrics: all comparison operators (
>=,>,<=,<,=,!=) - Boolean metrics: equals/not-equals
- Classification metrics: text matching with equals/not-equals
- Aggregation modes: Each, Average, Min, Max, Median, Sum, P95, P99, Count
- Participant role filtering: All, Agent, or Customer