Measure

KPI Studio & model performance

Track latency, accuracy, false positives, and drift. Break down performance by language, codec, and SNR bands to match operator reporting expectations.

Reporting window: Last 24 hrs Resolution: 15 min Exports pending: N/A
Model View Breakouts

Topline KPIs

Carrier-grade targets

Decision p95

N/A

Budget 1.0s

Whisper delivery

N/A

Alert within 2.0s

False positive rate

N/A

Threshold 0.50%

Fraud intent recall

N/A

Prevalence controlled

Model performance matrix

Drift & retrain signals
Model Use case Accuracy Drift Retrain trigger
Awaiting data.

Performance breakouts

Language, codec, and SNR

Language coverage

Awaiting data.

Codec + SNR bands

Awaiting data.

Audio quality signals

Codec, SNR, jitter, packet loss
Codec Samples Avg SNR Avg Jitter Avg Packet Loss
Awaiting data.

Evaluation methodology

Bias-aware measurement

Target prevalence

Awaiting data

Controlled weighting

Observed prevalence

Awaiting data

Labelled sample set

Intent precision

Awaiting data

Prevalence controlled

Intent recall

Awaiting data

Prevalence controlled

Intent FPR

Awaiting data

Guardrail threshold

Ground truth sources

Prevalence-controlled sampling, decoy engagements, and analyst adjudication feed the evaluation set.

Awaiting data

No ground truth labels yet.

Pending

Prevalence-controlled breakouts

Break down performance by language, codec, and SNR bands to avoid skewed traffic bias.

Awaiting data

Language performance will appear here.

Pending
Awaiting data Codec breakouts will appear here.
Awaiting data SNR breakouts will appear here.

KPI timeseries

15-minute resolution (last 3 hours)
Bucket start Calls Fraud Synthetic Liveness Whispers Avg latency Liveness latency
Awaiting data.

Model KPI log

Latency + FPR monitoring
Model Latency p95 FPR Recall Status
Awaiting data.

Transaction records

Traceability from call arrival to verdict
Call ID From → To Decision Confidence Whisper Liveness Liveness latency Policy bundle Timestamp
Awaiting data.

Liveness evidence

Third-party liveness reporting

Liveness coverage

92% of monitored calls evaluated

Healthy

Liveness latency

P95 680ms (budget 1.0s)

Monitor

KPI & transaction exports

CSV/JSON + SFTP delivery
Download KPI CSV Download KPI JSON KPI Manifest Queue SFTP KPI Download Transactions CSV Download Transactions JSON Transactions Manifest Queue SFTP Transactions
Job Format Schedule Status
KPI daily export CSV Daily 02:00 Success