Interface: AggregateMetrics
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:162
Aggregate metrics across a run.
Properties
avgLatencyMs
avgLatencyMs:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:176
Average latency ms
avgScore
avgScore:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:172
Average score (0-1)
byCategory?
optionalbyCategory:Record<string, {avgScore:number;count:number;passRate:number; }>
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:188
Metrics by category
failedTests
failedTests:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:168
Failed tests
p50LatencyMs
p50LatencyMs:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:178
P50 latency
p95LatencyMs
p95LatencyMs:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:180
P95 latency
p99LatencyMs
p99LatencyMs:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:182
P99 latency
passedTests
passedTests:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:166
Passed tests
passRate
passRate:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:170
Pass rate (0-1)
scoreStdDev
scoreStdDev:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:174
Score standard deviation
totalCostUsd
totalCostUsd:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:186
Total estimated cost
totalTests
totalTests:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:164
Total test cases
totalTokens
totalTokens:
number
Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:184
Total tokens used