Interface: EvalConfig

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:198

Configuration for an evaluation run.

Properties

concurrency?

optional concurrency: number

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:200

Maximum concurrent evaluations

---

continueOnError?

optional continueOnError: boolean

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:206

Whether to continue on error

---

customScorers?

optional customScorers: Record<string, ScorerFunction>

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:213

Custom scorers

---

retries?

optional retries: number

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:204

Number of retries on failure

---

thresholds?

optional thresholds: object

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:208

Scoring thresholds

pass?

optional pass: number

warn?

optional warn: number

---

timeoutMs?

optional timeoutMs: number

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:202

Timeout per test case (ms)