Skip to main content

Interface: EvalTestCase

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:54

A test case for evaluation.

Properties​

category?​

optional category: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:60

Category or tag

context?​

optional context: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:68

Context or system prompt

criteria?​

optional criteria: EvalCriteria[]

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:75

Evaluation criteria

expectedOutput?​

optional expectedOutput: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:64

Expected output (for comparison)

expectedToolCalls?​

optional expectedToolCalls: object[]

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:70

Expected tool calls

args?​

optional args: Record<string, unknown>

toolName​

toolName: string

id​

id: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:56

Unique test case ID

input​

input: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:62

Input to the agent

metadata?​

optional metadata: Record<string, unknown>

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:77

Metadata

name​

name: string

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:58

Test case name

referenceOutputs?​

optional referenceOutputs: string[]

Defined in: packages/agentos/src/core/evaluation/IEvaluator.ts:66

Reference outputs for similarity comparison