Interface IStructuredOutputManager

Initializes the manager with optional configuration.

Generates structured output conforming to the given schema.

Throws

If generation fails after all retries

Example

const result = await manager.generate<Person>({
  prompt: 'Extract person info from: John Doe, 30, john@example.com',
  schema: personSchema,
  schemaName: 'Person',
  strict: true,
});

if (result.success) {
  console.log(result.data.name); // Type-safe access
}
Copy

Generates parallel function/tool calls.

This method enables the LLM to call multiple functions in a single response, useful for parallel data fetching or multi-step operations.

Example

const result = await manager.generateFunctionCalls({
  prompt: 'Get the weather in Paris and London',
  functions: [weatherFunction],
  maxParallelCalls: 10,
});

// Execute all calls in parallel
await Promise.all(result.calls.map(async call => {
  const fn = functions.find(f => f.name === call.functionName);
  if (fn?.handler) {
    call.executionResult = await fn.handler(call.arguments);
  }
}));
Copy

Extracts structured entities from unstructured text.

Useful for NER, data extraction, and information retrieval tasks.

Example

const result = await manager.extractEntities<Person>({
  text: 'John Doe (john@example.com) met Jane Smith (jane@example.com)',
  entitySchema: personSchema,
  taskName: 'PersonExtraction',
  extractAll: true,
});

result.entities.forEach(person => {
  console.log(`Found: ${person.name} - ${person.email}`);
});
Copy

Validates data against a JSON Schema.

Example

const issues = manager.validate(
  { name: 'John', age: -5 },
  personSchema,
  true
);

if (issues.length > 0) {
  issues.forEach(issue => {
    console.log(`${issue.path}: ${issue.message}`);
  });
}
Copy

Parses JSON string with error recovery.

Attempts to extract valid JSON from potentially malformed output, handling common LLM output issues like:

• Markdown code blocks
• Trailing commas
• Unquoted keys
• Single quotes

Example

// Handles markdown-wrapped JSON
const data = manager.parseJSON('```json\n{"name": "John"}\n```');
// Returns: { name: 'John' }

// Handles trailing commas
const data2 = manager.parseJSON('{"a": 1, "b": 2,}');
// Returns: { a: 1, b: 2 }
Copy

Determines the best strategy for a given provider/model.

Registers a custom schema for reuse.

Example

manager.registerSchema('Address', {
  type: 'object',
  properties: {
    street: { type: 'string' },
    city: { type: 'string' },
    country: { type: 'string' },
    postalCode: { type: 'string' },
  },
  required: ['street', 'city', 'country'],
});

// Use in other schemas via $ref
const orderSchema = {
  type: 'object',
  properties: {
    shippingAddress: { $ref: '#/$defs/Address' },
  },
};
Copy

Gets a registered schema by name.

Gets statistics about structured output operations.

Resets statistics counters.