Skip to main content

Class: GatewayProviderManager

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:23

The provider-manager calls the GMI, MetapromptExecutor and LLMUtilityAI make (getProvider, getDefaultProvider, getProviderForModel, getModelInfo), answered from the hop that serves the turn. The GMI sets the resolution before it builds each prompt. Metaprompt and utility calls have no fallback of their own in this increment: on a fallback hop a call that names the primary's provider or model finds nothing, which the caller reports. A turn's budget, when it has one, bounds these calls too (the constructor's budgetOf).

Implements​

  • GmiProviderManagerCalls

Constructors​

Constructor​

new GatewayProviderManager(budgetOf?): GatewayProviderManager

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:34

Parameters​

budgetOf?​

() => SpendBudget | undefined

The spend budget of the turn the GMI is running, read at each call. With one, each provider this manager hands out checks it before every completion request and charges every answer (gmi.metaprompt), so a metaprompt or self-reflection call spends inside the turn's budget; without one, the hop's own providers.

Returns​

GatewayProviderManager

Properties​

isInitialized​

readonly isInitialized: true = true

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:27

Present for code that checks a manager's readiness.

Methods​

asProviderManager()​

asProviderManager(): AIModelProviderManager

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:79

This adapter typed as GMIBaseConfig.llmProviderManager expects; it implements every method the GMI path calls.

Returns​

AIModelProviderManager

getDefaultProvider()​

getDefaultProvider(): IProvider | undefined

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:55

The serving hop's provider.

Returns​

IProvider | undefined

Implementation of​

GmiProviderManagerCalls.getDefaultProvider

getModelInfo()​

getModelInfo(modelId, providerId?): Promise<ModelInfo | undefined>

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:73

Model info from the serving hop's manager, for the hop's provider unless providerId names another.

Parameters​

modelId​

string

providerId?​

string

Returns​

Promise<ModelInfo | undefined>

Implementation of​

GmiProviderManagerCalls.getModelInfo

getProvider()​

getProvider(providerId): IProvider | undefined

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:49

The serving hop's provider when providerId names it; otherwise undefined.

Parameters​

providerId​

string

Returns​

IProvider | undefined

Implementation of​

GmiProviderManagerCalls.getProvider

getProviderForModel()​

getProviderForModel(modelId): IProvider | undefined

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:61

The serving hop's provider when modelId is the hop's model; otherwise undefined.

Parameters​

modelId​

string

Returns​

IProvider | undefined

Implementation of​

GmiProviderManagerCalls.getProviderForModel

setResolution()​

setResolution(resolution): void

Defined in: packages/agentos/src/api/runtime/gatewayProviderManager.ts:37

Makes resolution the hop that answers every later call.

Parameters​

resolution​

CompletionResolution

Returns​

void