Skip to main content

Interface: VideoAnalyzeRequestRich

Defined in: packages/agentos/src/core/video/types.ts:424

Rich video analysis request with scene detection, transcription, and RAG indexing support.

Extends the simpler VideoAnalyzeRequest pattern with fine-grained control over scene detection thresholds, description detail, and optional RAG indexing of analysis results.

Example​

const request: VideoAnalyzeRequestRich = {
  video: 'https://example.com/demo.mp4',
  sceneThreshold: 0.3,
  transcribeAudio: true,
  descriptionDetail: 'detailed',
  onProgress: (evt) => console.log(`${evt.phase}: ${evt.progress}%`),
};

Properties​

descriptionDetail?​

optional descriptionDetail: DescriptionDetail

Defined in: packages/agentos/src/core/video/types.ts:452

How detailed scene descriptions should be.

Default​

'detailed'

indexForRAG?​

optional indexForRAG: boolean

Defined in: packages/agentos/src/core/video/types.ts:466

Whether to index scene descriptions and transcripts into the RAG vector store for later retrieval.

Default​

false

maxScenes?​

optional maxScenes: number

Defined in: packages/agentos/src/core/video/types.ts:459

Maximum number of scenes to detect. Prevents runaway analysis on very long videos with many cuts.

Default​

100

onProgress()?​

optional onProgress: (event) => void

Defined in: packages/agentos/src/core/video/types.ts:473

Optional callback invoked as analysis progresses through phases. Called with a VideoAnalysisProgressEvent at each phase transition and when per-scene progress updates are available.

Parameters​

event​

VideoAnalysisProgressEvent

Returns​

void

sceneThreshold?​

optional sceneThreshold: number

Defined in: packages/agentos/src/core/video/types.ts:438

Threshold for scene change detection (0-1). Lower values detect more scene boundaries (more sensitive); higher values only detect dramatic cuts.

Default​

0.3

transcribeAudio?​

optional transcribeAudio: boolean

Defined in: packages/agentos/src/core/video/types.ts:446

Whether to transcribe the audio track using Whisper. When enabled, each scene's transcript is populated and a full transcript is included in the analysis.

Default​

true

video​

video: string | Buffer

Defined in: packages/agentos/src/core/video/types.ts:430

Video to analyze — either a URL string or a raw Buffer. When a URL is provided, the pipeline downloads the video to a temporary file before processing.