Type Alias: FuzzyTokenizer()

FuzzyTokenizer = (text) => Iterable<FuzzyToken>

Defined in: packages/agentos/src/cognition/rag/search/FuzzyIndex.ts:39

The words of a text, each with where it stands. The index hands it every text and query in NFC.

Parameters

text

string

Returns

Iterable<FuzzyToken>