Note

Access to this page requires authorization. You can try signing in or .

Access to this page requires authorization. You can try .

LexicalTokenizer type

Contains the possible cases for Tokenizer.

type LexicalTokenizer =
 | ClassicTokenizer
 | EdgeNGramTokenizer
 | KeywordTokenizer
 | MicrosoftLanguageTokenizer
 | MicrosoftLanguageStemmingTokenizer
 | NGramTokenizer
 | PathHierarchyTokenizer
 | PatternTokenizer
 | LuceneStandardTokenizer
 | UaxUrlEmailTokenizer