Table of Contents

Namespace AiDotNet.Tokenization.Interfaces

Interfaces

ITokenizer

Interface for text tokenizers.

IVocabulary

Interface for vocabulary management.