Enum DraftModelType

Namespace

AiDotNet.Configuration

Assembly

AiDotNet.dll

Types of draft models for speculative decoding.

public enum DraftModelType

Fields

Custom = 2

Custom draft model (internal/serving integration).

NGram = 0

N-gram based statistical model (fast, no GPU).

SmallNeural = 1

Small neural network model (more accurate, uses GPU).