Enum OnlineUpdateMode
- Namespace
- AiDotNet.KnowledgeDistillation.Teachers
- Assembly
- AiDotNet.dll
Defines how an online teacher model is updated during training.
public enum OnlineUpdateMode
Fields
EMA = 0Exponential Moving Average - smooth, stable updates. Teacher slowly tracks toward target without explicit gradients.
GradientBased = 1Gradient-based updates - standard gradient descent on teacher. Teacher optimized with its own loss function.
MomentumBased = 2Momentum-based updates - teacher follows with momentum. Combines aspects of EMA and gradient-based.