Class GpuOptimizerState

Namespace

AiDotNet.Interfaces

Assembly

AiDotNet.dll

Holds the optimizer state buffers for GPU-resident training.

public class GpuOptimizerState

Inheritance

object

GpuOptimizerState

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Remarks

Different optimizers require different state: - SGD with momentum: velocity buffer - Adam/AdamW: first moment (m) and second moment (v) buffers - RMSprop: squared average buffer - Adagrad: accumulated gradient buffer

Properties

AccumulatedGrad

Accumulated gradient buffer (for Adagrad).

public IGpuBuffer? AccumulatedGrad { get; set; }

Property Value

IGpuBuffer

M

First moment buffer (for Adam-family optimizers).

public IGpuBuffer? M { get; set; }

Property Value

IGpuBuffer

SquaredAvg

Squared average buffer (for RMSprop).

public IGpuBuffer? SquaredAvg { get; set; }

Property Value

IGpuBuffer

V

Second moment buffer (for Adam-family optimizers).

public IGpuBuffer? V { get; set; }

Property Value

IGpuBuffer

Velocity

Velocity buffer (for SGD momentum, NAG, LARS).

public IGpuBuffer? Velocity { get; set; }

Property Value

IGpuBuffer