Class FusedAddLayerNormOp
- Namespace
- AiDotNet.JitCompiler.IR.Operations
- Assembly
- AiDotNet.dll
Fused add + layer normalization operation.
public class FusedAddLayerNormOp : IROp- Inheritance
-
FusedAddLayerNormOp
- Inherited Members
Remarks
For Beginners: Combines residual addition with LayerNorm.
Common in Transformer blocks: output = LayerNorm(x + residual)
Reduces memory traffic by avoiding intermediate storage.
Properties
Epsilon
Gets or sets epsilon for numerical stability.
public double Epsilon { get; set; }Property Value
NormalizedShape
Gets or sets the normalized shape.
public int[] NormalizedShape { get; set; }Property Value
- int[]
Methods
Validate()
Validates inputs (a, b, gamma, beta).
public override bool Validate()