Class FusedLayerNormAddOp
- Namespace
- AiDotNet.JitCompiler.IR.Operations
- Assembly
- AiDotNet.dll
Fused layer normalization + add operation.
public class FusedLayerNormAddOp : IROp- Inheritance
-
FusedLayerNormAddOp
- Inherited Members
Remarks
For Beginners: Combines LayerNorm with residual addition.
Very common in Transformers: output = LayerNorm(x) + residual
Fusing reduces memory reads/writes.
Properties
Epsilon
Gets or sets epsilon for numerical stability.
public double Epsilon { get; set; }Property Value
NormalizedShape
Gets or sets the normalized shape.
public int[] NormalizedShape { get; set; }Property Value
- int[]
Methods
Validate()
Validates inputs (x, gamma, beta, residual).
public override bool Validate()