Class FusedBatchNormActivationOp

Namespace

AiDotNet.JitCompiler.IR.Operations

Assembly

AiDotNet.dll

Fused batch normalization + activation operation.

public class FusedBatchNormActivationOp : IROp

Inheritance

object

IROp

FusedBatchNormActivationOp

Inherited Members

IROp.OutputIds

IROp.OutputId

IROp.InputIds

IROp.OutputType

IROp.OutputShape

IROp.OutputShapes

IROp.OpType

IROp.ToString()

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

Remarks

For Beginners: Combines batch norm with activation.

BatchNorm followed by ReLU is extremely common in CNNs. Fusing them reduces memory traffic and improves performance.

Pattern: x_norm = (x - mean) / sqrt(var + epsilon) output = activation(gamma * x_norm + beta)

Properties

ActivationName

Gets or sets the activation function name.

public string ActivationName { get; set; }

Property Value

string

Epsilon

Gets or sets epsilon for numerical stability.

public double Epsilon { get; set; }

Property Value

double

Momentum

Gets or sets momentum for running statistics.

public double Momentum { get; set; }

Property Value

double

Methods

Validate()

Validates inputs.

public override bool Validate()

Returns

bool