Class FusedResidualBlockOp

Namespace

AiDotNet.JitCompiler.IR.Operations

Assembly

AiDotNet.dll

Fused residual block operation.

public class FusedResidualBlockOp : IROp

Inheritance

object

IROp

FusedResidualBlockOp

Inherited Members

IROp.OutputIds

IROp.OutputId

IROp.InputIds

IROp.OutputType

IROp.OutputShape

IROp.OutputShapes

IROp.OpType

IROp.ToString()

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

Remarks

For Beginners: Fuses a residual/skip connection pattern.

Residual blocks are everywhere in modern networks (ResNet, Transformers, etc.) Pattern: output = activation(main_path + skip_connection)

By fusing this, we can:

• Optimize the addition and activation together
• Reduce memory traffic
• Better utilize CPU/GPU resources

Properties

ActivationName

Gets or sets the activation function name.

public string ActivationName { get; set; }

Property Value

string

Methods

Validate()

Validates inputs (main_path, skip_connection).

public override bool Validate()

Returns

bool