Class FusedLinearActivationOp
- Namespace
- AiDotNet.JitCompiler.IR.Operations
- Assembly
- AiDotNet.dll
Fused linear + activation operation.
public class FusedLinearActivationOp : IROp- Inheritance
-
FusedLinearActivationOp
- Inherited Members
Remarks
For Beginners: Combines linear layer with activation function.
Instead of: t1 = Linear(input, weights, bias) t2 = ReLU(t1)
We do: t2 = LinearReLU(input, weights, bias)
Common in neural networks - almost every layer has an activation!
Properties
ActivationName
Gets or sets the activation function name.
public string ActivationName { get; set; }Property Value
HasBias
Gets or sets whether the linear layer has a bias term.
public bool HasBias { get; set; }Property Value
Methods
Validate()
Validates inputs.
public override bool Validate()