Class BentIdentityOp
- Namespace
- AiDotNet.JitCompiler.IR.Operations
- Assembly
- AiDotNet.dll
Represents Bent Identity activation in the IR.
public class BentIdentityOp : IROp- Inheritance
-
BentIdentityOp
- Inherited Members
Remarks
Computes BentIdentity(x) = (sqrt(x^2 + 1) - 1) / 2 + x. Smooth approximation to ReLU with non-zero gradients everywhere.
Methods
Validate()
Validates that this operation is correctly formed.
public override bool Validate()Returns
- bool
True if valid, false otherwise.
Remarks
Basic validation checks that the operation has required information. Derived classes can override to add operation-specific validation.
For Beginners: This checks that the operation makes sense.
Basic checks:
- Output ID is valid (non-negative)
- Has the right number of inputs
- Shapes are compatible
Specific operations add their own checks:
- MatMul: inner dimensions must match
- Conv2D: kernel size must be valid
- Reshape: total elements must be preserved
If validation fails, the operation can't be compiled.