Class HierarchicalSoftmaxOp
- Namespace
- AiDotNet.JitCompiler.IR.Operations
- Assembly
- AiDotNet.dll
Represents Hierarchical Softmax activation in the IR.
public class HierarchicalSoftmaxOp : IROp- Inheritance
-
HierarchicalSoftmaxOp
- Inherited Members
Remarks
Organizes classes into a tree structure for efficient computation. Reduces complexity from O(V) to O(log V) for large vocabularies.
Properties
TreeStructure
The hierarchy tree structure (encoded).
public int[] TreeStructure { get; set; }Property Value
- int[]
Methods
Validate()
Validates that this operation is correctly formed.
public override bool Validate()Returns
- bool
True if valid, false otherwise.
Remarks
Basic validation checks that the operation has required information. Derived classes can override to add operation-specific validation.
For Beginners: This checks that the operation makes sense.
Basic checks:
- Output ID is valid (non-negative)
- Has the right number of inputs
- Shapes are compatible
Specific operations add their own checks:
- MatMul: inner dimensions must match
- Conv2D: kernel size must be valid
- Reshape: total elements must be preserved
If validation fails, the operation can't be compiled.