Class AiModelResult<T, TInput, TOutput>.InferenceSession
Facade-friendly inference session that owns stateful inference internals.
public sealed class AiModelResult<T, TInput, TOutput>.InferenceSession : IDisposable
- Inheritance
-
AiModelResult<T, TInput, TOutput>.InferenceSession
- Implements
- Inherited Members
Remarks
This type intentionally keeps inference internals behind the facade. Users create sequences via CreateSequence() and run inference via Predict(TInput).
Methods
CreateSequence()
Creates an independent sequence within this session.
public AiModelResult<T, TInput, TOutput>.InferenceSequence CreateSequence()
Returns
- AiModelResult<T, TInput, TOutput>.InferenceSequence
Remarks
Each sequence represents an independent stream (e.g., one chat) and owns its own state.
Dispose()
Performs application-defined tasks associated with freeing, releasing, or resetting unmanaged resources.
public void Dispose()