Table of Contents

Class DINO<T>

Namespace
AiDotNet.ComputerVision.Detection.ObjectDetection.DETR
Assembly
AiDotNet.dll

DINO (DETR with Improved deNoising anchOr boxes) - State-of-the-art DETR variant.

public class DINO<T> : ObjectDetectorBase<T>

Type Parameters

T

The numeric type used for calculations.

Inheritance
DINO<T>
Inherited Members

Remarks

For Beginners: DINO improves upon DETR by using contrastive denoising training and mixed query selection. It achieves better performance with faster convergence than the original DETR.

Key improvements: - Contrastive denoising training for better query learning - Mixed query selection (both content and position queries) - Look forward twice for better box predictions - Multi-scale deformable attention (optional)

Reference: Zhang et al., "DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection", ICLR 2023

Constructors

DINO(ObjectDetectionOptions<T>)

Creates a new DINO detector.

public DINO(ObjectDetectionOptions<T> options)

Parameters

options ObjectDetectionOptions<T>

Detection options.

Properties

Name

Name of this detector architecture.

public override string Name { get; }

Property Value

string

Methods

Detect(Tensor<T>, double, double)

Detects objects in an image with custom thresholds.

public override DetectionResult<T> Detect(Tensor<T> image, double confidenceThreshold, double nmsThreshold)

Parameters

image Tensor<T>

Input image tensor.

confidenceThreshold double

Minimum confidence to keep a detection.

nmsThreshold double

IoU threshold for NMS.

Returns

DetectionResult<T>

Detection results.

Forward(Tensor<T>)

Performs forward pass through the network.

protected override List<Tensor<T>> Forward(Tensor<T> input)

Parameters

input Tensor<T>

Input image tensor.

Returns

List<Tensor<T>>

Raw network outputs before post-processing.

GetHeadParameterCount()

Gets the number of parameters in the detection head.

protected override long GetHeadParameterCount()

Returns

long

Number of parameters.

LoadWeightsAsync(string, CancellationToken)

Loads pre-trained weights from a file or URL.

public override Task LoadWeightsAsync(string pathOrUrl, CancellationToken cancellationToken = default)

Parameters

pathOrUrl string

Local file path or URL to weights.

cancellationToken CancellationToken

Cancellation token.

Returns

Task

PostProcess(List<Tensor<T>>, int, int, double, double)

Post-processes raw network outputs into detections.

protected override List<Detection<T>> PostProcess(List<Tensor<T>> outputs, int imageWidth, int imageHeight, double confidenceThreshold, double nmsThreshold)

Parameters

outputs List<Tensor<T>>

Raw network outputs.

imageWidth int

Original image width.

imageHeight int

Original image height.

confidenceThreshold double

Minimum confidence threshold.

nmsThreshold double

NMS IoU threshold.

Returns

List<Detection<T>>

List of detections after NMS.

SaveWeights(string)

Saves model weights to a file.

public override void SaveWeights(string path)

Parameters

path string

File path to save weights.

Edit this page