Class BenchmarkProblem

Namespace

AiDotNet.Reasoning.Benchmarks.Models

Assembly

AiDotNet.dll

Represents a single problem in a benchmark dataset.

public class BenchmarkProblem

Inheritance

object

BenchmarkProblem

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

Remarks

For Beginners: This is one test question with its correct answer. Think of it like a single problem on a homework assignment or test.

Example (GSM8K):

Problem: "Janet has 15 apples. She gives 40% to her friend. How many does she have left?"
CorrectAnswer: "9"

Example (HumanEval):

Problem: "Write a function that returns True if a number is prime, False otherwise"
CorrectAnswer: "def is_prime(n): ..." (reference implementation)

Properties

Category

Category or topic of this problem (e.g., "algebra", "geometry", "sorting").

public string Category { get; set; }

Property Value

string

CorrectAnswer

The correct answer or solution.

public string CorrectAnswer { get; set; }

Property Value

string

Difficulty

Difficulty level (e.g., "easy", "medium", "hard").

public string Difficulty { get; set; }

Property Value

string

Id

Unique identifier for this problem.

public string Id { get; set; }

Property Value

string

Metadata

Additional metadata specific to the benchmark.

public Dictionary<string, object> Metadata { get; set; }

Property Value

Dictionary<string, object>

Problem

The problem statement or question.

public string Problem { get; set; }

Property Value

string

Methods

ToString()

Gets a summary string of this problem.

public override string ToString()

Returns

string