Class RedundancyRemovalCompressor

Namespace

AiDotNet.PromptEngineering.Compression

Assembly

AiDotNet.dll

Compressor that removes redundant phrases and verbose language from prompts.

public class RedundancyRemovalCompressor : PromptCompressorBase, IPromptCompressor

Inheritance

object

PromptCompressorBase

RedundancyRemovalCompressor

Implements

IPromptCompressor

Inherited Members

PromptCompressorBase.Name

PromptCompressorBase.Compress(string, CompressionOptions)

PromptCompressorBase.CompressWithMetrics(string, CompressionOptions)

PromptCompressorBase.CompressAsync(string, CompressionOptions, CancellationToken)

PromptCompressorBase.CountTokens(string)

PromptCompressorBase.ValidatePrompt(string)

PromptCompressorBase.ExtractVariables(string)

PromptCompressorBase.ReplaceVariablesWithPlaceholders(string, Dictionary<string, string>)

PromptCompressorBase.RestoreVariables(string, Dictionary<string, string>)

PromptCompressorBase.ExtractCodeBlocks(string)

PromptCompressorBase.ReplaceCodeBlocksWithPlaceholders(string, Dictionary<string, string>)

PromptCompressorBase.RestoreCodeBlocks(string, Dictionary<string, string>)

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Remarks

This compressor identifies and removes common patterns of redundant language such as filler phrases, unnecessary qualifiers, and verbose constructions. It preserves the semantic meaning while making the prompt more concise.

For Beginners: Removes wordy phrases without changing meaning.

Example:

var compressor = new RedundancyRemovalCompressor();

string verbose = "I would like you to please help me to analyze the following text";
string compressed = compressor.Compress(verbose);
// Result: "Analyze this text"

// What gets removed:
// - "I would like you to" → (removed)
// - "please help me to" → (removed)
// - "the following" → "this"

Constructors

RedundancyRemovalCompressor(Func<string, int>?)

Initializes a new instance of the RedundancyRemovalCompressor class.

public RedundancyRemovalCompressor(Func<string, int>? tokenCounter = null)

Parameters

tokenCounter Func<string, int>

Optional custom token counter function.

Methods

CompressCore(string, CompressionOptions)

Compresses the prompt by removing redundant phrases.

protected override string CompressCore(string prompt, CompressionOptions options)

Parameters

prompt string

options CompressionOptions

Returns

string