Table of Contents

Class SamplingParams

Namespace
InferenceEngine.Core
Assembly
InferenceEngine.Core.dll

Sampling parameters. Disabled/identity values mean "off".

public sealed class SamplingParams
Inheritance
SamplingParams
Inherited Members

Properties

RepetitionPenalty

1 => disabled.

public float RepetitionPenalty { get; set; }

Property Value

float

Temperature

0 => greedy (argmax).

public float Temperature { get; set; }

Property Value

float

TopK

0 => disabled.

public int TopK { get; set; }

Property Value

int

TopP

1 => disabled.

public float TopP { get; set; }

Property Value

float