Enum SamplerType

Namespace

Uralstech.UAI.LiteRTLM

Represents the type of sampler.

public enum SamplerType

Fields

Greedy = 3

Pick the token with maximum logit (i.e., argmax).

TopK = 1

Probabilistically pick among the top k tokens.

TopP = 2

Probabilistically pick among the tokens such that the sum is greater than or equal to p tokens after first performing top-k sampling.