Class NativeAPI.RepetitionPenaltyConfig

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.RepetitionPenaltyConfig

Inheritance

object

NativeAPI.RepetitionPenaltyConfig

Methods

litert_lm_repetition_penalty_config_create()

Creates a LiteRT LM Repetition Penalty Config. The caller is responsible for destroying the config using litert_lm_repetition_penalty_config_delete(nint).

public static extern nint litert_lm_repetition_penalty_config_create()

Returns

nint

A pointer to the created config, or nint.Zero on failure.

litert_lm_repetition_penalty_config_delete(nint)

Destroys a LiteRT LM Repetition Penalty Config.

public static extern void litert_lm_repetition_penalty_config_delete(nint config)

Parameters

config nint

The config to destroy.

litert_lm_repetition_penalty_config_set_frequency_penalty(nint, float)

public static extern void litert_lm_repetition_penalty_config_set_frequency_penalty(nint config, float frequencyPenalty)

Parameters

config nint

The config to modify.

frequencyPenalty float

A scalar subtracted from a token's logit scaled by previous appearances.

litert_lm_repetition_penalty_config_set_presence_penalty(nint, float)

Sets the presence penalty for the repetition penalty config.

public static extern void litert_lm_repetition_penalty_config_set_presence_penalty(nint config, float presencePenalty)

Parameters

config nint

The config to modify.

presencePenalty float

A scalar subtracted from a logit if a token has appeared at least once.

litert_lm_repetition_penalty_config_set_repetition_penalty(nint, float)

Sets the repetition penalty for the repetition penalty config.

public static extern void litert_lm_repetition_penalty_config_set_repetition_penalty(nint config, float repetitionPenalty)

Parameters

config nint

The config to modify.

repetitionPenalty float

A multiplicative penalty for any token already generated.

litert_lm_repetition_penalty_config_set_window_size(nint, int)

Sets the window size for the repetition penalty config.

public static extern void litert_lm_repetition_penalty_config_set_window_size(nint config, int windowSize)

Parameters

config nint

The config to modify.

windowSize int

The maximum number of recent tokens to consider.