Class NativeAPI.SamplerParams

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.SamplerParams

Inheritance

object

NativeAPI.SamplerParams

Methods

litert_lm_sampler_params_create(SamplerType)

Creates LiteRT LM Sampler Parameters with a specific sampler type. The caller is responsible for destroying the parameters using litert_lm_sampler_params_delete(nint).

public static extern nint litert_lm_sampler_params_create(SamplerType type)

Parameters

type SamplerType

The sampler type to use.

Returns

nint

A pointer to the created parameters, or nint.Zero on failure.

litert_lm_sampler_params_delete(nint)

Destroys LiteRT LM Sampler Parameters.

public static extern void litert_lm_sampler_params_delete(nint @params)

Parameters

params nint

The parameters to destroy.

litert_lm_sampler_params_set_seed(nint, int)

Sets the seed.

public static extern void litert_lm_sampler_params_set_seed(nint @params, int seed)

Parameters

params nint

seed int

litert_lm_sampler_params_set_temperature(nint, float)

Sets the temperature.

public static extern void litert_lm_sampler_params_set_temperature(nint @params, float temperature)

Parameters

params nint

temperature float

litert_lm_sampler_params_set_top_k(nint, int)

Sets the top-k value.

public static extern void litert_lm_sampler_params_set_top_k(nint @params, int topK)

Parameters

params nint

topK int

litert_lm_sampler_params_set_top_p(nint, float)

Sets the top-p value.

public static extern void litert_lm_sampler_params_set_top_p(nint @params, float topP)

Parameters

params nint

topP float