Class NativeAPI.ConversationOptionalArgs

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.ConversationOptionalArgs

Inheritance

object

NativeAPI.ConversationOptionalArgs

Methods

litert_lm_conversation_optional_args_create()

Creates a LiteRT LM Conversation Optional Args. The caller is responsible for destroying the optional args using litert_lm_conversation_optional_args_delete(nint).

public static extern nint litert_lm_conversation_optional_args_create()

Returns

nint

A pointer to the created optional args, or nint.Zero on failure.

litert_lm_conversation_optional_args_delete(nint)

Destroys a LiteRT LM Conversation Optional Args.

public static extern void litert_lm_conversation_optional_args_delete(nint optionalArgs)

Parameters

optionalArgs nint

The optional args to destroy.

litert_lm_conversation_optional_args_set_max_output_tokens(nint, int)

Sets the maximum number of output tokens for the conversation optional args.

public static extern void litert_lm_conversation_optional_args_set_max_output_tokens(nint optionalArgs, int maxOutputTokens)

Parameters

optionalArgs nint

The optional args to modify.

maxOutputTokens int

The maximum number of output tokens.

litert_lm_conversation_optional_args_set_repetition_penalty_config(nint, nint)

Sets the repetition penalty configuration for the conversation optional args.

public static extern void litert_lm_conversation_optional_args_set_repetition_penalty_config(nint optionalArgs, nint repetitionPenaltyConfig)

Parameters

optionalArgs nint

The optional args to modify.

repetitionPenaltyConfig nint

The repetition penalty config to set. If nint.Zero, clears any previously set repetition penalty config.

litert_lm_conversation_optional_args_set_thinking_config(nint, nint)

Sets the thinking config for the conversation optional args.

public static extern void litert_lm_conversation_optional_args_set_thinking_config(nint optionalArgs, nint thinkingConfig)

Parameters

optionalArgs nint

The optional args to modify.

thinkingConfig nint

The thinking config to set. If nint.Zero, clears any previously set thinking config.

litert_lm_conversation_optional_args_set_visual_token_budget(nint, int)

Sets the visual token budget for the conversation optional args.

public static extern void litert_lm_conversation_optional_args_set_visual_token_budget(nint optionalArgs, int visualTokenBudget)

Parameters

optionalArgs nint

The optional args to modify.

visualTokenBudget int

The visual token budget.