Class NativeAPI.ConversationConfig

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.ConversationConfig

Inheritance

object

NativeAPI.ConversationConfig

Methods

litert_lm_conversation_config_create()

Creates a LiteRT LM Conversation Config. The caller is responsible for destroying the config using litert_lm_conversation_config_delete(nint).

public static extern nint litert_lm_conversation_config_create()

Returns

nint

A pointer to the created config, or nint.Zero on failure.

litert_lm_conversation_config_delete(nint)

Destroys a LiteRT LM Conversation Config.

public static extern void litert_lm_conversation_config_delete(nint config)

Parameters

config nint

The config to destroy.

litert_lm_conversation_config_set_enable_constrained_decoding(nint, bool)

Sets whether to enable constrained decoding for this conversation config.

public static extern void litert_lm_conversation_config_set_enable_constrained_decoding(nint config, bool enableConstrainedDecoding)

Parameters

config nint

The config to modify.

enableConstrainedDecoding bool

Whether to enable constrained decoding.

litert_lm_conversation_config_set_extra_context(nint, string)

Sets the extra context for the conversation preface.

public static extern void litert_lm_conversation_config_set_extra_context(nint config, string extraContextJson)

Parameters

config nint

The config to modify.

extraContextJson string

A JSON string representing the extra context object.

litert_lm_conversation_config_set_filter_channel_content_from_kv_cache(nint, bool)

Sets whether to filter channel content from the KV cache.

public static extern void litert_lm_conversation_config_set_filter_channel_content_from_kv_cache(nint config, bool filterChannelContentFromKvCache)

Parameters

config nint

The config to modify.

filterChannelContentFromKvCache bool

Whether to filter channel content.

litert_lm_conversation_config_set_messages(nint, string)

Sets the initial messages for this conversation config.

public static extern void litert_lm_conversation_config_set_messages(nint config, string messagesJson)

Parameters

config nint

The config to modify.

messagesJson string

The initial messages in JSON array format.

litert_lm_conversation_config_set_session_config(nint, nint)

Sets the session config for this conversation config.

public static extern void litert_lm_conversation_config_set_session_config(nint config, nint sessionConfig)

Parameters

config nint

The config to modify.

sessionConfig nint

The session config to use.

litert_lm_conversation_config_set_stream_tool_calls(nint, bool, string)

Sets whether to stream tool call tokens.

public static extern void litert_lm_conversation_config_set_stream_tool_calls(nint config, bool streamToolCalls, string channelName)

Parameters

config nint

The config to modify.

streamToolCalls bool

Whether to stream tool call tokens.

channelName string

The channel name to use for tool call tokens.

litert_lm_conversation_config_set_system_message(nint, string)

Sets the system message for this conversation config.

public static extern void litert_lm_conversation_config_set_system_message(nint config, string systemMessageJson)

Parameters

config nint

The config to modify.

systemMessageJson string

The system message in JSON format.

litert_lm_conversation_config_set_thinking_config(nint, nint)

Sets the thinking config for this conversation config.

public static extern void litert_lm_conversation_config_set_thinking_config(nint config, nint thinkingConfig)

Parameters

config nint

The config to modify.

thinkingConfig nint

The thinking config to set. If nint.Zero, clears any previously set thinking config.

litert_lm_conversation_config_set_tools(nint, string)

Sets the tools for this conversation config.

public static extern void litert_lm_conversation_config_set_tools(nint config, string toolsJson)

Parameters

config nint

The config to modify.

toolsJson string

The tools description in JSON array format.