Class NativeAPI.TokenizeResult

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.TokenizeResult

Inheritance

object

NativeAPI.TokenizeResult

Methods

litert_lm_tokenize_result_delete(nint)

Destroys a LiteRT LM Tokenize Result.

public static extern void litert_lm_tokenize_result_delete(nint result)

Parameters

result nint

The tokenize result to destroy.

litert_lm_tokenize_result_get_num_tokens(nint)

Returns the number of token ids from a tokenize result.

public static extern nuint litert_lm_tokenize_result_get_num_tokens(nint result)

Parameters

result nint

The tokenize result.

Returns

nuint

The number of token ids.

litert_lm_tokenize_result_get_tokens(nint)

Returns the token ids from a tokenize result.

public static extern nint litert_lm_tokenize_result_get_tokens(nint result)

Parameters

result nint

The tokenize result.

Returns

nint

A pointer to the internal array of token ids. The returned pointer is valid only for the lifetime of the result object.