Class TokenizeResult

Namespace

Uralstech.UAI.LiteRTLM

public sealed class TokenizeResult : LiteRTLMNativeHandle

Inheritance

object

LiteRTLMNativeHandle

TokenizeResult

Inherited Members

LiteRTLMNativeHandle.Dispose()

Methods

AsReadOnlySpan()

Returns a span of the token ids.

public ReadOnlySpan<int> AsReadOnlySpan()

Returns

ReadOnlySpan<int>

Remarks

The returned span is only valid for the lifetime of this TokenizeResult object.

CopyTo(Span<int>)

Copies the token ids into span.

public long CopyTo(Span<int> span)

Parameters

span Span<int>

Returns

long

The number of copied elements.

ReleaseUnmanagedResources()

protected override void ReleaseUnmanagedResources()