Class NativeAPI.EmbeddingEngine

Namespace

Uralstech.UAI.LiteRTLM.Native

public static class NativeAPI.EmbeddingEngine

Inheritance

object

NativeAPI.EmbeddingEngine

Methods

litert_lm_embedding_engine_compute_embedding(nint, nint[], nuint, nint)

Computes embedding response for a single request.

public static extern nint litert_lm_embedding_engine_compute_embedding(nint engine, nint[] inputs, nuint numInputs, nint options)

Parameters

engine nint

The embedding engine.

inputs nint[]

Array of LiteRtLmInputData pointers representing multimodal input.

numInputs nuint

Number of inputs in the array.

options nint

Optional embedding options. If nint.Zero, default options are used.

Returns

nint

A pointer to the embedding response, or nint.Zero on failure. The caller is responsible for deleting the response using litert_lm_embedding_response_delete(nint).

litert_lm_embedding_engine_compute_embedding_batch(nint, nint[], nuint[], nuint, nint)

Computes embedding responses for a batch of requests.

public static extern nint litert_lm_embedding_engine_compute_embedding_batch(nint engine, nint[] inputsBatch, nuint[] numInputsPerBatch, nuint batchSize, nint options)

Parameters

engine nint

The embedding engine.

inputsBatch nint[]

An array of arrays of LiteRtLmInputData pointers.

numInputsPerBatch nuint[]

An array specifying the number of inputs for each request in the batch.

batchSize nuint

The number of requests in the batch.

options nint

Optional embedding options. If nint.Zero, default options are used.

Returns

nint

A pointer to the batch responses, or nint.Zero on failure. The caller is responsible for deleting responses using litert_lm_embedding_responses_delete(nint).

litert_lm_embedding_engine_create(nint)

Creates a LiteRT LM Embedding Engine from the given settings. The caller is responsible for destroying the engine using litert_lm_embedding_engine_delete(nint).

public static extern nint litert_lm_embedding_engine_create(nint settings)

Parameters

settings nint

The embedding engine settings.

Returns

nint

A pointer to the created engine, or nint.Zero on failure.

litert_lm_embedding_engine_delete(nint)

Destroys a LiteRT LM Embedding Engine.

public static extern void litert_lm_embedding_engine_delete(nint engine)

Parameters

engine nint

The engine to destroy.