Namespace Uralstech.UAI.LiteRTLM
Classes
Structs
- BenchmarkInfo.Turn
Benchmarks for a prefill or decode turn.
Enums
- InputDataType
Represents the type of input data.
- LogSeverity
Represents the log severity / level.
- SamplerType
Represents the type of sampler.
- TokenUnionType
Represents the type of a TokenUnion.
Delegates
- StreamCallback
Callback for streaming responses.