Struct BenchmarkInfo.Turn

Namespace

Uralstech.UAI.LiteRTLM

Benchmarks for a prefill or decode turn.

public readonly struct BenchmarkInfo.Turn

Constructors

Turn(int, double)

public Turn(int tokenCount, double tokensPerSecond)

Parameters

tokenCount int

tokensPerSecond double

Fields

TokenCount

The prefill/decode token count for this turn.

public readonly int TokenCount

Field Value

int

TokensPerSecond

The prefill/decode tokens per second for this turn.

public readonly double TokensPerSecond

Field Value

double