Struct BenchmarkInfo.Turn

Namespace

Uralstech.UAI.LiteRTLM

Benchmarks for a prefill or decode turn.

public readonly struct BenchmarkInfo.Turn

Properties

TokenCount

The prefill/decode token count for this turn.

public int TokenCount { get; init; }

Property Value

int

TokensPerSecond

The prefill/decode tokens per second for this turn.

public double TokensPerSecond { get; init; }

Property Value

double