Repository navigation

feature/metrics - #443

Closed

klement wants to merge 9 commits into

theroyallab:mainfrom

klement:feature/metrics

Closed

feature/metrics#443
klement wants to merge 9 commits into
theroyallab:mainfrom
klement:feature/metrics

Commits on Jul 31, 2026
- API: Add opt-in Prometheus-compatible /metrics endpoint
  
  Klement Sekera
  and
  claude
  committed
  9d61e78
- API: Add KV cache metrics to /metrics endpoint
  
  Klement Sekera
  and
  claude
  committed
  25e0314
- API: Add prefix-cache counters, latency histograms and spec decode stats to /metrics
  
  Klement Sekera
  and
  claude
  committed
  db7054e
- API: Stop publishing prompt_tokens_seconds in /metrics
  
  Klement Sekera
  and
  claude
  committed
  e17db62
- API: Add tokens_predicted_max to /metrics
  
  Klement Sekera
  and
  claude
  committed
  8c75400
Commits on Aug 1, 2026
- API: Add KV offload cache gauges to /metrics
  
  Klement Sekera
  and
  claude
  committed
  8b05929
- API: Add recurrent checkpoint metrics to /metrics
  
  Klement Sekera
  and
  claude
  committed
  e972669
- API: Build token histogram buckets from the model's context length
  
  Klement Sekera
  and
  claude
  committed
  ef44f6f
- API: Publish process_start_time_seconds in /metrics
  
  Klement Sekera
  and
  claude
  committed
  5b73894