Version history
proxy-chat-completions.nonstream.sustainable_rps
Sustainable one-worker offered request rate
Loading chart…
Performance / proxy
LiteLLM proxy chat-completions sustainable capacity
Explore the latest published metrics for each LiteLLM version.
Evidence status
Version coverage
Every LiteLLM version with published evidence in this data set, and whether this benchmark's canonical run succeeded, failed, or left no record. Only successful runs feed the charts below.
5 of 7 versions published · 2 failed
| Version | Status | Detail |
|---|---|---|
| 1.97.0 | published | 1 successful run |
| 1.98.0 | published | 1 successful run |
| 1.99.0 | failed | base: invalid_observation — the sweep did not find a sustainable offered rate |
| 1.100.0 | published | 1 successful run |
| 1.100.1 | published | 1 successful run |
| 1.101.0 | published | 1 successful run |
| 1.102.0rc2 | failed | base: invalid_observation — the sweep did not find a sustainable offered rate |
Results in selected range 5
LiteLLM versions 5
Metrics in selected range 1
Detailed measurements
Version history
Compare published metrics across releases. Charts use canonical Linux runs. Hover over a point for its measurement and configuration.
1.97.0 / 1.101.0
Median measurements in matching environments. Percentage change is relative to 1.97.0.
No matching measurements at both selected versions.