Version history
proxy-chat-completions.nonstream.sustainable_rps
Sustainable one-worker offered request rate
Loading chart…
Performance / proxy
LiteLLM proxy chat-completions sustainable capacity
Explore the latest published metrics for each LiteLLM version.
Evidence status
Version coverage
Every LiteLLM version with published evidence in this data set, and whether this benchmark's canonical run succeeded, failed, or left no record. Only successful runs feed the charts below.
4 of 5 versions published · 1 missing
| Version | Status | Detail |
|---|---|---|
| 1.97.0 | published | 1 successful run |
| 1.98.0 | published | 1 successful run |
| 1.99.0 | published | 1 successful run |
| 1.100.0 | published | 1 successful run |
| 1.100.1 | missing | No canonical result was published for this version |
Results in selected range 4
LiteLLM versions 4
Metrics in selected range 1
Detailed measurements
Version history
Compare published metrics across releases. Charts use canonical Linux runs. Hover over a point for its measurement and configuration.
1.97.0 / 1.100.0
Median measurements in matching environments. Percentage change is relative to 1.97.0.
Sustainable one-worker offered request ratebase · linux · x86_64 · ea06ee10dc37a8145ae0e52432d0d06a2d0224f4b557af95e9d7bb8253e6c4b1
50.0 RPS / 150 RPS
+200.0%