Version history
proxy-chat-completions-streaming.stream.sustainable_rps
Sustainable one-worker offered streaming request rate
Loading chart…
Performance / proxy
LiteLLM proxy streaming chat-completions sustainable capacity
Explore the latest published metrics for each LiteLLM version.
Evidence status
Version coverage
Every LiteLLM version with published evidence in this data set, and whether this benchmark's canonical run succeeded, failed, or left no record. Only successful runs feed the charts below.
6 of 7 versions published · 1 missing
| Version | Status | Detail |
|---|---|---|
| 1.97.0 | missing | No canonical result was published for this version |
| 1.98.0 | published | 1 successful run |
| 1.99.0 | published | 1 successful run |
| 1.100.0 | published | 1 successful run |
| 1.100.1 | published | 1 successful run |
| 1.101.0 | published | 1 successful run |
| 1.102.0rc2 | published | 1 successful run |
Results in selected range 6
LiteLLM versions 6
Metrics in selected range 1
Detailed measurements
Version history
Compare published metrics across releases. Charts use canonical Linux runs. Hover over a point for its measurement and configuration.
1.98.0 / 1.102.0rc2
Median measurements in matching environments. Percentage change is relative to 1.98.0.
Sustainable one-worker offered streaming request ratebase · linux · x86_64 · 72f62204d377c0435bf26fb935d73d3816ac477e20c0ebf40891f3ae81ae17c9
10.0 RPS / 30.0 RPS
+200.0%