trillium-tuned
Emerging · Rust · engine: trillium-http · tuned configuration · completeness 4/4
Trillium 1.x with one current_thread tokio runtime per CPU, SO_REUSEPORT TCP sharding (single QUIC endpoint for h3), tuned HttpConfig (larger response/body buffers, 64K h2 frames, eager body preallocation), a 4 KiB websocket read buffer, and static files preloaded into memory at startup. sonic-rs for JSON, deadpool-postgres, mimalloc, trillium-grpc for the benchmark.BenchmarkService gRPC endpoints.
Achievements
🥇 3 Gold · 🥈 3 Silver · 🥉 3 Bronze. Top three of a field, taken in this entry's own league: the family composite, the same composite among entries written in the same language, and each test profile it is scored on. Every field is the one the badges publish, so a medal and a badge always say the same thing. How medals are awarded.
| Medal | Award | Field | Rank |
|---|---|---|---|
| 🥇 Gold | Within its language | Rust · HTTP/3 | 1 of 3 |
| 🥇 Gold | Within its language | Rust · WebSocket | 1 of 8 |
| 🥇 Gold | Test profile | Efficiency · Latency-10K | 1 of 109 |
| 🥈 Silver | Family composite | Composite · WebSocket | 2 of 39 |
| 🥈 Silver | Within its language | Rust · Gateway | 2 of 3 |
| 🥈 Silver | Test profile | WebSocket · Echo Pipelined | 2 of 35 |
| 🥉 Bronze | Within its language | Rust · HTTP/2 | 3 of 8 |
| 🥉 Bronze | Within its language | Rust · gRPC | 3 of 5 |
| 🥉 Bronze | Test profile | WebSocket · Echo | 3 of 39 |
Composite rank
Each profile of a family is worth 1,000 to the entry that leads it, and the composite is the sum over the family, less 2.5% for each of routing, middleware, request and response the entry does not do for you - its completeness factor, which the WebSocket and gRPC families do not carry. The field is this entry's own league: engines and reverse proxies are scored apart from frameworks. How it works.
| Family | Rank | Composite |
|---|---|---|
| HTTP/1.1 | 14 of 109 | 5820 |
| HTTP/2 | 9 of 41 | 1899 |
| HTTP/3 | 6 of 20 | 898 |
| Gateway | 7 of 9 | 739 |
| gRPC | 6 of 14 | 1050 |
| WebSocket | 2 of 39 | 2861 |
Every result
Alpha Round, 43 runs. Requests per second is the best of three; latency, CPU and memory come from that run.
| Category | Profile | Conns | Req/sec | Avg | p99 | CPU | Memory |
|---|---|---|---|---|---|---|---|
| Connection | Baseline | 4,096 | 2,447,041 | 1.67ms | 2.29ms | 6710.7% | 433MiB |
| Connection | Pipelined | 4,096 | 3,696,010 | 17.57ms | 186.20ms | 6321.8% | 371MiB |
| Connection | Short-lived | 4,096 | 1,924,410 | 2.11ms | 6.57ms | 6484.8% | 524MiB |
| Concurrency | Async Delay | 32,000 | 1,973,380 | 16.09ms | 19.20ms | 6429.4% | 1.4GiB |
| Efficiency | Latency-10K | 1,024 | 9,983 | 73.8us | 118.0us | 28.3% | 207MiB |
| Efficiency | Latency-1M | 1,024 | 997,593 | 120.4us | 205.0us | 2946.8% | 207MiB |
| Efficiency | Latency-500K/8 | 1,024 | 358,751 | 2738042.4us | 6318080.0us | 785.3% | 101MiB |
| Workload | JSON Comp | 4,096 | 118,276 | 34.17ms | 79.20ms | 6227.6% | 1.0GiB |
| Workload | JSON Comp | 16,384 | 99,867 | 159.93ms | 261.00ms | 6122.4% | 1.4GiB |
| Workload | JSON TLS | 4,096 | 1,321,822 | 3.08ms | 80.22ms | 6542.0% | 523MiB |
| Workload | 8Gbit | 512 | 49,117 | 88.7us | 122.0us | 216.9% | 234MiB |
| Workload | Static TLS | 1,024 | 784,391 | 1.28ms | 34.93ms | 6461.7% | 752MiB |
| Database | Async DB | 1,024 | 245,053 | 3.79ms | 6.33ms | 3555.1% | 280MiB |
| Database | Fortunes | 1,024 | 166,211 | 5.64ms | 9.34ms | 4449.4% | 375MiB |
| HTTP/2 | Baseline | 256 | 5,385,385 | 5.21ms | 37.16ms | 6300.7% | 650MiB |
| HTTP/2 | Baseline | 1,024 | 4,062,132 | 23.85ms | 102.02ms | 6264.5% | 1.8GiB |
| HTTP/2 | Static | 256 | 207,837 | 40.59ms | 316.92ms | 6384.1% | 14.2GiB |
| HTTP/2 | Static | 1,024 | 195,722 | 159.65ms | 798.66ms | 6330.4% | 17.5GiB |
| HTTP/2 | Baseline (h2c) | 256 | 5,559,206 | 5.17ms | 51.12ms | 6152.6% | 593MiB |
| HTTP/2 | Baseline (h2c) | 1,024 | 4,247,239 | 23.06ms | 133.36ms | 6273.3% | 1.5GiB |
| HTTP/2 | Baseline (h2c) | 4,096 | 3,762,724 | 108.22ms | 509.20ms | 6349.7% | 5.5GiB |
| HTTP/2 | JSON (h2c) | 1,024 | 2,006,958 | 15.65ms | 118.07ms | 6369.4% | 1.2GiB |
| HTTP/2 | JSON (h2c) | 4,096 | 1,843,704 | 70.74ms | 431.08ms | 6242.4% | 3.3GiB |
| HTTP/3 | Baseline | 64 | 465,636 | 10.19ms | 191.95ms | 2522.1% | 372MiB |
| HTTP/3 | Static | 64 | 233,215 | 7.86ms | 46.67ms | 2443.6% | 697MiB |
| gRPC | Unary | 256 | 3,823,615 | 7.10ms | 37.81ms | 6342.6% | 529MiB |
| gRPC | Unary | 1,024 | 3,064,698 | 32.24ms | 132.95ms | 6349.6% | 1.6GiB |
| gRPC | Unary TLS | 256 | 3,728,130 | 7.52ms | 54.53ms | 6148.5% | 626MiB |
| gRPC | Unary TLS | 1,024 | 2,823,406 | 34.54ms | 171.63ms | 6093.8% | 1.8GiB |
| Gateway | Gateway (H2) | 512 | 69,226 | 221.10ms | 2.43s | 4033.5% | 3.4GiB |
| Gateway | Gateway (H2) | 1,024 | 68,584 | 412.99ms | 4.68s | 4337.0% | 5.3GiB |
| Gateway | Gateway (H3) | 64 | 77,688 | 26.17ms | 90.81ms | 3873.8% | 869MiB |
| Gateway | Gateway (H3) | 256 | 58,631 | 135.08ms | 818.57ms | 2846.2% | 1.7GiB |
| Gateway | Production Stack | 256 | 17,552 | 216.14ms | 940.63ms | 1141.5% | 1.3GiB |
| Gateway | Production Stack | 1,024 | 46,114 | 343.95ms | 2.35s | 3356.7% | 3.9GiB |
| WebSocket | Echo | 512 | 4,061,462 | 125us | 252us | 6466.6% | 173MiB |
| WebSocket | Echo | 4,096 | 4,121,639 | 993us | 1.39ms | 6446.0% | 294MiB |
| WebSocket | Echo | 16,384 | 3,604,368 | 4.51ms | 5.88ms | 6106.2% | 780MiB |
| WebSocket | Echo Pipelined | 512 | 52,631,128 | 154us | 308us | 6495.3% | 174MiB |
| WebSocket | Echo Pipelined | 4,096 | 53,286,433 | 1.23ms | 1.77ms | 6636.3% | 306MiB |
| WebSocket | Echo Pipelined | 16,384 | 46,915,465 | 5.53ms | 6.85ms | 6209.9% | 922MiB |
| WebSocket | Echo Short-lived | 512 | 2,009,768 | 169us | 602us | 5396.4% | 200MiB |
| WebSocket | Echo Short-lived | 4,096 | 2,472,798 | 1.26ms | 3.66ms | 6203.5% | 424MiB |
Compared with
The Rust web frameworks around trillium-tuned on the HTTP/1.1 composite, and the one leading them. Entries of other leagues are left out: a composite does not carry from one league to another. The last column shows every profile side by side.
| Entry | Composite | vs trillium-tuned | |
|---|---|---|---|
| cpeak | 7187 | +23% | head to head |
| tako | 6474 | +11% | head to head |
| actix | 6322 | +9% | head to head |
| mq-bridge | 4109 | -29% | head to head |
| trillium | 4109 | -29% | head to head |
Compare trillium-tuned with any Rust entry · Compare trillium-tuned with any entry, in any language · Every Rust entry, ranked
Results updated · How the benchmark is run · The machine · Add or fix an entry