HttpArena
Frameworks

trillium-tuned

Emerging · Rust · engine: trillium-http · tuned configuration · completeness 4/4

Trillium 1.x with one current_thread tokio runtime per CPU, SO_REUSEPORT TCP sharding (single QUIC endpoint for h3), tuned HttpConfig (larger response/body buffers, 64K h2 frames, eager body preallocation), a 4 KiB websocket read buffer, and static files preloaded into memory at startup. sonic-rs for JSON, deadpool-postgres, mimalloc, trillium-grpc for the benchmark.BenchmarkService gRPC endpoints.

Achievements

🥇 3 Gold · 🥈 3 Silver · 🥉 3 Bronze. Top three of a field, taken in this entry's own league: the family composite, the same composite among entries written in the same language, and each test profile it is scored on. Every field is the one the badges publish, so a medal and a badge always say the same thing. How medals are awarded.

MedalAwardFieldRank
🥇 GoldWithin its languageRust · HTTP/31 of 3
🥇 GoldWithin its languageRust · WebSocket1 of 8
🥇 GoldTest profileEfficiency · Latency-10K1 of 109
🥈 SilverFamily compositeComposite · WebSocket2 of 39
🥈 SilverWithin its languageRust · Gateway2 of 3
🥈 SilverTest profileWebSocket · Echo Pipelined2 of 35
🥉 BronzeWithin its languageRust · HTTP/23 of 8
🥉 BronzeWithin its languageRust · gRPC3 of 5
🥉 BronzeTest profileWebSocket · Echo3 of 39

Composite rank

Each profile of a family is worth 1,000 to the entry that leads it, and the composite is the sum over the family, less 2.5% for each of routing, middleware, request and response the entry does not do for you - its completeness factor, which the WebSocket and gRPC families do not carry. The field is this entry's own league: engines and reverse proxies are scored apart from frameworks. How it works.

FamilyRankComposite
HTTP/1.114 of 1095820
HTTP/29 of 411899
HTTP/36 of 20898
Gateway7 of 9739
gRPC6 of 141050
WebSocket2 of 392861

Every result

Alpha Round, 43 runs. Requests per second is the best of three; latency, CPU and memory come from that run.

CategoryProfileConnsReq/secAvgp99CPUMemory
ConnectionBaseline4,0962,447,0411.67ms2.29ms6710.7%433MiB
ConnectionPipelined4,0963,696,01017.57ms186.20ms6321.8%371MiB
ConnectionShort-lived4,0961,924,4102.11ms6.57ms6484.8%524MiB
ConcurrencyAsync Delay32,0001,973,38016.09ms19.20ms6429.4%1.4GiB
EfficiencyLatency-10K1,0249,98373.8us118.0us28.3%207MiB
EfficiencyLatency-1M1,024997,593120.4us205.0us2946.8%207MiB
EfficiencyLatency-500K/81,024358,7512738042.4us6318080.0us785.3%101MiB
WorkloadJSON Comp4,096118,27634.17ms79.20ms6227.6%1.0GiB
WorkloadJSON Comp16,38499,867159.93ms261.00ms6122.4%1.4GiB
WorkloadJSON TLS4,0961,321,8223.08ms80.22ms6542.0%523MiB
Workload8Gbit51249,11788.7us122.0us216.9%234MiB
WorkloadStatic TLS1,024784,3911.28ms34.93ms6461.7%752MiB
DatabaseAsync DB1,024245,0533.79ms6.33ms3555.1%280MiB
DatabaseFortunes1,024166,2115.64ms9.34ms4449.4%375MiB
HTTP/2Baseline2565,385,3855.21ms37.16ms6300.7%650MiB
HTTP/2Baseline1,0244,062,13223.85ms102.02ms6264.5%1.8GiB
HTTP/2Static256207,83740.59ms316.92ms6384.1%14.2GiB
HTTP/2Static1,024195,722159.65ms798.66ms6330.4%17.5GiB
HTTP/2Baseline (h2c)2565,559,2065.17ms51.12ms6152.6%593MiB
HTTP/2Baseline (h2c)1,0244,247,23923.06ms133.36ms6273.3%1.5GiB
HTTP/2Baseline (h2c)4,0963,762,724108.22ms509.20ms6349.7%5.5GiB
HTTP/2JSON (h2c)1,0242,006,95815.65ms118.07ms6369.4%1.2GiB
HTTP/2JSON (h2c)4,0961,843,70470.74ms431.08ms6242.4%3.3GiB
HTTP/3Baseline64465,63610.19ms191.95ms2522.1%372MiB
HTTP/3Static64233,2157.86ms46.67ms2443.6%697MiB
gRPCUnary2563,823,6157.10ms37.81ms6342.6%529MiB
gRPCUnary1,0243,064,69832.24ms132.95ms6349.6%1.6GiB
gRPCUnary TLS2563,728,1307.52ms54.53ms6148.5%626MiB
gRPCUnary TLS1,0242,823,40634.54ms171.63ms6093.8%1.8GiB
GatewayGateway (H2)51269,226221.10ms2.43s4033.5%3.4GiB
GatewayGateway (H2)1,02468,584412.99ms4.68s4337.0%5.3GiB
GatewayGateway (H3)6477,68826.17ms90.81ms3873.8%869MiB
GatewayGateway (H3)25658,631135.08ms818.57ms2846.2%1.7GiB
GatewayProduction Stack25617,552216.14ms940.63ms1141.5%1.3GiB
GatewayProduction Stack1,02446,114343.95ms2.35s3356.7%3.9GiB
WebSocketEcho5124,061,462125us252us6466.6%173MiB
WebSocketEcho4,0964,121,639993us1.39ms6446.0%294MiB
WebSocketEcho16,3843,604,3684.51ms5.88ms6106.2%780MiB
WebSocketEcho Pipelined51252,631,128154us308us6495.3%174MiB
WebSocketEcho Pipelined4,09653,286,4331.23ms1.77ms6636.3%306MiB
WebSocketEcho Pipelined16,38446,915,4655.53ms6.85ms6209.9%922MiB
WebSocketEcho Short-lived5122,009,768169us602us5396.4%200MiB
WebSocketEcho Short-lived4,0962,472,7981.26ms3.66ms6203.5%424MiB

Compared with

The Rust web frameworks around trillium-tuned on the HTTP/1.1 composite, and the one leading them. Entries of other leagues are left out: a composite does not carry from one league to another. The last column shows every profile side by side.

EntryCompositevs trillium-tuned
cpeak7187+23%head to head
tako6474+11%head to head
actix6322+9%head to head
mq-bridge4109-29%head to head
trillium4109-29%head to head

Compare trillium-tuned with any Rust entry · Compare trillium-tuned with any entry, in any language · Every Rust entry, ranked

Results updated · How the benchmark is run · The machine · Add or fix an entry