aspnet-minimal
Flagship · C# · engine: kestrel · standard configuration · completeness 4/4
Minimal ASP.NET Core server using .NET 10 with Kestrel and minimal API routing.
Achievements
🥇 1 Gold · 🥉 1 Bronze. Top three of a field, taken in this entry's own league: the family composite, the same composite among entries written in the same language, and each test profile it is scored on. Every field is the one the badges publish, so a medal and a badge always say the same thing. How medals are awarded.
| Medal | Award | Field | Rank |
|---|---|---|---|
| 🥇 Gold | Test profile | Efficiency · Latency-10K | 1 of 85 |
| 🥉 Bronze | Within its language | C# · HTTP/2 | 3 of 5 |
Composite rank
Each profile of a family is worth 1,000 to the entry that leads it, and the composite is the sum over the family, less 2.5% for each of routing, middleware, request and response the entry does not do for you - its completeness factor, which the WebSocket and gRPC families do not carry. The field is this entry's own league: engines and reverse proxies are scored apart from frameworks. How it works.
| Family | Rank | Composite |
|---|---|---|
| HTTP/1.1 | 38 of 85 | 2872 |
| HTTP/2 | 17 of 31 | 757 |
| HTTP/3 | 12 of 16 | 316 |
| gRPC | 7 of 10 | 680 |
| WebSocket | 22 of 30 | 805 |
Protocol compliance
The conformance suites this entry subscribes to, run against it on the benchmark machine: Http11Probe on HTTP/1.1, h2spec on HTTP/2, h3spec on HTTP/3 and Autobahn on WebSocket. A score, not part of the composite. How it works.
| Suite | Tool | Passed | Failed |
|---|---|---|---|
| HTTP/1.1 | http11probe d50d818 | 133 of 159 (83.6%) | 26 |
| HTTP/2 | h2spec 2.6.0 | 146 of 146 (100%) | 0 |
| HTTP/3 | h3spec v0.1.15 | 43 of 85 (50.6%) | 42 |
| WebSocket (aspnet-websocket) | autobahn-testsuite 25.10.1 | 244 of 244 (100%) | 0 |
HTTP/1.1: what failed
| Test | Expected | Got |
|---|---|---|
RFC9112-5-INVALID-HEADER-NAME Header name with invalid characters (brackets) must be rejected (RFC 9112 §5, MUST) | 400 or close | 200, connection left open |
RFC9112-6.1-CL-PLUS-SIGN Content-Length with plus sign must be rejected (RFC 9112 §6.1, MUST) | 400 or close | 200, connection left open |
COMP-ASTERISK-WITH-GET Asterisk-form (*) request-target with GET must be rejected (RFC 9112 §3.2.4, MUST) | 400, close, or timeout = warn | 405, connection closed |
COMP-OPTIONS-STAR OPTIONS * is the only valid asterisk-form request (RFC 9112 §3.2.4, MUST) | 2xx or 405; close/timeout = warn | 404, connection left open |
COMP-METHOD-CONNECT CONNECT to an origin server must be rejected (RFC 9110 §9.3.6, SHOULD) | 400/405/501 or close | 404, connection left open |
COMP-HOST-EMPTY-VALUE Empty Host header value must be rejected (RFC 9112 §3.2, MUST) | 400 or close | 200, connection left open |
COMP-VERSION-CASE HTTP version is case-sensitive — lowercase 'http' must be rejected (RFC 9112 §2.3, MUST) | 400, close, or timeout = warn | 505, connection closed |
SMUG-CHUNK-BARE-SEMICOLON Chunk size with bare semicolon and no extension name must be rejected (RFC 9112 §7.1.1, MUST) | 400 or close | 200, connection left open |
SMUG-CHUNK-EXT-INVALID-TOKEN Chunk extension with invalid token character must be rejected (RFC 9112 §7.1.1, MUST) | 400 or close | 200, connection left open |
SMUG-CHUNK-EXT-CTRL NUL byte in chunk extension must be rejected (RFC 9112 §7.1.1, MUST) | 400 or close | 200, connection left open |
SMUG-CHUNK-LF-TRAILER Bare LF in chunked trailer termination — server MAY accept bare LF per RFC 9112 §2.2 (RFC 9112 §7.1, MAY) | 400 or 2xx | no response, timed out |
SMUG-CL-NEGATIVE-ZERO Content-Length: -0 must be rejected — not valid 1*DIGIT (RFC 9110 §8.6, MUST) | 400 or close | 200, connection left open |
SMUG-CLTE-CONN-CLOSE CL+TE conflict — server MUST close connection after responding (RFC 9112 §6.1, MUST) | 400, or 2xx + close | 200, connection left open (Accepted with 200 but kept connection open — follow-up GET returned 200) |
SMUG-TECL-CONN-CLOSE TE+CL conflict (reversed order) — server MUST close connection after responding (RFC 9112 §6.1, MUST) | 400, or 2xx + close | 200, connection left open (Accepted with 200 but kept connection open — follow-up GET returned 200) |
SMUG-CLTE-DESYNC CL.TE desync — leftover bytes after the body boundary may be interpreted as the next request (RFC 9112 §6.1, MUST) | 400, or close | 405, connection left open (Accepted with 200, kept connection open — follow-up GET returned 405) |
SMUG-CLTE-SMUGGLED-GET CL.TE desync — embedded GET in body; multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded GET likely executed)) |
SMUG-CLTE-SMUGGLED-GET-CL-PLUS CL.TE desync with malformed Content-Length (+N) — multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded GET likely executed)) |
SMUG-CLTE-SMUGGLED-HEAD CL.TE desync — embedded HEAD in body; multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded HEAD likely executed)) |
SMUG-CLTE-SMUGGLED-GET-TE-TRAILING-SPACE CL.TE desync with TE trailing space — multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded GET likely executed)) |
SMUG-CLTE-SMUGGLED-GET-TE-LEADING-COMMA CL.TE desync with TE leading comma — multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded GET likely executed)) |
SMUG-CLTE-SMUGGLED-GET-TE-CASE-MISMATCH CL.TE desync with TE case mismatch — multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (MULTIPLE RESPONSES: observed 2 HTTP status lines (embedded GET likely executed)) |
SMUG-TECL-SMUGGLED-GET TE.CL desync via chunk-size prefix trick — multiple responses indicate request boundary confusion (RFC 9112 §6.1, MUST) | 400, or close (no extra response) | 200, connection left open (Accepted with 200 but kept connection open — MUST-close violated (no extra response observed)) |
SMUG-TECL-DESYNC TE.CL desync — chunked terminator before CL boundary, leftover bytes smuggled (RFC 9112 §6.1, MUST) | 400, or close | 405, connection left open (Accepted with 200, kept connection open — follow-up GET returned 405) |
MAL-CONTROL-CHARS-HEADER Control characters in header value should be rejected (MUST) | 400 or close | 200, connection left open |
MAL-LONG-METHOD 100KB method name should be rejected (SHOULD) | 400, 501 or close | 414, connection closed |
MAL-CHUNK-SIZE-OVERFLOW Chunk size with integer overflow must be rejected (MUST) | 400 or close | 500, connection closed |
HTTP/3: what failed
| Test | Expected | Got |
|---|---|---|
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if original_destination_connection_id is received [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if preferred_address is received [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if retry_source_connection_id is received [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if stateless_reset_token is received [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if a parameter value is malformed [Transport 18] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if max_udp_payload_size < 1200 [Transport 7.4 and 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if ack_delay_exponent > 20 [Transport 7.4 and 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if max_ack_delay >= 2^14 [Transport 7.4 and 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if initial_max_streams_bidi > 2^60 [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers MUST send TRANSPORT_PARAMETER_ERROR if initial_max_streams_uni > 2^60 [Transport 18.2] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived TLSHandshakeFailure "" |
| QUIC servers SHOULD send PROTOCOL_VIOLATION on an ACK for a packet never sent [Transport 13.1] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived FrameEncodingError "" |
| QUIC servers MUST send PROTOCOL_VIOLATION on no frames [Transport 12.4] | - | predicate failed on expected exception: QUICException / TransportErrorIsSent InternalError "Too many path or CID frames" |
| QUIC servers MUST send PROTOCOL_VIOLATION if PATH_CHALLENGE in Handshake is received [Transport 12.4] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived FrameEncodingError "" |
| QUIC servers MUST send PROTOCOL_VIOLATION if RETIRE_CONNECTION_ID for a sequence number never issued [Transport 19.16] | - | did not get expected exception: QUICException |
| QUIC servers MUST send PROTOCOL_VIOLATION if STREAM_DATA_BLOCKED in Handshake is received [Transport 12.4] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived FrameEncodingError "" |
| QUIC servers MUST send PROTOCOL_VIOLATION if DATA_BLOCKED in Handshake is received [Transport 12.4] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived FrameEncodingError "" |
| QUIC servers MUST send PROTOCOL_VIOLATION if NEW_TOKEN is received [Transport 19.7] | - | did not get expected exception: QUICException |
| QUIC servers MUST send FRAME_ENCODING_ERROR if invalid MAX_STREAMS is received [Transport 19.11] | - | predicate failed on expected exception: QUICException / TransportErrorIsReceived StreamLimitError "" |
| QUIC servers MUST send STREAM_LIMIT_ERROR or FRAME_ENCODING_ERROR if invalid STREAMS_BLOCKED is received [Transport 19.14] | - | did not get expected exception: QUICException |
| QUIC servers MUST send unexpected_message TLS alert if KeyUpdate in Handshake is received [TLS 6] | - | did not get expected exception: QUICException |
| QUIC servers MUST send unexpected_message TLS alert if KeyUpdate in 1-RTT is received [TLS 6] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_MESSAGE_ERROR if mandatory pseudo-header fields are absent [HTTP/3 4.3.1] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST treat a request with keep-alive as malformed [HTTP/3 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST treat a request with proxy-connection as malformed [HTTP/3 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST treat a request with transfer-encoding as malformed [HTTP/3 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST treat a request with upgrade as malformed [HTTP/3 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_FRAME_ERROR if a SETTINGS frame stops mid-parameter [HTTP/3 7.1] | - | did not get expected exception: QUICException |
| HTTP/3 servers treats a repeated setting identifier as an error whatever its value [HTTP/3 7.2.4] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_ID_ERROR if CANCEL_PUSH names a push ID not allowed [HTTP/3 7.2.3] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_ID_ERROR if MAX_PUSH_ID goes down [HTTP/3 7.2.7] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_ID_ERROR if GOAWAY goes up [HTTP/3 5.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST ignore a frame of unknown type, however long [HTTP/3 7.2.8] | - | uncaught exception: QUICException / ApplicationProtocolErrorIsReceived (ApplicationProtocolError 262) "" |
| HTTP/3 servers MUST send QPACK_DECOMPRESSION_FAILED if an invalid static table index exists in a field line representation [QPACK 3.1] | - | predicate failed on expected exception: QUICException / ApplicationProtocolErrorIsSent (ApplicationProtocolError 270) "" |
| HTTP/3 servers MUST send QPACK_DECOMPRESSION_FAILED if a field line references a dynamic table entry that is not there [QPACK 2.2.3] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send QPACK_DECOMPRESSION_FAILED if a field line is cut short [QPACK 2.2.3] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send QPACK_DECOMPRESSION_FAILED if a Huffman string is badly padded [QPACK 4.1.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST NOT buffer an over-long frame on a control stream [HTTP/3 7.1] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send QPACK_ENCODER_STREAM_ERROR if a new dynamic table capacity value exceeds the limit [QPACK 4.3.1] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_STREAM_CREATION_ERROR if a client opens a push stream [HTTP/3 6.2.2] | - | did not get expected exception |
| HTTP/3 servers MUST send H3_CLOSED_CRITICAL_STREAM if a decoder stream is closed [QPACK 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send H3_CLOSED_CRITICAL_STREAM if an encoder stream ends inside an instruction [QPACK 4.2] | - | did not get expected exception: QUICException |
| HTTP/3 servers MUST send QPACK_DECODER_STREAM_ERROR if Insert Count Increment is 0 [QPACK 4.4.3] | - | did not get expected exception: QUICException |
Every result
Alpha Round, 35 runs. Requests per second is the best of three; latency, CPU and memory come from that run.
| Category | Profile | Conns | Req/sec | Avg | p99 | CPU | Memory |
|---|---|---|---|---|---|---|---|
| Connection | Baseline | 4,096 | 1,305,946 | 2.67ms | 8.19ms | 5599.7% | 408MiB |
| Connection | Pipelined | 4,096 | 6,821,003 | 7.85ms | 20.30ms | 5559.6% | 341MiB |
| Connection | Short-lived | 4,096 | 456,366 | 1.52ms | 12.40ms | 3439.3% | 141MiB |
| Concurrency | Async Delay | 32,000 | 871,904 | 27.15ms | 56.90ms | 4652.9% | 1.7GiB |
| Efficiency | Latency-10K | 1,024 | 9,983 | 103.0us | 129.0us | 145.9% | 164MiB |
| Efficiency | Latency-1M | 1,024 | 997,932 | 480.9us | 4474.0us | 4974.2% | 197MiB |
| Efficiency | Latency-500K/8 | 1,024 | 299,094 | 3956788.2us | 7874560.0us | 742.2% | 158MiB |
| Workload | JSON Comp | 4,096 | 337,518 | 10.01ms | 34.40ms | 5871.1% | 554MiB |
| Workload | JSON Comp | 16,384 | 325,717 | 14.57ms | 38.20ms | 5714.2% | 644MiB |
| Workload | JSON TLS | 4,096 | 501,185 | 7.96ms | 96.85ms | 6002.4% | 782MiB |
| Workload | 8Gbit | 512 | 49,306 | 190.1us | 1736.0us | 899.7% | 219MiB |
| Workload | Static TLS | 1,024 | 93,261 | 11.06ms | 49.84ms | 6027.9% | 498MiB |
| Database | Async DB | 1,024 | 165,654 | 5.64ms | 19.20ms | 3637.1% | 415MiB |
| Database | Fortunes | 1,024 | 77,921 | 10.77ms | 33.20ms | 5329.1% | 491MiB |
| HTTP/2 | Baseline | 256 | 2,220,505 | 11.22ms | 82.75ms | 6117.8% | 920MiB |
| HTTP/2 | Baseline | 1,024 | 1,956,244 | 55.16ms | 253.50ms | 5401.9% | 3.1GiB |
| HTTP/2 | Static | 256 | 73,392 | 109.48ms | 896.12ms | 6001.4% | 3.2GiB |
| HTTP/2 | Static | 1,024 | 54,245 | 529.37ms | 4.34s | 5802.7% | 9.2GiB |
| HTTP/2 | Baseline (h2c) | 256 | 2,732,413 | 9.37ms | 54.79ms | 6281.1% | 1.4GiB |
| HTTP/2 | Baseline (h2c) | 1,024 | 2,535,974 | 40.89ms | 246.27ms | 5993.1% | 3.1GiB |
| HTTP/2 | Baseline (h2c) | 4,096 | 1,769,573 | 204.59ms | 798.67ms | 5581.1% | 8.4GiB |
| HTTP/2 | JSON (h2c) | 1,024 | 713,236 | 45.91ms | 209.59ms | 6100.1% | 1.9GiB |
| HTTP/2 | JSON (h2c) | 4,096 | 581,550 | 183.36ms | 1.12s | 5761.9% | 4.9GiB |
| HTTP/3 | Baseline | 64 | 649,852 | 6.16ms | 23.91ms | 6061.6% | 1.2GiB |
| HTTP/3 | Static | 64 | 54,100 | 75.11ms | 329.85ms | 4761.2% | 2.8GiB |
| gRPC | Unary | 256 | 2,491,232 | 10.56ms | 10.56ms | 5624.0% | 1007.0MiB |
| gRPC | Unary | 1,024 | 2,338,525 | 41.35ms | 41.35ms | 6207.7% | 2.5GiB |
| gRPC | Unary TLS | 256 | 2,058,161 | 12.19ms | 12.19ms | 6079.8% | 818.2MiB |
| gRPC | Unary TLS | 1,024 | 1,826,316 | 56.98ms | 56.98ms | 5281.5% | 2.8GiB |
| WebSocket | Echo | 512 | 1,835,273 | 278us | 696us | 6128.2% | 220.4MiB |
| WebSocket | Echo | 4,096 | 1,806,996 | 1.72ms | 5.25ms | 6120.1% | 389.2MiB |
| WebSocket | Echo | 16,384 | 1,686,022 | 3.63ms | 10.10ms | 6033.9% | 456.1MiB |
| WebSocket | Echo Pipelined | 512 | 19,748,819 | 414us | 2.08ms | 5700.1% | 225MiB |
| WebSocket | Echo Pipelined | 4,096 | 19,744,758 | 1.92ms | 7.12ms | 5656.8% | 380MiB |
| WebSocket | Echo Pipelined | 16,384 | 19,407,960 | 2.94ms | 9.60ms | 5864.6% | 380MiB |
Compared with
The C# web frameworks around aspnet-minimal on the HTTP/1.1 composite, and the one leading them. Entries of other leagues are left out: a composite does not carry from one league to another. The last column shows every profile side by side.
| Entry | Composite | vs aspnet-minimal | |
|---|---|---|---|
| genhttp-ioxide | 7075 | +146% | head to head |
| genhttp-kestrel | 3025 | +5% | head to head |
| aspnet-minimal-11 | 2916 | +2% | head to head |
| fastendpoints | 2779 | -3% | head to head |
| codebehind | 2690 | -6% | head to head |
Compare aspnet-minimal with any C# entry · Compare aspnet-minimal with any entry, in any language · Every C# entry, ranked
Results updated · How the benchmark is run · The machine · Add or fix an entry