Skip to content

[WTX] Update gRPC - #1056

Open
c410-f3r wants to merge 2 commits into
MDA2AV:mainfrom
c410-f3r:grpc
Open

[WTX] Update gRPC#1056
c410-f3r wants to merge 2 commits into
MDA2AV:mainfrom
c410-f3r:grpc

Conversation

@c410-f3r

Copy link
Copy Markdown
Contributor

Description

Reopens #980.

Looks like all validation tests for gRPC are not working

@c410-f3r

c410-f3r commented Jul 26, 2026

Copy link
Copy Markdown
Contributor Author

/benchmark -f wtx-grpc-tls --save

@github-actions

Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@c410-f3r

Copy link
Copy Markdown
Contributor Author

Erhhh... Wrong directory name...

/benchmark -f wtx-grpc --save

@github-actions

Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: wtx-grpc | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
unary-grpc 256 2,478,340 6469.9% 523MiB +4.1% +10.6%
unary-grpc 1024 2,400,296 6438.2% 896MiB +3.9% +13.0%
Full log

5Main benchmark duration is over for thread #. Stopping all clients.
32. Stopping all clients.

finished in 5.07s, 2391140.00 req/s, 102.62MB/s
requests: 11955700 total, 11981300 started, 11955700 done, 11955700 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 11955738 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 513.10MB (538024564) total, 307.85MB (322804470) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:      487us    163.10ms     12.38ms      8.99ms    88.10%
time for connect:       37us      2.36ms       625us       556us    78.13%
time to 1st byte:     8.75ms    162.25ms     60.33ms     36.62ms    58.98%
req/s           :    4079.05    38902.32     9339.88     6001.66    90.23%
[info] CPU 5988.6% | Mem 505MiB

[run 2/3]
starting benchmark...
17.
48.
.
61.
.
38. Stopping all clients.
. Stopping all clients.Stopped all clients for thread #6

45. Stopping all clients.
35. Stopping all clients.


finished in 5.03s, 2493202.80 req/s, 107.00MB/s
requests: 12466014 total, 12491614 started, 12466014 done, 12466014 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 12466055 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 535.00MB (560988766) total, 320.99MB (336582993) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:      449us    259.06ms     11.14ms      5.66ms    64.94%
time for connect:       32us      1.33ms       405us       288us    66.41%
time to 1st byte:     1.47ms     36.13ms      8.67ms      6.57ms    70.70%
req/s           :    4699.33    39746.97     9738.58     6548.00    89.06%
[info] CPU 6469.9% | Mem 523MiB

[run 3/3]
starting benchmark...
5.
7.
.
Application protocol: h2c
10.

.Main benchmark duration is started for thread #57.

35.

.
11
60Main benchmark duration is over for thread #. Stopping all clients.1
. Stopping all clients.Stopped all clients for thread #60

. Stopping all clients.

finished in 5.04s, 2375703.40 req/s, 101.96MB/s
requests: 11878517 total, 11904117 started, 11878517 done, 11878517 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 11878554 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 509.79MB (534551305) total, 305.86MB (320720514) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:      430us    111.19ms     11.45ms      5.14ms    70.05%
time for connect:       28us      3.36ms       529us       511us    89.45%
time to 1st byte:     1.52ms     27.41ms      9.00ms      5.98ms    66.80%
req/s           :    4282.70    39755.58     9279.51     5921.16    93.75%
[info] CPU 6041.0% | Mem 539MiB

=== Best: 2478340 req/s (CPU: 6469.9%, Mem: 523MiB) ===
[info] saved results/unary-grpc/256/wtx-grpc.json
httparena-bench-wtx-grpc
httparena-bench-wtx-grpc

==============================================
=== wtx-grpc / unary-grpc / 1024c (tool=h2load) ===
==============================================
[info] waiting for server...
[info] gRPC server ready

[run 1/3]
starting benchmark...
progress: 62Warm-up phase is over for thread #49Warm-up phase is over for thread #% of clients started.

59.
56

59Main benchmark duration is started for thread #56.
.
55.
progress: .
75% of clients started

.


.Main benchmark duration is started for thread #
5Main benchmark duration is started for thread #21.
.
.
50.
Application protocol: h2c
41.

58. Stopping all clients.
32
24
31

finished in 5.10s, 2280363.80 req/s, 97.88MB/s
requests: 11401819 total, 11504219 started, 11401819 done, 11401819 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 11401862 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 489.38MB (513151495) total, 293.59MB (307849758) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:      735us    410.86ms     51.17ms     41.25ms    93.82%
time for connect:       17us      4.78ms      1.47ms      1.06ms    69.43%
time to 1st byte:     5.99ms    422.29ms    214.65ms    105.54ms    65.72%
req/s           :    1119.71     7270.85     2226.57      786.54    76.56%
[info] CPU 6108.7% | Mem 870MiB

[run 2/3]
starting benchmark...
13.
22.
52Warm-up phase is over for thread #Main benchmark duration is started for thread #56Warm-up phase is over for thread #2614.
.
.
.Main benchmark duration is started for thread #
26Warm-up phase is over for thread #Warm-up phase is over for thread #Main benchmark duration is started for thread #30.63.

.
56.
.

Application protocol: h2c
34
62. Stopping all clients.
49
14Stopped all clients for thread #24
. Stopping all clients.Stopped all clients for thread #31

20. Stopping all clients.
. Stopping all clients.
4. Stopping all clients.

finished in 5.05s, 2365366.20 req/s, 101.52MB/s
requests: 11826831 total, 11929231 started, 11826831 done, 11826831 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 11826857 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 507.62MB (532276627) total, 304.53MB (319324827) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:      826us       1.20s     42.54ms     19.18ms    87.24%
time for connect:       19us      5.34ms      1.24ms       866us    69.92%
time to 1st byte:     4.99ms    151.87ms     28.69ms     26.45ms    84.96%
req/s           :    1338.91     4678.29     2309.56      603.62    75.59%
[info] CPU 6413.4% | Mem 889MiB

[run 3/3]
starting benchmark...
progress: Warm-up phase is over for thread #55.
56Main benchmark duration is started for thread #55.
% of clients started
.
56.

68% of clients started
.Warm-up phase is over for thread #25.
Application protocol: h2c
52.

53. Stopping all clients.
58

finished in 5.07s, 2433894.20 req/s, 104.46MB/s
requests: 12169471 total, 12271871 started, 12169471 done, 12169471 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 12169501 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 522.32MB (547695523) total, 313.35MB (328576167) headers (space savings 46.00%), 0B (0) data
                     min         max         mean         sd        +/- sd
time for request:     1.05ms       1.04s     39.98ms     14.46ms    72.12%
time for connect:       17us      4.03ms      1.24ms       790us    62.60%
time to 1st byte:     5.53ms     93.48ms     24.63ms     18.19ms    80.18%
req/s           :    1418.23     4858.93     2376.44      644.97    69.24%
[info] CPU 6438.2% | Mem 896MiB

=== Best: 2400296 req/s (CPU: 6438.2%, Mem: 896MiB) ===
[info] saved results/unary-grpc/1024/wtx-grpc.json
httparena-bench-wtx-grpc
httparena-bench-wtx-grpc
[info] skip: wtx-grpc does not subscribe to unary-grpc-tls
[info] skip: wtx-grpc does not subscribe to stream-grpc
[info] skip: wtx-grpc does not subscribe to stream-grpc-tls
[info] skip: wtx-grpc does not subscribe to echo-ws
[info] skip: wtx-grpc does not subscribe to echo-ws-pipeline
[info] skip: wtx-grpc does not subscribe to echo-ws-limited
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/results/wtx.json - 2 new, 15 total
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant