Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reported results are not feasible #9168

Open
robaho opened this issue Jul 16, 2024 · 6 comments
Open

reported results are not feasible #9168

robaho opened this issue Jul 16, 2024 · 6 comments

Comments

@robaho
Copy link
Contributor

robaho commented Jul 16, 2024

The vast majority of the plaintext results are not possible on 10 Gbit ethernet.

The maximum transfer speed of 10gbit ethernet is 1,250 megabytes per second.

The minimum valid http response for plaintext is 142 bytes, the headers are 129 bytes, and the payload 13 bytes.

HTTP/1.1 200 OK
Server: httpserver-robaho
Date: Tue, 16 Jul 2024 14:35:23 GMT
Content-type: text/plain
Content-length: 13 

You could reduce it a bit will a smaller server name.

so, the top result of 28,733,734 by mrhttp is not possible, as this would equate to:

28733734 * 142 / (1024*1024) = 3891 megabytes per second

The approximate theoretical maximum requests per second between a single client and single server machine on 10gbit ethernet is 9230422 requests per second - which would mean everything above 70th place is impossible. This also assumes that the packet rate is not exceeded (i.e. that every ethernet frame is filled to capacity).

The only way this would be possible is using multiple coordinated client machines with dedicated ethernet connections to multiple server machines - but the latest environment documentation does not describe this as being the case.

Can you provide more details on how these numbers are achieved? Thanks.

@robaho
Copy link
Contributor Author

robaho commented Jul 16, 2024

I think I see the issue. I don't think the website is working properly. I think it is showing cloud results for the physical as they are the same.

image image

@robaho
Copy link
Contributor Author

robaho commented Jul 16, 2024

Strangely though, the official benchmarks do not show any results for Cloud for plaintext or json serialization.

@NateBrady23
Copy link
Member

There is currently no cloud environment.

The current environment is 40gbit.

Have to update the docs.

@robaho
Copy link
Contributor Author

robaho commented Jul 16, 2024

There is currently no cloud environment.

The current environment is 40gbit.

Have to update the docs.

When you click cloud, the results should probably be empty then to not confuse people.

@remittor
Copy link
Contributor

remittor commented Jul 18, 2024

Can you provide more details on how these numbers are achieved? Thanks.

There are many explanations here: #7402

Here I repeated the results on 99% identical hardware for the libreactor framework: #7402 (comment)

There I also showed the throughput when using a 25Gbit network: 21387110 req/sec

@robaho
Copy link
Contributor Author

robaho commented Jul 18, 2024

Can you provide more details on how these numbers are achieved? Thanks.

There are many explanations here: #7402

Here I repeated the results on 99% identical hardware for the libreactor framework: #7402 (comment)

There I also showed the throughput when using a 25Gbit network: 21387110 req/sec

Understood. The docs stated it was 10gbit Ethernet which is what made them infeasible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants