When you take a look at the TechEmpower Web Framework Benchmarks it's hard to not notice how fast is Rust compared to the other languages. 585,000 requests / s for may-minihttp, 400,000 requests / s for axum [postgresql]! It's tempting to think "ZOMGG!! Stop everything!! We need to rewrite our
I don’t know and I won’t pretend it does have any statistical significance. I will just say that I have read dozens of papers and anecdotally, the results were questionable in almost all cases. And not because of the possibility that they might have missed something, but because of basic shortcomings. Some don’t even state how often they repeated their experiments, software versions, whether they accounted for caching effects, (system) temperature, hardware characteristics, you name it.
That’s why I wouldn’t name papers a prime example for clean benchmarking. The quality on YT news outlets like Gamers Nexus or Hardware Unboxed is higher than most of them by far.