Yesterday, I posted a story on the fact that Samsung was being accused of cheating on benchmark tests by AnandTech. Today, AnandTech is saying almost everyone in the Android universe cheats when it comes to benchmark tests. They’ve posted a very lengthy report on this. While I encourage you to read it, I’ll give you the executive summary. It would be a shorter list to tell you who isn’t cheating when it comes to benchmarks. The companies that are running clean are:
That’s a pretty short list. I Included Apple because according to the report, they don’t cheat either. That implies that you may not be getting the performance that you’re paying for. And it’s likely to become difficult to detect going forward:
Going forward I expect all of this to become more heavily occluded from end user inspection. App detects alone are pretty simple, but what I expect to happen next are code/behavior detects and switching behavior based on that.
That’s not good at all for anyone. I would be interested to hear these companies who do cheat explain their rationale.
Like this:
Like Loading...
Related
This entry was posted on October 2, 2013 at 2:42 pm and is filed under Commentary with tags Benchmarks, Smartphone. You can follow any responses to this entry through the RSS 2.0 feed.
You can leave a response, or trackback from your own site.
AnandTech Says Almost Everyone Cheats On Benchmarks
Yesterday, I posted a story on the fact that Samsung was being accused of cheating on benchmark tests by AnandTech. Today, AnandTech is saying almost everyone in the Android universe cheats when it comes to benchmark tests. They’ve posted a very lengthy report on this. While I encourage you to read it, I’ll give you the executive summary. It would be a shorter list to tell you who isn’t cheating when it comes to benchmarks. The companies that are running clean are:
That’s a pretty short list. I Included Apple because according to the report, they don’t cheat either. That implies that you may not be getting the performance that you’re paying for. And it’s likely to become difficult to detect going forward:
Going forward I expect all of this to become more heavily occluded from end user inspection. App detects alone are pretty simple, but what I expect to happen next are code/behavior detects and switching behavior based on that.
That’s not good at all for anyone. I would be interested to hear these companies who do cheat explain their rationale.
Share this:
Like this:
Related
This entry was posted on October 2, 2013 at 2:42 pm and is filed under Commentary with tags Benchmarks, Smartphone. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.