Your favorite Apple, iPhone, iPad, iOS, Jailbreak, and Cydia site.
11-28-2013, 01:34 AM #1
Samsung and HTC Face Benchmark Test Chart Removal Shame
Futuremark seems to have delisted the scores of Samsung and HTC products from its public benchmark listings over new allegations of performance doping. According to a recent report by Tony Smith of the Register, Futuremark accused the two companies of rigging results in its 3DMark GPU benchmarking app for Android. The company removed the scores of Samsung’s Galaxy Note 10.1 tablet and Note III phablet as well as HTC’s One and One Mini smartphones, dropping the models to the bottom of its listings, below devices with a score of zero (above).
The president of Futuremark, Oliver Baltuch, told the site the following:
People rely on Futuremark benchmarks to produce accurate and unbiased results. That's why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software. In simple terms, a device must run our benchmarks without modification as if they were any other application.
"The platform may not detect the launch of the benchmark executable" and that devices "must not alter, replace or override any parameters or parts of the test, nor modify the usual functioning of the platform based on the detection of the benchmark."
For those of you who didn’t know, this already happened before too. Samsung was previously caught faking benchmark scores for the Exynos 5 version of the Galaxy S4 as well as its Galaxy Note 3 using a Qualcomm Snapdragon chip and its Galaxy 3 10.1 powered by an Intel CloverTrail+ processor. This kind of benchmark fudging is a practice that is opposed by Qualcomm and Intel as noted by the folks over at AnandTech, which called for attention to the benchmark doping in its testing this summer.
Samsung on the other hand issued multiple contradictory denials that it wasn’t doing anything wrong and certain Android fan sites also seemed to have defended the practice. Although the difference in numbers that such cheating produces appears to be small, it allows Samsung to claim for example, a performance edge over Apple’s iPhone 5C with its own Galaxy S4 flagship model, when in reality the S4 is about the same or scores slightly lower when it tested without being able to cheat.
How do you feel about the whole ordeal?
Source: The Register via AppleInsider
11-28-2013, 02:27 AM #2
I'm glad to see benchmark test companies finally taking charge. Drop the fake scores and force companies to provide real, and accurate tests. No CPU/GPU Code boosting, pure consumer-side tests with no alteration. Hopefully more benchmark companies do this
11-28-2013, 05:26 AM #3
11-28-2013, 11:09 AM #4
Wait for it...Jon Garrett (Android Avenger) to defend this abhorred display of performance fixing...Twitter ID: @Jato_BZ
.artwork Assassin / Emoji Extractor
11-29-2013, 10:27 PM #5
The point of a benchmark is to see how a device performs against another in real life usage. Im glad Futuremark is doing this and hope Samsung/HTC learn from their mistake. I dont care what a devices hardware is CAPABLE of, I care about WHAT IT ACTUALLY DOES on a day to day basis under normal usage.
The Following User Says Thank You to SupaMonkey For This Useful Post:
11-30-2013, 03:57 AM #6
First they gotta steal ideas. Now they gotta cheat on benchmarks. Is there no legitimate business practices going on any more. For shame!
11-30-2013, 01:39 PM #7
Well that's embarrassing lol people will still buy them regardless.