Sci-tech

Huawei's excuse for benchmark manipulation: others do it!

Huawei's excuse for benchmark manipulation: others do it!”

UL, the company behind the gaming 3DMark benchmark, has just announced that four Huawei smartphones are getting delisted after confirming a breach of their rules - Huawei P20 Pro, Huawei nova 3, Huawei Honor Play, and Huawei P20.

Huawei reportedly claimed that the peak of productivity during the startup benchmark application, was "intuitive leap", based on the work of artificial intelligence. The company behind the app, UL Benchmarks, stated: "After testing the devices in our lab and confirming that they breach our rules, we have chose to delist the affected models and remove them from our performance rankings".

As a result, the Huawei P20, Huawei P20 Pro, Huawei Nova and Huawei Honor Play have all been delisted from UL Benchmarks' online rankings. As part of a response, Anandtech had a conversation with Huawei at IFA where its Consumer Business Group President, Wang Chenglu admitted to the fact that it does use a benchmark detection software to deliver an enhanced result to look strong with respect to its competitors in the eyes of a user. UL and Huawei would like to participate in an industry movement to develop benchmarking standards that best serve the needs of manufacturers, press, and consumers.

Third, benchmarking companies have other methods to test a device's actual expected capabilities, which is a good thing. Huawei did this to boast the powerful performance of Huawei smartphones and impress the customers.

AnandTech discovered that Huawei is another company guilty of manipulating benchmarking scores using a technique where the phone increases its clock speed once it detects the software. According to 3DMark, it was able to prove the misleading test results because Huawei's phones only recognized the public version of its benchmarking app.

UL say that "Delisted devices appear unranked, and without scores, at the bottom of our popular list of the best smartphones". That's presumably part of the reason why Huawei is launching "Performance Mode" with EMUI 9.0.

Kuala Lumpur, September 8, 2018 - Honor always prioritizes the user experience rather than pursuing high benchmark scores - especially since there isn't a direct connection between smartphone benchmarks and user experiences. They do, however, provide information about the smartphone's performance during heavy stress.

When AnandTech ran tests using an unlabeled version on benchmark apps, the phones were unable to recognize the same and performed poorly.



Like this

loading...
loading...

Latest


09 September 2018
Sadr calls for televised, emergency parliament session on Basra
His decision came after protesters took to the streets, which made it hard for security forces to enforce the curfew. Demonstrators also tried to break into the headquarters of the Al-Hashd Al-Shaabi militia in Basra .

09 September 2018
Google Pixel 3 Event To Take Place On October 9th
Google will be also live streaming its event as always on its Made by Google YouTube channel at 11 AM EST. It is believed to feature a Snapdragon 845 chipset paired with 4GB of RAM and 64GB of onboard storage.

09 September 2018
Boris Johnson to divorce - but will it hit his leadership hopes?
Johnson is thought to be plotting a return to frontline politics following his resignation over Theresa May's Brexit plan in July. Of more than 1,300 people surveyed, 72% said the divorce was "not very" or "not at all" relevant to him being in the top job.

09 September 2018
Florence to Become Hurricane Soon; Possibly Historic
The three tropical systems - Florence , Isaac and Helene - come right before the Atlantic hurricane season hits its peak Monday. But weaker winds and the storm's interaction with the jet stream have nudged it on a more westerly track that's very unusual.

09 September 2018
Fortnite’s 5.40 update brings the highly-anticipated Getaway mode and grappler gun
The person carrying the jewel receives additional health and shields over time, though also suffers a 10% decrease in speed. The goal is to be one of the four teams to find the safe, unlock it, and survive all the way to the getaway van .

09 September 2018
#PlaidShirtGuy from Trump rally steps forward
Later Linfesty pinned a stylized rose emblem representing the Democratic Socialists of America to his right breast. The high school student told the Montana newspaper he requested tickets to the rally earlier in the week.

09 September 2018
Flash flood watch in effect for mid-Missouri counties
Tropical Storm Gordon had previously swept over the southern United States, causing flooding and heavy wind and rain in Florida. Clouds will gradually decrease during the afternoon and evening hours, with highs topping out in the low-70s.

09 September 2018
Keys into back-to-back US Open semis
I can not return like I used to and during the match or during the points, I think we have good rallies, but she was better today. It was another hot afternoon Wednesday, with temperatures in the high 80s but feeling about 10 degrees hotter with the humidity.

09 September 2018
Bernie Sanders introduces 'Stop BEZOS Act' in the Senate
The median Amazon worker , meanwhile, was paid $28,446 a year ago , according to company filings. One concern from Bernstein is that it "joins the right in vilifying benefit receipt".

08 September 2018
BTS release highly anticipated MV for 'IDOL' featuring Nicki Minaj!
The version featuring Nicki Minaj is not on the group's album but is available as a special digital track released online. Speaking of dance moves, there are several clips of fans imitating the group's choreography at the end of the video.