User Tag List

Results 1 to 11 of 11

Thread: The State of Cheating in Android Benchmarks

  1. #1
    Noblesse Oblige
    • CvP's Gadgets
      • Motherboard:
      • ASUS P8Z77 V Delux
      • CPU:
      • Intel Core i7 3770K @3.9GHz
      • RAM:
      • GSkill TridentX 2x8GB DDR3 @2400MHz
      • Hard Drive:
      • Crucial M4 256GB SSD; WD Caviar Black 2TB; Hitachi 250GB; Samsung S3 1.5TB; Hitachi 2TB
      • Graphics Card:
      • EVGA 980Ti 6GB
      • Display:
      • Samsung 17"+22"+22"
      • Sound Card:
      • Realtek HD Audio <internal>
      • Speakers/HPs:
      • Creative Inspire 5:1
      • Keyboard:
      • Razer BlackWidow Ultimate
      • Mouse:
      • G7
      • Power Supply:
      • Seasonic X 850W 80Plus Gold
      • Optical Drive:
      • External DVD-RW
      • USB Devices:
      • Logitech Carl Zeiss Tessar HD 1080p Webcam
      • UPS:
      • Mercury 1500VA with Large Lead-Acid Battery
      • Operating System:
      • Genuine Windows 10 Pro
      • Comment:
      • Everything packed in a NZXT Phantom 820
      • ISP:
      • Link3/Amber IT
      • Download Speed:
      • 10000
      • Upload Speed:
      • 10000
    CvP's Avatar
    Join Date
    Feb 2008
    Location
    Dhaka, Bangladesh
    Posts
    9,019

    Default The State of Cheating in Android Benchmarks

    AnandTech published a nice read on this subject: http://www.anandtech.com/show/7384/s...oid-benchmarks

    Thanks to AndreiF7's excellent work on discovering it, we kicked off our investigations into Samsung’s CPU/GPU optimizations around the international Galaxy S 4 in July and came away with a couple of conclusions:


    1) On the Exynos 5410, Samsung was detecting the presence of certain benchmarks and raising thermal limits (and thus max GPU frequency) in order to gain an edge on those benchmarks, and

    2) On both Snapdragon 600 and Exynos 5410 SGS4 platforms, Samsung was detecting the presence of certain benchmarks and automatically driving CPU voltage/frequency to their highest state right away. Also on Snapdragon platforms, all cores are plugged in immediately upon benchmark detect.

    The first point applied exclusively to the Exynos 5410 equipped version of the Galaxy S 4. We did a lot of digging to confirm that max GPU frequency (450MHz) was never exceeded on the Snapdragon 600 version. The second point however applied to many, many more platforms.

    Hit the link for the "I Can't Believe I Have to Make This Table" table.
    The abuse of greatness is when it disjoins remorse from power.
    Please do not PM me for support. You will NOT get a reply. Post in the relevant forum section.

  2. #2
    Forum Staff
    • aayman's Gadgets
      • Motherboard:
      • MSI X370 Gaming Pro
      • CPU:
      • Ryzen 1700 @3.7GHz (H100i v2)
      • RAM:
      • 2x8GB Trident Z 3600Mhz
      • Hard Drive:
      • 960 EVO 250GB + SanDisk SSDX 960GB + 1TB WD Black
      • Graphics Card:
      • EVGA 1070 FTW
      • Display:
      • ASUS PG279Q + Dell U2312HM
      • Sound Card:
      • Creative Sound Blaster Zx
      • Speakers/HPs:
      • Sennheiser PC350SE + Phillips SPH9500
      • Keyboard:
      • CM QuickFire Stealth
      • Mouse:
      • FinalMouse Scream One | Logitech G403
      • Controller:
      • Steam Controller
      • Power Supply:
      • Corsair AX850
      • Operating System:
      • Windows 10 1703
      • ISP:
      • AmberIT
    aayman's Avatar
    Join Date
    Jul 2008
    Posts
    13,792

    Default

    That is...disappointing. Thank god the Nexus devices are free of the fiasco. It's a shame what OEMs are willing to do for such a small edge.

  3. #3
    Member
    • Syeef's Gadgets
      • Motherboard:
      • ASRock Z77 Extreme6 | Corsair Carbide Air 540 Case
      • CPU:
      • Intel i7 3770k 3.50GHz | Corsair H110 280mm Water Cooler
      • RAM:
      • Corsair Vengeance 8GB (4x2) DDR3 1600MHz
      • Hard Drive:
      • WD 1TB Blue Sata III
      • Graphics Card:
      • MSI GTX680 Twin Frozr III OC
      • Display:
      • Samsung 22-inch LED 1080p
      • Sound Card:
      • N/A
      • Speakers/HPs:
      • Creative SBS 2.1
      • Keyboard:
      • Tt eSports Knucker
      • Mouse:
      • Tt eSports Theron Laser 5700 DPI
      • Controller:
      • Logitech F310 Gamepad
      • Power Supply:
      • Corsair CS750W Modular 80 Plus Gold
      • Optical Drive:
      • Samsung DVD-RAM 24x Sata
      • USB Devices:
      • Transcend JF780 32GB USB 3.0
      • UPS:
      • 650VA
      • Operating System:
      • Windows 8.1 Pro x64 with Media Center
      • ISP:
      • UTurn Broadband | Banglalion WiMAX
      • Download Speed:
      • ~15 Mbps | 128 KB/s
      • Upload Speed:
      • ~5 Mbps | 32 KB/s

    Join Date
    Jun 2011
    Location
    Dhaka
    Posts
    882

    Default

    But one thing... do we really look at benchmarks before buying mobile devices... or we buy because we think they are cool?
    Quran 6:159 - there is no sunni, shia under Islam.

    NOTE: I'm leaving this forum.. do not quote, tag, mention or PM me... you won't get a response.

  4. #4
    Member
    • furiousTaher's Gadgets
      • Motherboard:
      • Asus z170p || Asus p8 P67m pro
      • CPU:
      • i7 6700k || i5 2400
      • RAM:
      • 2 x Ripjaws 8gb 3200C16D 16GVKB || (Transcend 4gb + Adata 4gb) 1333
      • Hard Drive:
      • Evo 850 250gb + Toshiba 2tb || WD 500gb blue
      • Graphics Card:
      • Zotac gtx 1060 amp || Sapphire r7 260x 1GB
      • Display:
      • Asus vx229h ||Samsung 21.5" S22A300B
      • Sound Card:
      • Xonar dgx
      • Speakers/HPs:
      • Microlab 223 || AltecLansing VS2621 + a4tech hs100
      • Mouse:
      • a4tech x7
      • Power Supply:
      • Adata HM 850w || Thermaltek 600 TR2 S
      • Optical Drive:
      • Asus dvd writer 24x max
      • USB Devices:
      • Phantom 240 red/black || Vatyn 664b (Tyrannosaurus)
      • UPS:
      • Power guard 1200va
      • Comment:
      • :D
    furiousTaher's Avatar
    Join Date
    Apr 2010
    Location
    Dhaka
    Posts
    8,151

    Default

    the state of cheating in samsung benchmarking

  5. #5
    Member
    • avas911's Gadgets
      • Motherboard:
      • Gigabyte GA-EG41MF-US2H
      • CPU:
      • Intel Pentium Dual Core E6500 2.9 GHz 2MB L2 1066MHz FSB
      • RAM:
      • 2x2GB 800 MHz Apecer at 5-5-5-15
      • Hard Drive:
      • OCZ Vertex 3 120GB Sata III & Samsung 103SJ 1 TB F3
      • Graphics Card:
      • Sapphire ATI RADEON HD6850 1GB GDDR5
      • Display:
      • Philips 107S7 17" at [email protected]
      • Sound Card:
      • Built In Realtek ALC883
      • Speakers/HPs:
      • Creative SBS A200 / Cosonic Generic / Logitech Ultimate Ears 200vi/SoundMAGIC E10M IEM
      • Keyboard:
      • A4Tech
      • Mouse:
      • A4Tech X7 XL-747H 3600 DPI
      • Controller:
      • None
      • Power Supply:
      • Delta GPS-500AB A 500W
      • Optical Drive:
      • Asus 16x IDE DVD R
      • USB Devices:
      • Transcend 500 8GB & Corsair Survivor USB 3.0 16GB & Samsung Class 10 16GB mSDHC
      • UPS:
      • Rahimafrooz 600VA Premium
      • Operating System:
      • Win7 Ultimate 64Bit
      • Comment:
      • Slow in gaming
      • ISP:
      • Link3 512
      • Download Speed:
      • 70
      • Upload Speed:
      • 70
    avas911's Avatar
    Join Date
    Nov 2008
    Location
    Mohammadpur
    Posts
    4,251

    Default

    Not only samsung. apparently everyone is doing it.

    Good thing I dont buy devices by their benchmark scores
    Once more into the fray
    Into the last good fight I’ll ever know

    Live and die on this day
    Live and Die on this day

  6. #6
    Forum Staff
    • aayman's Gadgets
      • Motherboard:
      • MSI X370 Gaming Pro
      • CPU:
      • Ryzen 1700 @3.7GHz (H100i v2)
      • RAM:
      • 2x8GB Trident Z 3600Mhz
      • Hard Drive:
      • 960 EVO 250GB + SanDisk SSDX 960GB + 1TB WD Black
      • Graphics Card:
      • EVGA 1070 FTW
      • Display:
      • ASUS PG279Q + Dell U2312HM
      • Sound Card:
      • Creative Sound Blaster Zx
      • Speakers/HPs:
      • Sennheiser PC350SE + Phillips SPH9500
      • Keyboard:
      • CM QuickFire Stealth
      • Mouse:
      • FinalMouse Scream One | Logitech G403
      • Controller:
      • Steam Controller
      • Power Supply:
      • Corsair AX850
      • Operating System:
      • Windows 10 1703
      • ISP:
      • AmberIT
    aayman's Avatar
    Join Date
    Jul 2008
    Posts
    13,792

    Default

    Quote Originally Posted by Syeef View Post
    But one thing... do we really look at benchmarks before buying mobile devices... or we buy because we think they are cool?
    If I were buying an Android phone then I definitely would. I like to ensure I get best performance and value for the money, so benches help a lot. So far I have only bought iPhones and didn't even look at benches because I already know that they will have the best or near best performance in everything but the same can't be said for most Android phones.

  7. #7
    Member
    • avas911's Gadgets
      • Motherboard:
      • Gigabyte GA-EG41MF-US2H
      • CPU:
      • Intel Pentium Dual Core E6500 2.9 GHz 2MB L2 1066MHz FSB
      • RAM:
      • 2x2GB 800 MHz Apecer at 5-5-5-15
      • Hard Drive:
      • OCZ Vertex 3 120GB Sata III & Samsung 103SJ 1 TB F3
      • Graphics Card:
      • Sapphire ATI RADEON HD6850 1GB GDDR5
      • Display:
      • Philips 107S7 17" at [email protected]
      • Sound Card:
      • Built In Realtek ALC883
      • Speakers/HPs:
      • Creative SBS A200 / Cosonic Generic / Logitech Ultimate Ears 200vi/SoundMAGIC E10M IEM
      • Keyboard:
      • A4Tech
      • Mouse:
      • A4Tech X7 XL-747H 3600 DPI
      • Controller:
      • None
      • Power Supply:
      • Delta GPS-500AB A 500W
      • Optical Drive:
      • Asus 16x IDE DVD R
      • USB Devices:
      • Transcend 500 8GB & Corsair Survivor USB 3.0 16GB & Samsung Class 10 16GB mSDHC
      • UPS:
      • Rahimafrooz 600VA Premium
      • Operating System:
      • Win7 Ultimate 64Bit
      • Comment:
      • Slow in gaming
      • ISP:
      • Link3 512
      • Download Speed:
      • 70
      • Upload Speed:
      • 70
    avas911's Avatar
    Join Date
    Nov 2008
    Location
    Mohammadpur
    Posts
    4,251

    Default

    Quote Originally Posted by aayman View Post
    If I were buying an Android phone then I definitely would. I like to ensure I get best performance and value for the money, so benches help a lot. So far I have only bought iPhones and didn't even look at benches because I already know that they will have the best or near best performance in everything but the same can't be said for most Android phones.
    Does not matter in general usage. Get the phone you like and get the one with features you like. Any phone with A9 dual cores and 1 gb or more ram works fine. The rest is useless in most cases. I am using the NII for more than 10 months. I yet have to find a app or scenario where it was performance bottlenecked.

    You can get a superfast but buggy phone. And you can get a super stable phone which has sufficiently fast hardware. I will always choose the later. That is all.
    Once more into the fray
    Into the last good fight I’ll ever know

    Live and die on this day
    Live and Die on this day

  8. #8
    Forum Staff
    • aayman's Gadgets
      • Motherboard:
      • MSI X370 Gaming Pro
      • CPU:
      • Ryzen 1700 @3.7GHz (H100i v2)
      • RAM:
      • 2x8GB Trident Z 3600Mhz
      • Hard Drive:
      • 960 EVO 250GB + SanDisk SSDX 960GB + 1TB WD Black
      • Graphics Card:
      • EVGA 1070 FTW
      • Display:
      • ASUS PG279Q + Dell U2312HM
      • Sound Card:
      • Creative Sound Blaster Zx
      • Speakers/HPs:
      • Sennheiser PC350SE + Phillips SPH9500
      • Keyboard:
      • CM QuickFire Stealth
      • Mouse:
      • FinalMouse Scream One | Logitech G403
      • Controller:
      • Steam Controller
      • Power Supply:
      • Corsair AX850
      • Operating System:
      • Windows 10 1703
      • ISP:
      • AmberIT
    aayman's Avatar
    Join Date
    Jul 2008
    Posts
    13,792

    Default

    Quote Originally Posted by avas911 View Post
    Does not matter in general usage. Get the phone you like and get the one with features you like. Any phone with A9 dual cores and 1 gb or more ram works fine. The rest is useless in most cases. I am using the NII for more than 10 months. I yet have to find a app or scenario where it was performance bottlenecked.

    You can get a superfast but buggy phone. And you can get a super stable phone which has sufficiently fast hardware. I will always choose the later. That is all.
    Easy to say that when you have the Note2, that's a flagship device, unlikely to face issues and will obviously run anything without bottlenecking. If you check benches, you will see your experience is confirmed scientifically.

    It has been shown many times that just having the hardware will not cut it anymore, which is why I cannot buy anything just by looking at its specs. A9 and 1GB are great but means nothing if the phone has heating issues and forced to throttle down. This is where benches will come in and show whether you are getting the performance you are paying for.

    MotoX for example, mid range hardware and you probably won't think much basing off specs. Benches show that it's performance is close to a high-end one. Obviously you can't just look at benches, you need to read up on the experience part as well. If its a buggy phone then you'll read about it as well, but when I go to buy my aim will be super fast + super stable and make adjustments based on budget, user input etc.

  9. #9
    Member
    • Rakin7's Gadgets
      • Motherboard:
      • ASUS Z77 Sabertooth
      • CPU:
      • Watercooled Intel Sandy Bridge Core i5 2500k
      • RAM:
      • Corsair Vengeance 1600MHz 2x4GB
      • Hard Drive:
      • Samsung F4 2TB and Crucial M4 128GB SSD
      • Graphics Card:
      • Sapphire HD7970 Vapor-X 3GB GHz Edition flashed to R9 280X
      • Display:
      • Asus MS228H 21.5 LED Full HD 1080p and Sony Bravia CX520 32
      • Sound Card:
      • ASUS Xonar Essence STX
      • Speakers/HPs:
      • Beyerdynamic DT770 Pro 250 Ohms
      • Keyboard:
      • Thermaltake Meka G1 Mechnical Keyboard
      • Mouse:
      • Razer Deathadder 2013
      • Power Supply:
      • Thermaltake Smart M850
      • UPS:
      • Powerpac 1200VA backed up by Generator
      • Operating System:
      • Windows 8 x64 with Media Center
      • ISP:
      • Link3 2.5 Mbps
      • Download Speed:
      • 325 KB/s
      • Upload Speed:
      • 325 KB/s
    Rakin7's Avatar
    Join Date
    Apr 2011
    Location
    Dhaka
    Posts
    3,840

    Default

    Click image for larger version. 

Name:	Screenshot_2013-10-05-01-17-54[1].png 
Views:	3 
Size:	145.6 KB 
ID:	31159
    Small wonder my GT-i9500 (International Version of the Galaxy S4) shows 2000MHz on Antutu 4 and 1600MHz elsewhere, though I'm not complaining. The device has all the features one could hope for on a mobile phone and then some, and is smooth as ¤¤¤¤ even on the stock ROM.

  10. #10
    Member
    • mr_08's Gadgets
      • Motherboard:
      • Asus B75M+ || Gigabyte G41m combo
      • CPU:
      • Intel core i5 2500k @3.3ghz cooled by the CM V6GT || Intel dual core e5500 @4ghz with TT V1AX cooler
      • RAM:
      • Gskill RIPJAWS X SERIES 4gbx2 @ 1600mhz || adata xpg 2x2gb @1333mhz 7-7-7-20
      • Hard Drive:
      • samsung f3 500gb || wd 1tb , samsung 250gb
      • Graphics Card:
      • Sapphire 7970 OC 3GB w/ BOOST || Gigabyte 8800gts 512mb
      • Display:
      • Sony Bravia KDL42W700B || Samsung P2350, Samsung T190
      • Sound Card:
      • integrated
      • Speakers/HPs:
      • Genius G500v || cosonic headphone
      • Keyboard:
      • cm devastator mb24 , a4tech x7 g800 , logitech k260|| a4tech x7 g500,a4tech KB 28g
      • Mouse:
      • cm devastator ms2k , a4tech x7 X710 || a4tech office mouse, logitech m210
      • Controller:
      • logitech g13,logitech rp2,xbox 360 wireless controller,generic usb x 3
      • Power Supply:
      • xfx pro series 650w || delux 450w
      • Optical Drive:
      • liteon 24x w/ LT || asus dvd rw
      • USB Devices:
      • Transcend 16gb USB 3.0 || Transcend 16gb usb 2.0
      • UPS:
      • Apollo 1200va || Powerguard 650va
      • Operating System:
      • win7 ultimate sp1 || xp sp3
      • Comment:
      • alhamdulillah!duitai chole,kharap na :D
      • ISP:
      • Itbasebd || qubee
      • Download Speed:
      • 8mb || 4 mb
      • Upload Speed:
      • 8mb || 2mb

    Join Date
    Apr 2008
    Location
    dhaka
    Posts
    4,041

    Default

    Quote Originally Posted by Rakin7 View Post
    Click image for larger version. 

Name:	Screenshot_2013-10-05-01-17-54[1].png 
Views:	3 
Size:	145.6 KB 
ID:	31159
    Small wonder my GT-i9500 (International Version of the Galaxy S4) shows 2000MHz on Antutu 4 and 1600MHz elsewhere, though I'm not complaining. The device has all the features one could hope for on a mobile phone and then some, and is smooth as ¤¤¤¤ even on the stock ROM.
    that is Samsung's cpu/gpu ''optimization for benchmarks"
    ami chhoto amake marbenna.-_- shob _ buira_gamer_

  11. #11
    Member
    • Rakin7's Gadgets
      • Motherboard:
      • ASUS Z77 Sabertooth
      • CPU:
      • Watercooled Intel Sandy Bridge Core i5 2500k
      • RAM:
      • Corsair Vengeance 1600MHz 2x4GB
      • Hard Drive:
      • Samsung F4 2TB and Crucial M4 128GB SSD
      • Graphics Card:
      • Sapphire HD7970 Vapor-X 3GB GHz Edition flashed to R9 280X
      • Display:
      • Asus MS228H 21.5 LED Full HD 1080p and Sony Bravia CX520 32
      • Sound Card:
      • ASUS Xonar Essence STX
      • Speakers/HPs:
      • Beyerdynamic DT770 Pro 250 Ohms
      • Keyboard:
      • Thermaltake Meka G1 Mechnical Keyboard
      • Mouse:
      • Razer Deathadder 2013
      • Power Supply:
      • Thermaltake Smart M850
      • UPS:
      • Powerpac 1200VA backed up by Generator
      • Operating System:
      • Windows 8 x64 with Media Center
      • ISP:
      • Link3 2.5 Mbps
      • Download Speed:
      • 325 KB/s
      • Upload Speed:
      • 325 KB/s
    Rakin7's Avatar
    Join Date
    Apr 2011
    Location
    Dhaka
    Posts
    3,840

    Default

    Quote Originally Posted by mr_08 View Post
    that is Samsung's cpu/gpu ''optimization for benchmarks"
    yea I know.

Similar Threads

  1. Replies: 23
    Last Post: February 4th, 2012, 02:00
  2. AMD Trinity Internal Benchmarks Surface
    By Arif69 in forum Tech News
    Replies: 0
    Last Post: November 21st, 2011, 22:24
  3. Post your SuperPi 32M Benchmarks
    By Dee in forum CPU
    Replies: 4
    Last Post: February 18th, 2011, 01:27
  4. AMD Radeon HD 6870 benchmarks ?
    By SHÅîTÅN™ in forum GPU
    Replies: 15
    Last Post: September 1st, 2010, 20:37
  5. Benchmarks: Windows 7 RTM versus Vista, XP
    By cRush in forum Software
    Replies: 0
    Last Post: August 6th, 2009, 23:42

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Page generated in 0.22729 seconds with 15 queries.