AI Benchmark
Is your smartphone capable of running the latest Deep Neural Networks to perform these AI-based tasks? Does it have a dedicated AI Chip? Is it fast enough? Run AI Benchmark to comprehensively evaluate it's AI Performance!
Current phone ranking: http://ai-benchmark.com/ranking.html
AI Benchmark measures the speed, accuracy and memory requirements for several key AI and Computer Vision algorithms. Among the tested solutions are Image Classification and Face Recognition methods, Neural Networks used for Image Super-Resolution and Photo Enhancement, AI models playing Atari Games and performing Bokeh Simulation, as well as algorithms used in autonomous driving systems. Visualization of the algorithms’ output allows to assess their results graphically and to get to know the current state-of-the-art in various AI fields.
In total, AI Benchmark consists of 21 tests and 11 sections provided below:
Section 1. Classification, MobileNet-V2
Section 2. Classification, Inception-V3
Section 3. Face Recognition, Inception-ResNet-V1
Section 4. Playing Atari Games, LSTM
Section 5. Deblurring, SRCNN
Section 6. Super-Resolution, VGG19
Section 7. Super-Resolution, SRGAN
Section 8. Bokeh Simulation, U-Net
Section 9. Semantic Segmentation, ICNet
Section 10. Image Enhancement, DPED ResNet
Section 11. Memory limits, SRCNN
A detailed description of the tests can be found here: http://ai-benchmark.com/tests.html
Note: Hardware acceleration is supported on Android 9.0 and above on all mobile SoCs with AI accelerators, including Qualcomm Snapdragon, HiSilicon Kirin, Samsung Exynos and MediaTek Helio.
Category : Tools
Reviews (26)
Always use AI benchmark when testing out new phones or the build of my phones that I make been wonderful to see what kind of AI I can come up with out of a regular ordinary phone sometimes we can have phone out to its Max really improves the AI very much satisfied with this product
Works on some of my phones, crashes on others, keeps crashing on test 5/11, deblurring, right after Atari test on one of my devices, can't get a score because I get an exception error every time. So on nice phones, it works, on budget soc's it's hit and miss.
Not accurate at all, results based on how much RAM you have and what version of Android your running to "accelerate" test results. Unless your using a flagship, it will always state "feels like a phone from 2012". Waste of time.
I have a oneplus 6 bought from store. This app keeps crashing after the first test. LE: can't update to android pie as it's still in beta and it still has some bugs. LE2: Worked fine after updating to android pie. Thank you for the guidance uploader.
EDIT: Oh I see! I want to apologize for wrong review. Everything works correctly, I just had to restart the app. Thank you for your response, Ignatov Andrey! Quite interesting app for testing NPU of your device. However this app quits on the last test (11/11). I have Samsung S10 5G so I didn't expect any errors. Hopefully it will get fixed so I can see the result of testing.
Nice effort, delivering what one would expect from benchmarking application. I might have missed that piece of info, but it would be good to add report of underlaying HW resources, like 4*CPU, NPU, DSP, GPU, etc
Great app an all, but how phones with a snapdragon 810 (one of the worst CPUs ever made by Qualcomm) namely sony z5 and htc one M9 can get higher scores than my snapdragon 835 Pixel? And the difference is quite significant, I got like a 9.5 and those phones got around 13. And my phone didn't even get warm during the test.
very interesting but the report is not clear. what do you mean CPU/INT? is it CPU running on quantized network? also in my other device that has Qualcomm 845, I do not see any report with GPU
Great app! Would be great if it could measure the power consumption as well, so one could get the efficiency.
Edit: Thank you very much for clarifying! 5* According to the "short ranking" results page my SD730 device scores 2x more than a SD855 powered Pixel3 - which I highly doubt is correct.
Put my device in a reboot loop! Lucky enough was able to unistall app in the split second chance i had before it forced reboot. Not Good At All
My phone scored over 21,000 points... taking 1st place by a landslide. It's an Huawei Mate 20. Is that really accurate? That's more than 4 times what an Galaxy S9+ scored! 😱
Crashes on 10/11. So close to being finished and crashes. Oh well. Uninstalled. -Note 10 Plus
Crashing during load model stage on Exynos 9611 running on Android 10, dont know used to work fine on my older phone running Snapdragon 636 on Android 9. Is it incompatible with Samsung chips?
Weird app. I am not sure how AI ready my phone is, but I have used it to compare a few devices.
Wow, going by other reviews of the app...my Poco performed way better @7204. But I was just wondering, is this somehow dependent on my internet speeds?
An amazing app with state of art implementations of deep learning also provide paper and code!!!
Ran through it in ½ the time with this Note 20 Ultra. Fun to watch. Never used more than 52% RAM.
Awesome, so accurate for my flagship phone. Can someone try no AI capability phone on this benchmark? Let's see what it will say, just curious AF
Very well made, although mine crashes during the ram test. S8+ Android 9
Crashes on my redmi 8a after a few minutes!!! It crashed during the test called miss universe which is most likely the 8th test!!.🙂
Working perfectly no errors in my redmi 9, interesting work! Keep dev! (My phone s***)
Informative and educational. And the AI tricks are impressive.
My brand new Xiaomi mi 11 ultra with Snapdragon 888 tested just slightly faster than the galaxy S10 ? How is that even possible?
Worked well on my Poco X3 GT. I scored a whopping 141,300, which places it between the flagship grade Exynos 2100 and Snapdragon 888.
Really interesting app. I still have to read alot about how the scoring and acceleration works. When I get my new Samsung S22 Ultra, which is claimed to have 73% more powerful NPU than last years model...I'm keen to run it along side my current Samsung Note10 plus at the same time. which is 2.5 yrs old now and see the difference.