Testin: 2012 China E-commerce Enterprise Mobile Internet Application Quality Report

On August 30, 2012, Ebrun and Testin, a mobile app automated real-device cloud testing platform, released the "2012 China E-commerce Enterprise Mobile Internet Application Quality Report", which showed that the overall performance of apps of domestic e-commerce companies is currently at a relatively low level, and user experience has also been affected to varying degrees.

Testin Cloud Testing has tested the apps of many e-commerce companies, including Manzuo Group Buying, Taobao, JD.com, and West Street Sports. The main test indicators are the compatibility and adaptation rate of the app, quality performance, CPU and memory consumption, service availability and response time across the country, etc., and finally the comprehensive performance of an app is averaged through scoring.

Quality and performance: 51bigou.com leads the Yaodian 100 and ranks last

Looking at the report as a whole, the comprehensive quality and performance scores of Android apps of all e-commerce companies are below 90 points, with an average level of 73.07 points. The quality and performance scores of the latest Android versions of apps of 18 e-commerce companies are all lower than the average level of the mobile Internet industry.

Yibang Power Network learned that among the App applications of the 18 e-commerce companies that participated in the test, the version with the highest comprehensive performance score was version 1.0 released by 51bigou.com, with a score of 89.23 points; version 1.60 released by Yaodian 100 had the lowest score of 58.08 points.

Compatibility: Taobao is the best, Jinxiang is the worst

From the compatibility perspective, a test of 200 mainstream terminal models on the Testin automated real-machine cloud testing platform showed that all 40 e-commerce enterprise App applications that participated in the test had compatibility and adaptation errors to varying degrees. The most compatible one was Taobao 3.22, with a compatibility and adaptation rate of 99.47%, and the worst was Golden Image Network 1.0, with a compatibility and adaptation rate of 26.32%.

Startup performance: Mobile phone Paipai is very fast while Meituan is slow

In terms of App startup performance, the average level is 1.46 s. The best is Paipai (1.0), with an average startup time of 0.55 s on all test terminals. The worst is Meituan (2.9.1.1), with an average startup time of 23.89 s on all test terminals.

CPU consumption: Nuomi.com is the most economical, while Taobao is the most intensive

In terms of CPU consumption, the average level is 8.91%. The best CPU performance consumption is Nuomi.com (2.1.0), with an average CPU usage of 1.82% in all test terminals. The worst is Taobao (3.2.2), with an average CPU usage of 18.84% in all test terminals.

Memory consumption: 51Bet Best 100 Worst

In terms of memory consumption, the average level is 13.92 MB. The best memory performance consumption is 51bigou.com (1.0), with an average memory usage of 8.6 MB in all test terminals. The worst is Yaodian 100 (1.6.0), with an average memory usage of 18.49 MB in all test terminals.

Service availability: All below 100%

In addition, according to Testin APM data monitoring, the availability rates of mobile Internet application services of Chinese e-commerce companies are all below 100%. Jumei Youpin has the highest availability, with an availability rate of 99.80%; Yaodian 100 has the lowest availability, with an availability rate of only 10.89%. The average level is 83.67%.

Testin said that Chinese e-commerce companies generally do not pay much attention to mobile application development. Many e-commerce apps do not undergo compatibility, performance, and function testing after development. This results in generally low quality of e-commerce apps, greatly affecting user experience and making it impossible to complete high-quality shopping. In addition, there is no effective monitoring solution for the service response of these apps in different networks and regions, and the service availability is not ideal.