If you believe that the user experience is everything for mobile apps, HPE has a simple question for you: How are you measuring it?
All too often, existing tools do not adequately measure the user experience. Some measure only a few variables or have inconsistent measurement processes; others measure variables that provide incomplete or misleading information.
HPE has developed a fast, easy method to measure and monitor the user experience in a truly meaningful way: from the user’s perspective. It’s called “FunDex,” a single score from 0 to 100 that encapsulates the average overall user experience.
FunDex unifies all aspects of the user experience measured by the mobile analytics software product HPE AppPulse Mobile—performance, stability, battery and cellular data usage, while providing an accurate, relevant metric that can be used to prioritize QA/development efforts for mobile apps according to business impact. This paper describes how it works and why it’s better than traditional approaches to user experience measurement.
FunDex: a single score based on meaningful metrics
HPE created FunDex to address a dilemma that mobile app developers have faced for years. The success or failure of mobile apps depends on user experience, but the user experience is comprised of many different aspects—performance, stability, battery usage, and more. How do you measure and monitor the right variables, and how do you merge the measurements together to reflect an overall user experience?
FunDex solves the dilemma in two ways. First, it provides a single score, based on a wide array of variables measured and monitored, to quantify the average user experience. The data is collected by HPE AppPulse Mobile, which is a SaaS wrapper to the mobile app—so it is easy to add to mobile apps, and it captures, names, and measures ALL user actions automatically, without requiring developers to add code or maintain tags.
Second, FunDex is based on metrics that are actually meaningful—both to developers and to the business. For example, HPE AppPulse Mobile measures app performance in terms of UI response time, as perceived by the user. This application performance management approach is in stark contrast to most other user experience measurement solutions, which measure the network request time. The problem with measuring the network request time is that in many cases a network request does not impact the user at all. It doesn’t measure the client processing time, which is more significant in modern applications, especially in the mobile arena where many different operating systems and devices can impact the client processing time.
FunDex also takes into account meaningful metrics such as:
– The launch time for mobile apps, including both start time and resume time.
– Slow user actions that impact the most users and hence have the highest impact on the business.
– Crash analysis, showing user actions that caused a crash, the number of unique users affected by this crash, crashes that did not result from a specific user action, and more.
– Errors resulting from user actions, such as an HTTP error from a URL request.
– Battery consumption as a percentage, per minute of use, by device type and by app version.
– Cellular data usage: the amount of data consumed by the mobile app when connected through the cellular provider. This is broken down by each user action, domain, and more.
While these are the crucial aspects of the user experience, FunDex is also open to measuring and monitoring additional user experience variables in the future. For additional details about what AppPulse Mobile measures and why, please download a copy of “Measure What Matters,” an HPE white paper.
FunDex inner workings: a closer look
FunDex provides a graphical view of both the “FunDex per user” and the “average FunDex of all users” to quantify the average user experience. These visual representations enable mobile product managers to compare metrics over time, compare results between versions, compare with industry standards (future), and much more.
The score itself is based on a point system. Points are added for positive performance and deducted for issues such as slow launch times, application crashes, slow actions, and so on. Each user has the same impact on the score, regardless of the volume of usage. FunDex graphically shows why points were deducted.
The FunDex score is also color-coded—with green for good results, yellow for suboptimal, and red for unacceptable—making it easy to see whether the app passes a given threshold. While the color grades themselves are fixed, the user can change the threshold by which a user action or launch time is considered slow (2 seconds or 4 seconds by default), hence impacting the FunDex and making it fit specific mobile app requirements.
The average user experience score makes it possible to anticipate the experience of a new user, as well as to correlate usage and user experience. For example, it is possible to compare the FunDex of the users that use the app the most with the FunDex of users that use the app very little, and understand the impact of the FunDex on usage.
The graphical user interface or dashboard that displays the FunDex also makes it easy to track the variables that comprise the FunDex score. For example, you can monitor:
– Your FunDex trend, showing your FunDex score over the same time periods mentioned above.
– Your FunDex score by app version, along with the total number of users per app version, so you can quickly identify issues with a given version and prioritize problem resolution efforts according to business impact.
Improving your FunDex scores
The FunDex dashboard also presents graphic guidance for improving FunDex scores. For example, you can see at a glance how your UI is performing, and whether that performance is contributing to a high FunDex or lowering your FunDex score. The dashboard specifies what percentage of actions required more than 2 seconds to complete, and how many points were deducted from your FunDex score as a result of those slow actions.
In addition, you can quickly discover whether points were deducted from your FunDex because of stability issues. It shows the percentage of users who experienced a crash, and unlike other mobile analytics solutions, HPE AppPulse Mobile first identifies the user actions that caused the crash, then counts the number of unique users affected by this crash, and groups the crashes according to their impact on the business. This enables mobile product managers to prioritize which are most urgent.
You can also drill down from these metrics to get the details about the slow actions and crashes that impacted your FunDex score the most; in other words, you can see exactly what reduced the score and how to remedy the situation.
Equally important, FunDex factors in resource usage as part of the score. High battery consumption per minute of use lowers your FunDex, as does high cellular data usage.
In short, FunDex provides an intuitive, easy way to see how to improve the user experience of mobile apps, to identify actionable steps, and to prioritize those actions to deliver the highest user satisfaction and maximize business results.
See for yourself
The best way to learn more about FunDex is to see the dashboard for yourself. To start an AppPulse Mobile trial click here. For additional information about the mobile analytics software product HPE AppPulse Mobile, please download the “Measure What Matters” white paper.
Learn more at: hpe.com/software/apppulsemobile