App developers needed for beta launch of Quality App Directory

02/01/2012

We're about to launch an online Directory containing details of apps that have been tested against (and have passed) the tests outlined in the Unified Testing Criteria (UTC).

Initially the Directory will be for Android apps, but we’ll very soon be expanding to cover apps from other platforms.

We're conducting a trial with a number of developers who have Android apps that they’ve either tested themselves against the relevant version of the UTI’s Testing Criteria, or have been tested against that Testing Criteria via a reputable test house.

For those developers involved in the trial, we’re looking for their feedback on the Directory itself as they trial it with us so we can remove any bugs or inconsistencies: we’ll be looking to them to tell us what makes sense and what doesn’t, and feeding back to us on suggested improvements. And of course, their app details will be the first to be featured once the beta phase is over.

Download the latest version of the Android Testing Criteria here (pdf). 

The trial started on February 15, with initial results released at Mobile World Congress (in a slot within the developerprogram.com and Cisco session on Monday 27 Feb. 

About the Quality Application Directory: FAQs

Why have it?
To give visibility throughout the industry to apps that have reached a specified level of quality relating to usability and application behaviour within the phone. This will help those apps stand out from the crowd.

Who’s determining the level of quality?
The UTI (with industry input) has compiled a set of Testing Criteria (UTC) for the Android platform and one for Java ME. Other platforms will be added soon. The platform-specific UTC is an evolving set of tests, built up from developer and UTI member input. It focussed mainly on usability and application behaviour within the phone, and will soon be expanded to cover other areas relating to battery life, such as privacy and network usage amongst others. However, it intentionally does not look at the usefulness or function of the application, and isn’t intended to capture everything.

It is simply a guide to the level of acceptable usability UTI members feel an app should have before it is commercialised. We hope that most apps meet this criteria anyway, as developers are stringent about quality.

How is the Directory being funded?
The UTI members are funding both the Directory and the auditing of the apps. There is no cost to the developer for submitting details of apps into the Directory. It is a pure industry initiative, funded by the industry for the industry.

Can anyone submit app details into the Directory?
Yes. Any developer wishing to submit details of apps that meet the quality standard can open an account. They can then upload information for each app.

Are the apps themselves uploaded?
No. This isn’t an app store. It’s a reference point for UTI members and other interested parties to see details of apps that have met certain quality standards.

How do you know my apps have met the standard?
Because you’ll have signed the Ts and Cs to tell us that you’ll only upload details of apps that have met the standard. We’ll conduct an audit on apps periodically (at our own cost), and if they fail the audit, we’ll make that clear within the Directory, having given you time to rectify the situation. Any developer abusing the Directory will of course be publicly black-listed.

Will I need to prove I’ve had the apps tested using a test house?
There will be different levels of quality assurance open to you. If, for example, you upload a test report from one of the recognised test houses (and we’ll give you a list of them), then this gives you and your app great credibility. In addition, UTI members can upload apps from developers that they have tested themselves. These will have a further level of assurance associated with them.

Will it cost me money to get the apps tested by a test house?
Yes, but it would do anyway, whether you were uploading details into the App Directory or not. We need to make sure the test houses are reputable, so will be providing a list of them to you. We’re starting off with a few, but are very open to including more as time goes by. UTI has no involvement at all in the price the test houses charge for testing. That agreement is between you and the test house. Our interest is in making sure the price is competitive, which is why we’re recommending a selection for you to choose from.

Who will benefit from the Directory, and how?
Huge benefits will be gained by developers uploading details of apps. You will be able to demonstrate for the first time the quality of your apps (and, by association, your organisation).

UTI members will have access to all of the information within the Directory, and will be able to make decisions based on that information. It will also help UTI members identify how much additional testing they need to do themselves if they were to include an app within an embedded or over-the-air distribution channel.

Finally, the Directory will be open to the public, enabling them to check the quality of an app before they download it. However, the ‘public’ is not the main audience for the Directory.

Will the Directory just be for Android apps?
It will start of with Android apps, but will then roll-out to include other platforms.

Why have a beta version of the Directory?
The last thing we want to do is to launch something without gaining input from the developer community. Although the building and maintenance of the directory and the auditing costs are funded by the UTI members, without additional industry input, it won’t work. That’s why we’re running a beta trial, to get as much feedback as we can before we go live.

› back