Testing Android applications

Which mobile scenarios are worth automating

The value of automation is determined not by the number of tests, but by the faults it helps detect early. The first scenarios should therefore not be only those that are easiest to write. We select them according to their impact on the user, frequency of use, repeatability and maintenance cost.

Why a long list of screens is not enough

A team often starts automating linearly according to the application’s menu. This produces dozens of checks of lists and settings, while sign-in, payment or recovery after a network outage remain subject to manual testing. The report looks comprehensive, but the greatest risks remain uncovered.

The opposite problem is trying to move every detail into the end-to-end layer. Such tests are slower, work with multiple systems and require more maintenance. A price calculation or input validation can often be verified faster and more accurately at the unit or API test level.

How to determine the order

We assign four simple assessments to each candidate:

  1. Impact of a fault: would it stop the customer, a payment or an important process?
  2. Frequency: how often do customers use the journey and the team repeat it?
  3. Repeatability: can we prepare a known state and verify the result unambiguously?
  4. Appropriate layer: does the scenario need to go through the mobile interface, or would an API or lower-level test verify it better?

We select scenarios with a high impact and a clear outcome first. We take implementation difficulty into account, but it should not automatically eliminate the most important journey.

Scenarios that tend to be good candidates

We select scenarios such as a call, orientation change or a restriction on the background process according to whether they affect a specific function. Not every application needs them in its first suite.

How to turn candidates into a maintainable suite

For every scenario, we define the initial state, test data, expected outcome and owner. We prepare data through an API or controlled helper mechanism unless creating it through the interface is itself the subject of the test. This shortens the run and reduces the number of random failures.

The shortest critical journeys form the smoke suite. Broader and slower combinations run regularly or before release on a selected device matrix. We fix a test that fails over the long term without a product fault, or temporarily exclude it with a clear owner; it must not become tolerated noise.

If the mobile application depends on a backend, a large proportion of the rules can be covered less expensively through API testing. The mobile layer then verifies the connection between systems and the actual user journey.

What you gain

A smaller, well-chosen suite detects more important faults than a large number of superficial scenarios. Results arrive sooner, are easier to evaluate, and the team understands which risk each test covers.

Clear priorities also make expansion easier. When a feature or production problem is added, the new scenario is classified according to the same rules instead of enlarging the suite arbitrarily.

Next step

Take the five most important user journeys and assess them according to impact, frequency, repeatability and the appropriate testing layer. Verify the two highest-ranked journeys in a pilot and define a measurable outcome for each. Only then add further scenarios.

Related topics

You might also be interested in

We will verify the decisive scenarios on real devices

Automated testing of native and hybrid Android applications, with critical runs on physical or cloud devices.