The German Federal Network Agency (BNetzA) is making significant changes in improving the accuracy and relevance of mobile network testing by shifting from scanners to using mobile phones. This approach aims to better reflect the real user experience, ensuring that the data collected is more representative of what consumers actually encounter in their daily lives.

Methodology and Implementation

The new testing method involves the use of eight smartphones, each equipped with standard measurement software. The devices are divided into two groups: four phones measure voice call quality, while the other four assess the available data transmission speeds on the networks of the four major mobile operators in Germany. The measurements are carried out along pre-planned routes in various representative areas, ensuring a comprehensive assessment of network performance in different environments.

One of the key advantages of this approach is its flexibility. Smartphones can be used in a variety of conditions, including urban, suburban and rural areas. In addition, BNetzA plans to introduce measurements using measurement backpacks in areas inaccessible to vehicles, such as pedestrian zones, building interiors, railway tracks and waterways. The routes will be operated by people carrying measurement backpacks on their backs.

The Shift from Scanners to Smartphones

Until now, the Regulator’s testing of mobile networks has been based on specialised scanners that measure the strength of radio signals from base stations. Although these scanners are very accurate in measuring signal strength, they do not record user experience. This is because the actual performance of mobile networks, as experienced by users, includes not only signal strength but also factors such as voice call quality, data transmission speed and the ability to maintain a stable connection during various activities such as streaming or browsing the internet.

To fill this gap, BNetzA has introduced a new measurement concept that uses standard smartphones to measure key performance indicators (KPIs) such as voice call quality and data transmission speed. By using devices that consumers use on a daily basis, BNetzA intends to collect data that is more consistent with the actual experiences of mobile network users.

Enhancing User Experience

The primary motivation behind this shift is to enhance the user experience. By focusing on the actual conditions that users face, BNetzA can provide more accurate and relevant information to both consumers and mobile network operators. This data can help operators identify and address specific issues that affect user satisfaction, such as areas with poor call quality or slow data speeds.
Moreover, the new measurement concept allows for greater transparency and accountability. States, municipalities, and service providers can use the same methodology to conduct their own measurements and share the results with BNetzA. This collaborative approach ensures that the data is comprehensive and covers the entire country, providing a clear picture of mobile network performance across Germany.

Future Prospects

The BNetzA’s approach to mobile network testing may confirm that the most reliable standard for network performance assessment by market regulators is controllable, objective active field measurements using measurement systems that reflect users’ experience of using the services. By giving high priority to user experience, the agency not only improves the quality of its data, but also promotes a more user-oriented approach to mobile network management. This may lead to better service quality and greater satisfaction among mobile phone users in Germany.

Systemics-PAB benchmark services

For more then 15 years Systemics-PAB provides services testing quality of mobile networks all around the world. The company uses up-to-date mobile phones measuring both connection quality and data transmission speed for all available radio networks. We understand and support the reasons of BNetzA’s decisions to use standard mobile phones for network testing. Chosen solution represents a significant step forward in ensuring that mobile network performance data accurately reflects the real-world experiences of users. This user-centric approach is likely to benefit both consumers and operators, leading to improved mobile services and a better overall user experience. Here are some key benefits for users:

  1. More Accurate Data: By using standardized smartphones instead of scanners, the measurements will better reflect the actual user experience. This means the data on network performance will be more accurate and relevant to everyday use.
  2. Improved Network Quality: With more precise data, mobile network operators can identify and address specific issues more effectively. This should lead to better overall network quality, including improved voice call clarity and faster data speeds.
  3. Enhanced Transparency: Users will have access to more reliable information about network performance, helping them make informed decisions when choosing a mobile service provider.
  4. Broader Coverage: The new measurement methods include plans for pedestrian backpack setups and measurements along waterways or railways, ensuring that more accessible areas are covered.

Overall, these changes are designed to ensure that the mobile network performance data is more reflective of real-world conditions, ultimately leading to a better user experience.