Systemics-PAB started Orange DSBO 2021 network measurements and assessment with 5G measurements included. These drive tests of mobile networks provide to Systemic’s customers tools for maintaining the highest standards of telecommunication services quality and customer experience when using the network. The scoring mechanism embedded in the service offers the assessment of the situation and stimulates competitiveness. The year 2021, is the sixth time in row that Systemics-PAB conducts the annual assessment of mobile networks as a part of the Orange DSBO project (Data Services Benchmarking and Optimization) in Belgium, Luxemburg, Moldova, Poland, Romania, Slovakia and Spain.
The benchmarking measurements took place between July 19th and August 7th of 2021 on representative areas of Romania including cities and roads covering more than 50% of the population.The total distance covered by each of 2 drive test cars used was over 3600 km. Measurements took more than 120 hours delivering ~3500 voice service tests and ~2100 for each of data services tests. All the tests were conducted using SwissQual (Rohde&Schwarz Group) benchmarking solution installed in the roof boxes on measurement cars.
The quality assessment and the comparison between operators was done using the ETSI Technical Report 103559 Annex B approach. It fulfils market needs for open and “standardized” countrywide mobile network benchmarking and scoring. TR103599 allows to get results which are transparent about how the actual scoring has been achieved including methods and underlying assumptions. In assessing the overall performance and overall score of each mobile network, 2 main categories of services (with subcategories)have been evaluated:
- Voice services, affecting 40% of the overall score
- Data services, affecting 60% of the overall score
The experienced quality of service varies over time so that the individual score of a particular throughput cannot be fixed once and for all. In order to reflect 5G implementation values for data KPIs thresholds were adopted and bigger files were used for emulation of receiving/sending attachments (fixed size file DL/UL test).
With applied scoring methodology the highest number of points in overall scoring was achieved by Orange and was equal to 941.6 out of 1000 of maximum achievable. The other operators scored 908.2, 848.0 and 736.1. Orange got the best score in both voice and data tests and can therefore be certified as the operator with the highest overall quality of mobile services in the test.
Orange Romania presented very good results for data services achieving highest data speeds in capacity tests and shortest session times for file transfer tests. These results were possible due to the deployment of 5G NR bands in cities and use of widest bandwidth in data services tested.
More details on results could be found in the attached document.
DSBO Romania H1 2021 – Nationwide Benchmark Certificate extended version.pdf (1 MB)