The year 2021, is the sixth time in row that Systemics-PAB conducts the annual assessment of mobile networks as a part of the Orange DSBO project (Data Services Benchmarking and Optimization) in Belgium, Luxemburg, Moldova, Poland, Romania, Slovakia and Spain. Orange DSBO 2021 benchmarking project included 5G measurements.
The benchmarking measurements took place between June 3rd and July 1st of 2021 on representative areas of Spain including cities and roads covering more than 50% of the population. The total distance covered by 2 drive test cars used was 11600 km. Measurements took around 170 hours delivering almost 5000 voice service tests and over 3000 for each of data services tests. All the tests were conducted using SwissQual (Rohde&Schwarz Group) benchmarking solution installed in the roof boxes on measurement cars.
The quality assessment and the comparison between operators was done using the ETSI Technical Report 103559 Annex B approach. It fulfils market needs for open and “standardized” countrywide mobile network benchmarking and scoring. TR103599 allows to get results which are transparent about how the actual scoring has been achieved including methods and underlying assumptions. In assessing the overall performance and overall score of each mobile network, 2 main categories of services (with subcategories)have been evaluated:
• Voice services, affecting 40% of the overall score
• Data services, affecting 60% of the overall score
The experienced quality of service varies over time so that the individual score of a particular throughput cannot be fixed once and for all. In order to reflect 5G implementation values for data KPIs thresholds were adopted and bigger files were used for emulation of receiving/sending attachments (fixed size file DL/UL test).
With applied scoring methodology the highest number of points in overall scoring was achieved by Orange and was equal to 912.0 out of 1000 of maximum achievable. The other operators scored 910.9, 890.6 and 774.3.
More details on results could be found in the attached document.
DSBO Spain H1 2021 – Nationwide Benchmark Certificate extended version (1.1 MB)
