background

Nationwide Test of Mobile Networks

Global Wireless Solutions conducts “consumer experience” tests in over 500 markets representing 94% of US population.

AT&T Crowned Best US Network in Largest Ever Mobile Performance Evaluation

Image

Key Findings

After months of scientific testing, collecting and analyzing millions of data points across America, we are releasing the findings of the most comprehensive study into wireless connectivity to date. The results from our evaluation (based on scientific and engineering test methods that we have been conducting and refining for over 22 years) show that AT&T has achieved the “Best Network OneScoreTM” for 2018.

Unlike other benchmarking rankings, GWS Best Network OneScore takes into account voice, packet data, video, coverage, and reliability metrics, and combines them into a single score that highlights the overall performance of each network. The testing includes results from 501 markets in all 50 states as well as Puerto Rico and the US Virgin Islands, representing 94% of Americans. In addition, the importance of each metric is weighted based on feedback from consumers across the US; feedback that focuses on those elements of network performance that matter most to Americans. By combining engineering-led test results with consumer research, GWS has created the most comprehensive evaluation ever that highlights the performance of each major network in the U.S.

Key Test Facts

Over 8 million individual controlled tests were conducted by GWS wireless network specialists in all 50 states as well as Puerto Rico and the US Virgin Islands

501 markets were tested including all US metropolitan areas as well as other cities and towns – representing 94% of US population

Nearly 1 million miles driven while testing

GWS collection and evaluation of data was conducted using specialized network test equipment, Samsung Galaxy mobile devices, GWS’ Mobistat data reporting platform, and big data analytics

Findings from the study also show:

Data Speed

Verizon edges out AT&T for for the fastest uploads for tasks like posting videos, photos and other social media content.

Video Performance

Following on from its success in previous tests, AT&T provides the best video streaming quality and quickest loading time.

Voice Performance

AT&T scores top for voice retainability (i.e. lowest number of dropped calls), while T-Mobile takes the lead for best voice quality on calls made.

Poorest Showing

Sprint is the only network not to finish first in any of the voice and data tests.

Network Observations

Through scientific testing, engineering analysis, and big data analytics, we know why one network outperforms another in certain areas. We know, for example, that T-Mobile has the best voice quality in part because of their usage of an EVS wideband codec. We’ve also observed that AT&T’s higher usage of advanced network features (such as LTE 4 channel aggregation) helps them outperform others in terms of reliability and throughputs.

Markets Tested

501 markets in total. Yellow pins represent top 25 metropolitan markets in terms of population.

 


OneScore Ranking Explained

In addition to measuring real-world network performance, GWS’ OneScore also looks at what consumers want from their wireless network in terms of data speed, coverage, video performance, voice quality and network reliability. In particular, GWS annually conducts third-party polling of 5,000 consumers across the country. As a result, by combining engineering-level testing with the results from current nationwide-level polling, GWS’ OneScore creates the most balanced picture of the mobile experience that consumers care most about today. Further, this combination of controlled, scientific testing conducted with test equipment in each market across the US along with in-depth nationwide consumer research results in the industry’s most comprehensive, realistic evaluation of network performance.

Image

Traditionally, network performance is tested by looking at factors like throughput or signal quality. This provides a good high-level overview of the state of a wireless network. But what does that mean to consumers using those networks? Would they rather be able to make a high quality call, or do they only care about fast data streaming? To truly understand how those networks are performing, it is crucial to understand consumer expectations and behavior when using their mobile devices.

More specifically, the consumer survey includes questions asking respondents to rank the importance of different tasks they perform on their mobile device, as well as the importance of different aspects of network performance. Our nationwide network test results are then weighted according to how consumers prioritize what’s important to them, and evaluated in twelve different network performance areas related to voice, data, network reliability and network coverage.

Data Collection, Processing and Analysis

GWS’ team of network testing specialists drove nearly one million miles across the US conducting scientifically controlled tests of network performance. Network specialists drove routes within specified geographic regions based on a weighted algorithm that reflects population demographics, targeting areas likely to have higher mobile usage. What this means is that GWS tested in both urban and rural areas, on major highways and minor roads – testing in areas where consumers live, work and play.

Image

GWS collection and evaluation of data was performed between January and August 2018 using specialized test equipment, Samsung Galaxy mobile devices, GWS’ Mobistat reporting system, and big data analytics. The resulting setup enables the collection of a wide array of key network and device information, from radio frequency to packet and other network engineering (layer 3) data. In addition, our testing platform enables us to perform detailed voice quality score and call testing using standard algorithms such as perceptual objective listening quality analysis; all of which helps determine network voice quality and performance.

Using this platform, GWS network testing specialists were able to run tests and collect thousands of measurements from multiple networks simultaneously (this also eliminates time and location as variables; something that cannot be done with other forms of network testing such as crowd source data collection). Over the last 22 years, we have benchmarked mobile networks of all shapes and sizes across the globe with all types of technology and features; and along the way we’ve invested millions of dollars and extensive resources in developing our collection and evaluation process. It’s a process that eliminates random, anomalous data found in other forms of network testing and it’s a process that emphasizes accuracy and “real world” consumer experience.

GWS Consumer Research

All survey figures are from a study that was commissioned by GWS and conducted by Toluna. Total sample size was 5,000 adults. The survey undertaken online in June 2018. The figures have been weighted and are representative of Americans (aged 18+).

The following are a few select highlights from the consumer survey results on mobile phone usage and network expectations. As mentioned previously, GWS’s annual consumer survey results are taken into consideration and weighted when analyzing network test results in the determination of Best Network OneScore.

Voice Calling Is Still Important

Similar to our previous surveys, making and receiving phone calls is the most common activity and considered the most important by consumers.

Phone Activities
on the Rise

This year’s survey is also showing an increase (over past surveys) in consumers using streaming video services like YouTube and Netflix as well as sending and receiving pics, using social media apps, and web browsing.

Reliability vs. Speed

Consumers find network reliability far more important than network speed. In fact, they consider it to be three times more important.