Assessing Internet performance over mobile networks: From theory to practice

The proper execution of performance tests is of utmost importance for the analysis and evaluation of Internet-related technologies, protocols and deployment strategies. There are plenty of tools available for experimenters ranging from simulation tools, emulation equipment, to small and large scale experimentation testbeds. Each of these performance evaluation frameworks introduces a series of capabilities and drawbacks. Additionally, there is a need for using a common methodology to perform different performance tests and to create comparable outcomes. Seeking for the standardization of reliable and comparable Internet speed measurements and trying to provide end-users with trustworthy measurement tools, different SDOs have standardized different measurement methodologies. This paper focuses on the applicability of the distinct measurement frameworks and methodologies in the field of mobile Internet, with special focus on the impact of using TCP over mobile broadband connections. The paper describes a series of experiments over different frameworks and, based on the obtained results, identifies the implications of the different types of performance tests into the evaluation outcomes and states the need for large scale measurements.