Analysis of the Power and Hardware Resource Consumption of Servers under Different Load Balancing Policies

Abstract

Most Internet applications employ some kind of load balancing policies in a cluster setting to achieve reliable service provision as well as to deal with a resource bottleneck. However, these policies may not ensure the utilization of \textit{all} of the hardware resources in a server equally efficiently. This paper experimentally investigates the relationship between the power consumption and resource utilization of a multimedia server cluster when different load balancing policies are used to distribute a workload. Our observations are the following: (1) A bottleneck on a single hardware resource can lead to a significant amount of underutilization of the entire system. (2) A ten times increment in the network bandwidth of the entire cluster can double the throughput of individual servers. The associated increment in power consumption of the individual servers is 1.2% only. (3) For TCP-based applications, session information is more useful than other types of status information to utilize power more efficiently. (4) The use of dynamic frequency scaling does not affect the overall throughput of IO-bound applications but reduces the power consumption of the servers; but this reduction is only 12% of the overall power consumption. More power can be saved by avoiding a resource bottleneck or through service consolidation.