Scalable services for resource management in distributed and networked environments

Abstract

Sharing hardware and software resources among networked workstations has become common practice. Resource management in such systems is complex because of physical distribution of the resources, communication delays and the lack of global state informations. This paper describes a scalable load monitoring service and a scalable resource query service developed in the Warp project to provide necessary state information for resource management. Scalability is achieved by reducing the network traffic. Techniques include exploiting the IP multicast for one-to-many communications, using supply-driven and demand driven approaches for disseminating different classes of information, compressing information, and tailoring servers only to publish information when certain conditions are met. GUI tools, statistical analysers, and job scheduling are example clients of the services.