FingHV: Efficient Sharing and Fine-Grained Scheduling of Virtualized HPU Resources

Abstract

While artificial intelligence (AI) technology has advanced in real-world applications, there is a strong motivation to develop hybrid systems where AI algorithms and humans collaborate, promoting more human-centered approaches in AI system design. This has led to the emergence of a novel human-machine computing (HMC) paradigm, which combines human cognitive abilities with machine computational power to create a collaborative computing framework that meets the demands of large-scale, complex tasks and enables human-machine symbiosis. Human processing units (HPUs) are crucial computing resources in HMC-oriented systems, and efficient HPU resource provisioning is key to boosting system performance. However, existing schemes often fail to assign tasks to the most suitable HPUs and optimize HPU utility, as they either cannot quantitatively measure skills or overlook utility concerns during task assignment and scheduling. To address these challenges, this article proposes a fine-grained HPU virtualization (FingHV) approach, which leverages virtualization techniques to improve flexibility, fairness, and utility in the provisioning process. The core idea is to use a tree-based skill model to precisely measure the levels and correlations of multiple skills within individual HPUs, and to apply a mixed time/event-based scheduling policy to maximize HPU utility. Specifically, we begin by proposing a hierarchical multiskill tree to model HPU skills and their correlations. Next, we formulate the HPU virtualization problem and present a fine-grained virtualization method, which includes a quality-driven HPU assignment process and a mixed time/event-based scheduling policy to improve resource-sharing efficiency. Finally, we evaluate FingHV on a synthetic dataset with varying task sizes and a real-world case. The results demonstrate that FingHV improves global matching quality by up to 39.7% and increases HPU utility by 11.2% compared to the baselines.