A Fast CU Partition Algorithm for AVS3 Based on Adaptive Tree Search and Pruning Optimization

Abstract

In the third generation of the Audio Video Coding Standard (AVS3), the size of Coding Tree Units (CTUs) has been expanded to four times larger than the previous generation, and more Coding Unit (CU) partition modes have been introduced, enhancing adaptability and efficiency in video encoding. CU partition in AVS3 not only brings improvements in encoding performance but also significantly increases the computational complexity, posing substantial challenges to real-time encoding. We propose a fast algorithm for CU partition, which features adaptive tree search and pruning optimization. Firstly, it adjusts the tree search order based on neighbor CU and lookahead information. Specifically, the analysis order of sub-blocks and parent blocks is adaptively adjusted: the potential optimal partition is prioritized, the non-optimal partitions are deferred, and an optimized order of first-full-then-sub or first-sub-then-full is selected. Secondly, the pruning optimization algorithm utilizes analyzed information to skip non-optimal partitions to reduce computational complexity. Due to the adjusted tree search order and the prioritization of potential optimal partitions, more analyzed information becomes available when evaluating non-optimal partitions, thereby improving the recall and precision rates of non-optimal partitions detection, saving more time, and introducing negligible loss in coding performance. The proposed algorithm has been implemented in the open-source encoder uavs3e. Experimental results indicate that under the three encoding configurations of AI, LD B, and RA, the algorithm achieves significant time saving of 51.41%, 40.57%, and 40.57%, with BDBR increases of 0.64%, 1.61%, and 1.04%, respectively. These results outperform the state-of-the-art fast CU partition algorithms.