A comparative study of H.264 and AVS-M fast intra mode decision

Abstract

In this paper, we first introduced SKIP mode decision at early stage. And then, compared the H.264 and AVS-M fast intra mode decision. For H.264, by making use of the edge direction histogram, the number of mode combinations for luma and chroma blocks in a MB that take part in RDO calculation has been reduced significantly from 592 to as low as 132. For AVS-M, we got a statistical order list of the best mode based on the Most_Probable_Mode. By using this list, we get an order to evaluate if a mode is the best mode or not. Experimental results show that these methods speed up the encoding process without loss of coding PSNR and bitrate efficiency.