Ibrahim Taabane;Daniel Menard;Anass Mansouri;Selima Sahraoui;Ali Ahaitouf
{"title":"Low Complexity Learning-Based QTMTT Partitioning Scheme for Inter Coding in VVC Encoder","authors":"Ibrahim Taabane;Daniel Menard;Anass Mansouri;Selima Sahraoui;Ali Ahaitouf","doi":"10.1109/ACCESS.2024.3469089","DOIUrl":null,"url":null,"abstract":"The Versatile Video Coding (VVC) standard, finalized in 2020 by the Joint Video Experts Team (JVET) and the Video Coding Experts Group (VCEG), marks a major advancement in video compression technology, offering a 50% efficiency improvement over its predecessor, the High-Efficiency Video Coding (HEVC) standard. A key innovation in the VVC standard is the Quad Tree with nested Multi-Type Tree (QTMTT) structure, essential for the partitioning process. However, this enhancement has led to increased coding complexity, posing challenges for real-time applications. To address this, our paper focuses on optimizing the partitioning process in the VVC encoder under the Random Access (RA) configuration. We propose a novel approach that leverages inter-prediction by integrating both coding and motion information across inter-frames to enhance coding efficiency. This solution is implemented on the Fraunhofer Versatile Video Encoder (VVenC). It utilizes a set of lightweight Light Gradient Boosting Machine (LightGBM) binary classifiers to accurately predict the optimal split mode for each Coding Unit (CU). Consequently, our approach significantly accelerates the VVenC encoding process. Experimental results show that our method reduces the runtime of the slower preset by 43.21%, with only a slight bitrate increase of 2.9%. These improvements not only significantly reduce computational complexity but also outperform several existing state-of-the-art methods.","PeriodicalId":13079,"journal":{"name":"IEEE Access","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10697171","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Access","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10697171/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The Versatile Video Coding (VVC) standard, finalized in 2020 by the Joint Video Experts Team (JVET) and the Video Coding Experts Group (VCEG), marks a major advancement in video compression technology, offering a 50% efficiency improvement over its predecessor, the High-Efficiency Video Coding (HEVC) standard. A key innovation in the VVC standard is the Quad Tree with nested Multi-Type Tree (QTMTT) structure, essential for the partitioning process. However, this enhancement has led to increased coding complexity, posing challenges for real-time applications. To address this, our paper focuses on optimizing the partitioning process in the VVC encoder under the Random Access (RA) configuration. We propose a novel approach that leverages inter-prediction by integrating both coding and motion information across inter-frames to enhance coding efficiency. This solution is implemented on the Fraunhofer Versatile Video Encoder (VVenC). It utilizes a set of lightweight Light Gradient Boosting Machine (LightGBM) binary classifiers to accurately predict the optimal split mode for each Coding Unit (CU). Consequently, our approach significantly accelerates the VVenC encoding process. Experimental results show that our method reduces the runtime of the slower preset by 43.21%, with only a slight bitrate increase of 2.9%. These improvements not only significantly reduce computational complexity but also outperform several existing state-of-the-art methods.
IEEE AccessCOMPUTER SCIENCE, INFORMATION SYSTEMSENGIN-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
9.80
自引率
7.70%
发文量
6673
审稿时长
6 weeks
期刊介绍:
IEEE Access® is a multidisciplinary, open access (OA), applications-oriented, all-electronic archival journal that continuously presents the results of original research or development across all of IEEE''s fields of interest.
IEEE Access will publish articles that are of high interest to readers, original, technically correct, and clearly presented. Supported by author publication charges (APC), its hallmarks are a rapid peer review and publication process with open access to all readers. Unlike IEEE''s traditional Transactions or Journals, reviews are "binary", in that reviewers will either Accept or Reject an article in the form it is submitted in order to achieve rapid turnaround. Especially encouraged are submissions on:
Multidisciplinary topics, or applications-oriented articles and negative results that do not fit within the scope of IEEE''s traditional journals.
Practical articles discussing new experiments or measurement techniques, interesting solutions to engineering.
Development of new or improved fabrication or manufacturing techniques.
Reviews or survey articles of new or evolving fields oriented to assist others in understanding the new area.