Yan Tian, Hanshi Fu, Hao Wang, Yuqi Liu, Zhaocheng Xu, Hong Chen, Jianyuan Li, Ruili Wang
{"title":"RGB oralscan video-based orthodontic treatment monitoring","authors":"Yan Tian, Hanshi Fu, Hao Wang, Yuqi Liu, Zhaocheng Xu, Hong Chen, Jianyuan Li, Ruili Wang","doi":"10.1007/s11432-023-3847-x","DOIUrl":null,"url":null,"abstract":"<h3>Abstract</h3> <p>Orthodontic treatment monitoring involves using current images and previous 3D models to estimate the relative position of individual teeth before and after orthodontic treatment. This process differs from image-based object 6D pose estimation due to the gingiva deformation and varying pose offsets for each tooth during treatment. Motivated by the fact that the poses of molars remain relatively fixed in implicit orthodontics, we design an approach that employs multiview pose evaluation and bidirectional temporal propagation for jaw pose estimation and then employs an iteration-based method for tooth alignment. To handle changes in tooth appearance or location with weak texture across frames, we also introduce an instance propagation module that leverages positional and semantic information to explore instance relations in the temporal domain. We evaluated the performance of our approach using both the Shining3D tooth pose dataset and the Aoralscan3 tooth registration dataset. Our experimental results demonstrate remarkable accuracy improvements compared with existing methods.</p>","PeriodicalId":21618,"journal":{"name":"Science China Information Sciences","volume":"29 1","pages":""},"PeriodicalIF":7.3000,"publicationDate":"2023-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science China Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11432-023-3847-x","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Orthodontic treatment monitoring involves using current images and previous 3D models to estimate the relative position of individual teeth before and after orthodontic treatment. This process differs from image-based object 6D pose estimation due to the gingiva deformation and varying pose offsets for each tooth during treatment. Motivated by the fact that the poses of molars remain relatively fixed in implicit orthodontics, we design an approach that employs multiview pose evaluation and bidirectional temporal propagation for jaw pose estimation and then employs an iteration-based method for tooth alignment. To handle changes in tooth appearance or location with weak texture across frames, we also introduce an instance propagation module that leverages positional and semantic information to explore instance relations in the temporal domain. We evaluated the performance of our approach using both the Shining3D tooth pose dataset and the Aoralscan3 tooth registration dataset. Our experimental results demonstrate remarkable accuracy improvements compared with existing methods.
期刊介绍:
Science China Information Sciences is a dedicated journal that showcases high-quality, original research across various domains of information sciences. It encompasses Computer Science & Technologies, Control Science & Engineering, Information & Communication Engineering, Microelectronics & Solid-State Electronics, and Quantum Information, providing a platform for the dissemination of significant contributions in these fields.