Hassan Rasheed, Reuben Dorent, Maximilian Fehrentz, Daniil Morozov, Tina Kapur, William M Wells, Alexandra Golby, Sarah Frisken, Julia A Schnabel, Nazim Haouchine
{"title":"学习术前磁共振和术中超声的二维关键点匹配。","authors":"Hassan Rasheed, Reuben Dorent, Maximilian Fehrentz, Daniil Morozov, Tina Kapur, William M Wells, Alexandra Golby, Sarah Frisken, Julia A Schnabel, Nazim Haouchine","doi":"10.1007/978-3-031-73647-6_8","DOIUrl":null,"url":null,"abstract":"<p><p>We propose in this paper a texture-invariant 2D keypoints descriptor specifically designed for matching preoperative Magnetic Resonance (MR) images with intraoperative Ultrasound (US) images. We introduce a <i>matching-by-synthesis</i> strategy, where intraoperative US images are synthesized from MR images accounting for multiple MR modalities and intraoperative US variability. We build our training set by enforcing keypoints localization over all images then train a patient-specific descriptor network that learns texture-invariant discriminant features in a supervised contrastive manner, leading to robust keypoints descriptors. Our experiments on real cases with ground truth show the effectiveness of the proposed approach, outperforming the state-of-the-art methods and achieving 80.35% matching precision on average.</p>","PeriodicalId":520353,"journal":{"name":"Simplifying medical ultrasound : 5th international workshop, ASMUS 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, proceedings. ASMUS (Workshop) (5th : 2024 : Marrakech, Morocco)","volume":"15186 ","pages":"78-87"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11682695/pdf/","citationCount":"0","resultStr":"{\"title\":\"Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasound.\",\"authors\":\"Hassan Rasheed, Reuben Dorent, Maximilian Fehrentz, Daniil Morozov, Tina Kapur, William M Wells, Alexandra Golby, Sarah Frisken, Julia A Schnabel, Nazim Haouchine\",\"doi\":\"10.1007/978-3-031-73647-6_8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We propose in this paper a texture-invariant 2D keypoints descriptor specifically designed for matching preoperative Magnetic Resonance (MR) images with intraoperative Ultrasound (US) images. We introduce a <i>matching-by-synthesis</i> strategy, where intraoperative US images are synthesized from MR images accounting for multiple MR modalities and intraoperative US variability. We build our training set by enforcing keypoints localization over all images then train a patient-specific descriptor network that learns texture-invariant discriminant features in a supervised contrastive manner, leading to robust keypoints descriptors. Our experiments on real cases with ground truth show the effectiveness of the proposed approach, outperforming the state-of-the-art methods and achieving 80.35% matching precision on average.</p>\",\"PeriodicalId\":520353,\"journal\":{\"name\":\"Simplifying medical ultrasound : 5th international workshop, ASMUS 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, proceedings. ASMUS (Workshop) (5th : 2024 : Marrakech, Morocco)\",\"volume\":\"15186 \",\"pages\":\"78-87\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11682695/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Simplifying medical ultrasound : 5th international workshop, ASMUS 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, proceedings. ASMUS (Workshop) (5th : 2024 : Marrakech, Morocco)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-73647-6_8\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/10/5 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Simplifying medical ultrasound : 5th international workshop, ASMUS 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, proceedings. ASMUS (Workshop) (5th : 2024 : Marrakech, Morocco)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-73647-6_8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/5 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasound.
We propose in this paper a texture-invariant 2D keypoints descriptor specifically designed for matching preoperative Magnetic Resonance (MR) images with intraoperative Ultrasound (US) images. We introduce a matching-by-synthesis strategy, where intraoperative US images are synthesized from MR images accounting for multiple MR modalities and intraoperative US variability. We build our training set by enforcing keypoints localization over all images then train a patient-specific descriptor network that learns texture-invariant discriminant features in a supervised contrastive manner, leading to robust keypoints descriptors. Our experiments on real cases with ground truth show the effectiveness of the proposed approach, outperforming the state-of-the-art methods and achieving 80.35% matching precision on average.