{"title":"Using explainable deep learning in da Vinci Xi robot for tumor detection","authors":"Rohan Ibn Azad, S. Mukhopadhyay, M. Asadnia","doi":"10.21307/ijssis-2021-017","DOIUrl":null,"url":null,"abstract":"Abstract Deep learning has proved successful in computer-aided detection in interpreting ultrasound images, COVID infections, identifying tumors from computed tomography (CT) scans for humans and animals. This paper proposes applications of deep learning in detecting cancerous cells inside patients via laparoscopic camera on da Vinci Xi surgical robots. The paper presents method for detecting tumor via object detection and classification/localizing using GRAD-CAM. Localization means heat map is drawn on the image highlighting the classified class. Analyzing images collected from publicly available partial robotic nephrectomy videos, for object detection, the final mAP was 0.974 and for classification the accuracy was 0.84.","PeriodicalId":45623,"journal":{"name":"International Journal on Smart Sensing and Intelligent Systems","volume":"14 1","pages":"1 - 16"},"PeriodicalIF":0.5000,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal on Smart Sensing and Intelligent Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21307/ijssis-2021-017","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract Deep learning has proved successful in computer-aided detection in interpreting ultrasound images, COVID infections, identifying tumors from computed tomography (CT) scans for humans and animals. This paper proposes applications of deep learning in detecting cancerous cells inside patients via laparoscopic camera on da Vinci Xi surgical robots. The paper presents method for detecting tumor via object detection and classification/localizing using GRAD-CAM. Localization means heat map is drawn on the image highlighting the classified class. Analyzing images collected from publicly available partial robotic nephrectomy videos, for object detection, the final mAP was 0.974 and for classification the accuracy was 0.84.
期刊介绍:
nternational Journal on Smart Sensing and Intelligent Systems (S2IS) is a rapid and high-quality international forum wherein academics, researchers and practitioners may publish their high-quality, original, and state-of-the-art papers describing theoretical aspects, system architectures, analysis and design techniques, and implementation experiences in intelligent sensing technologies. The journal publishes articles reporting substantive results on a wide range of smart sensing approaches applied to variety of domain problems, including but not limited to: Ambient Intelligence and Smart Environment Analysis, Evaluation, and Test of Smart Sensors Intelligent Management of Sensors Fundamentals of Smart Sensing Principles and Mechanisms Materials and its Applications for Smart Sensors Smart Sensing Applications, Hardware, Software, Systems, and Technologies Smart Sensors in Multidisciplinary Domains and Problems Smart Sensors in Science and Engineering Smart Sensors in Social Science and Humanity