{"title":"基于多尺度融合关注机制的胆囊癌微高光谱图像分类方法","authors":"Hongmin Gao, Zhu Min, Xueying Cao, Chenming Li, Liu Qin, Peipei Xu","doi":"10.11834/jig.211201","DOIUrl":null,"url":null,"abstract":": Objective Gallbladder carcinoma is recognized as one of the most malignant tumors in relevant to biliary sys⁃ tem. Its prognosis is extremely poor , and only 6 months of overall average. It is challenged for missed diagnose because of the lack of typical clinical manifestations in early stage of gallbladder cancer. To clarify gallbladder lesions for early detec⁃ tion of gallbladder carcinoma accurately , current gallbladder cancer - related diagnosis is mainly focused on the interpreta⁃ tion of digital pathological section images ( such as b - ultrasound , computed tomography ( CT ), magnetic resonance imaging ( MRI ), etc. ) in terms of the computer - aided diagnosis ( CAD ) . However , the accuracy is quite lower because the molecu⁃ lar level information of diseased organs cannot be obtained. Micro - hyperspectral technology can be incorporated the fea⁃ tures of spectral analysis and optical imaging , and it can obtain the chemical composition and physical features for biologi⁃ cal tissue samples at the same time. The changes of physical attributes of cancerous tissue may not be clear in the early stage , but the changes of chemical factors like its composition , structure and content can be reflected by spectral informa⁃ tion. Therefore , micro hyperspectral imaging has its potentials to achieve the early diagnosis of cancer more accurately. Micro - hyperspectral technology , as a special optical diagnosis technology , can provide an effective auxiliary diagnosis method for clinical research. However , it can provide richer spectral information but large amount of data and information redundancy are increased. To develop an improved accuracy detection method and use the rich spatial and hyperspectral information effectively , we design a multi - scale fusion attention mechanism - relevant network model for gallbladder cancer - oriented classification accuracy optimization. Method The multiscale squeeze - and - excitation - residual ( MSE - Res ) can be used to realize the fusion of multiscale features between channel dimensions. First , an improved multi - scale feature extrac⁃ tion module is employed to extract features of different scales in channel dimension. To extract the salient features of the image a maximum pooled layer , an upper sampling layer is used beyond convolution layer of 1 × 1. To compensate for the","PeriodicalId":36336,"journal":{"name":"中国图象图形学报","volume":"6 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A micro-hyperspectral image classification method of gallbladder cancer based on multi-scale fusion attention mechanism\",\"authors\":\"Hongmin Gao, Zhu Min, Xueying Cao, Chenming Li, Liu Qin, Peipei Xu\",\"doi\":\"10.11834/jig.211201\",\"DOIUrl\":null,\"url\":null,\"abstract\":\": Objective Gallbladder carcinoma is recognized as one of the most malignant tumors in relevant to biliary sys⁃ tem. Its prognosis is extremely poor , and only 6 months of overall average. It is challenged for missed diagnose because of the lack of typical clinical manifestations in early stage of gallbladder cancer. To clarify gallbladder lesions for early detec⁃ tion of gallbladder carcinoma accurately , current gallbladder cancer - related diagnosis is mainly focused on the interpreta⁃ tion of digital pathological section images ( such as b - ultrasound , computed tomography ( CT ), magnetic resonance imaging ( MRI ), etc. ) in terms of the computer - aided diagnosis ( CAD ) . However , the accuracy is quite lower because the molecu⁃ lar level information of diseased organs cannot be obtained. Micro - hyperspectral technology can be incorporated the fea⁃ tures of spectral analysis and optical imaging , and it can obtain the chemical composition and physical features for biologi⁃ cal tissue samples at the same time. The changes of physical attributes of cancerous tissue may not be clear in the early stage , but the changes of chemical factors like its composition , structure and content can be reflected by spectral informa⁃ tion. Therefore , micro hyperspectral imaging has its potentials to achieve the early diagnosis of cancer more accurately. Micro - hyperspectral technology , as a special optical diagnosis technology , can provide an effective auxiliary diagnosis method for clinical research. However , it can provide richer spectral information but large amount of data and information redundancy are increased. To develop an improved accuracy detection method and use the rich spatial and hyperspectral information effectively , we design a multi - scale fusion attention mechanism - relevant network model for gallbladder cancer - oriented classification accuracy optimization. Method The multiscale squeeze - and - excitation - residual ( MSE - Res ) can be used to realize the fusion of multiscale features between channel dimensions. First , an improved multi - scale feature extrac⁃ tion module is employed to extract features of different scales in channel dimension. To extract the salient features of the image a maximum pooled layer , an upper sampling layer is used beyond convolution layer of 1 × 1. To compensate for the\",\"PeriodicalId\":36336,\"journal\":{\"name\":\"中国图象图形学报\",\"volume\":\"6 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"中国图象图形学报\",\"FirstCategoryId\":\"1093\",\"ListUrlMain\":\"https://doi.org/10.11834/jig.211201\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"中国图象图形学报","FirstCategoryId":"1093","ListUrlMain":"https://doi.org/10.11834/jig.211201","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Computer Science","Score":null,"Total":0}
A micro-hyperspectral image classification method of gallbladder cancer based on multi-scale fusion attention mechanism
: Objective Gallbladder carcinoma is recognized as one of the most malignant tumors in relevant to biliary sys⁃ tem. Its prognosis is extremely poor , and only 6 months of overall average. It is challenged for missed diagnose because of the lack of typical clinical manifestations in early stage of gallbladder cancer. To clarify gallbladder lesions for early detec⁃ tion of gallbladder carcinoma accurately , current gallbladder cancer - related diagnosis is mainly focused on the interpreta⁃ tion of digital pathological section images ( such as b - ultrasound , computed tomography ( CT ), magnetic resonance imaging ( MRI ), etc. ) in terms of the computer - aided diagnosis ( CAD ) . However , the accuracy is quite lower because the molecu⁃ lar level information of diseased organs cannot be obtained. Micro - hyperspectral technology can be incorporated the fea⁃ tures of spectral analysis and optical imaging , and it can obtain the chemical composition and physical features for biologi⁃ cal tissue samples at the same time. The changes of physical attributes of cancerous tissue may not be clear in the early stage , but the changes of chemical factors like its composition , structure and content can be reflected by spectral informa⁃ tion. Therefore , micro hyperspectral imaging has its potentials to achieve the early diagnosis of cancer more accurately. Micro - hyperspectral technology , as a special optical diagnosis technology , can provide an effective auxiliary diagnosis method for clinical research. However , it can provide richer spectral information but large amount of data and information redundancy are increased. To develop an improved accuracy detection method and use the rich spatial and hyperspectral information effectively , we design a multi - scale fusion attention mechanism - relevant network model for gallbladder cancer - oriented classification accuracy optimization. Method The multiscale squeeze - and - excitation - residual ( MSE - Res ) can be used to realize the fusion of multiscale features between channel dimensions. First , an improved multi - scale feature extrac⁃ tion module is employed to extract features of different scales in channel dimension. To extract the salient features of the image a maximum pooled layer , an upper sampling layer is used beyond convolution layer of 1 × 1. To compensate for the
中国图象图形学报Computer Science-Computer Graphics and Computer-Aided Design
CiteScore
1.20
自引率
0.00%
发文量
6776
期刊介绍:
Journal of Image and Graphics (ISSN 1006-8961, CN 11-3758/TB, CODEN ZTTXFZ) is an authoritative academic journal supervised by the Chinese Academy of Sciences and co-sponsored by the Institute of Space and Astronautical Information Innovation of the Chinese Academy of Sciences (ISIAS), the Chinese Society of Image and Graphics (CSIG), and the Beijing Institute of Applied Physics and Computational Mathematics (BIAPM). The journal integrates high-tech theories, technical methods and industrialisation of applied research results in computer image graphics, and mainly publishes innovative and high-level scientific research papers on basic and applied research in image graphics science and its closely related fields. The form of papers includes reviews, technical reports, project progress, academic news, new technology reviews, new product introduction and industrialisation research. The content covers a wide range of fields such as image analysis and recognition, image understanding and computer vision, computer graphics, virtual reality and augmented reality, system simulation, animation, etc., and theme columns are opened according to the research hotspots and cutting-edge topics.
Journal of Image and Graphics reaches a wide range of readers, including scientific and technical personnel, enterprise supervisors, and postgraduates and college students of colleges and universities engaged in the fields of national defence, military, aviation, aerospace, communications, electronics, automotive, agriculture, meteorology, environmental protection, remote sensing, mapping, oil field, construction, transportation, finance, telecommunications, education, medical care, film and television, and art.
Journal of Image and Graphics is included in many important domestic and international scientific literature database systems, including EBSCO database in the United States, JST database in Japan, Scopus database in the Netherlands, China Science and Technology Thesis Statistics and Analysis (Annual Research Report), China Science Citation Database (CSCD), China Academic Journal Network Publishing Database (CAJD), and China Academic Journal Network Publishing Database (CAJD). China Science Citation Database (CSCD), China Academic Journals Network Publishing Database (CAJD), China Academic Journal Abstracts, Chinese Science Abstracts (Series A), China Electronic Science Abstracts, Chinese Core Journals Abstracts, Chinese Academic Journals on CD-ROM, and China Academic Journals Comprehensive Evaluation Database.