利用注意力增强型 ResNets 预测星系形态

IF 2.7 4区 地球科学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Earth Science Informatics Pub Date : 2024-08-24 DOI:10.1007/s12145-024-01449-6
Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal
{"title":"利用注意力增强型 ResNets 预测星系形态","authors":"Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal","doi":"10.1007/s12145-024-01449-6","DOIUrl":null,"url":null,"abstract":"<p>The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.</p>","PeriodicalId":49318,"journal":{"name":"Earth Science Informatics","volume":null,"pages":null},"PeriodicalIF":2.7000,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predicting galaxy morphology using attention-enhanced ResNets\",\"authors\":\"Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal\",\"doi\":\"10.1007/s12145-024-01449-6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.</p>\",\"PeriodicalId\":49318,\"journal\":{\"name\":\"Earth Science Informatics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-08-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Earth Science Informatics\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s12145-024-01449-6\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Earth Science Informatics","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s12145-024-01449-6","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

根据形态对星系进行分类的做法是存在的,它提供了有关宇宙产生和发展的重要细节。传统的视觉检测技术非常主观且耗时。然而,由于深度学习技术的进步,现在可以更准确地对星系进行分类。深度学习已在星系分类研究中展现出相当大的潜力,并为星系的起源和演化提供了全新的视角。所建议的方法采用基于迁移学习的残差网络(Residual Networks)进行分类。为了提高残差网络的准确性,还加入了注意力机制。在研究中,我们使用了两个相对较浅的 ResNet 模型 ResNet18 和 ResNet50,并在其中加入了软注意力机制。所提出的方法在 Kaggle 的 Galaxy Zoo 数据集上进行了验证。ResNet18的准确率从60.15%提高到80.20%,ResNet50的准确率从78.21%提高到80.55%,这表明所提出的方法与更为复杂的ResNet152模型的准确率相当。我们发现,即使是浅层模型,注意力机制也能成功提高其准确性,这对未来图像识别任务的研究具有重要意义。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Predicting galaxy morphology using attention-enhanced ResNets

The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Earth Science Informatics
Earth Science Informatics COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-GEOSCIENCES, MULTIDISCIPLINARY
CiteScore
4.60
自引率
3.60%
发文量
157
审稿时长
4.3 months
期刊介绍: The Earth Science Informatics [ESIN] journal aims at rapid publication of high-quality, current, cutting-edge, and provocative scientific work in the area of Earth Science Informatics as it relates to Earth systems science and space science. This includes articles on the application of formal and computational methods, computational Earth science, spatial and temporal analyses, and all aspects of computer applications to the acquisition, storage, processing, interchange, and visualization of data and information about the materials, properties, processes, features, and phenomena that occur at all scales and locations in the Earth system’s five components (atmosphere, hydrosphere, geosphere, biosphere, cryosphere) and in space (see "About this journal" for more detail). The quarterly journal publishes research, methodology, and software articles, as well as editorials, comments, and book and software reviews. Review articles of relevant findings, topics, and methodologies are also considered.
期刊最新文献
Estimation of the elastic modulus of basaltic rocks using machine learning methods Feature-adaptive FPN with multiscale context integration for underwater object detection Autoregressive modelling of tropospheric radio refractivity over selected locations in tropical Nigeria using artificial neural network Time series land subsidence monitoring and prediction based on SBAS-InSAR and GeoTemporal transformer model Drought index time series forecasting via three-in-one machine learning concept for the Euphrates basin
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1