Taking Artificial Intelligence Into Space Through Objective Selection of Hyperspectral Earth Observation Applications: To bring the “brain” close to the “eyes” of satellite missions
Agata M. Wijata, Michel-François Foulon, Yves Bobichon, R. Vitulli, M. Celesti, R. Camarero, Gianluigi Di Cosimo, F. Gascon, N. Longépé, J. Nieke, Michal Gumiela, J. Nalepa
{"title":"Taking Artificial Intelligence Into Space Through Objective Selection of Hyperspectral Earth Observation Applications: To bring the “brain” close to the “eyes” of satellite missions","authors":"Agata M. Wijata, Michel-François Foulon, Yves Bobichon, R. Vitulli, M. Celesti, R. Camarero, Gianluigi Di Cosimo, F. Gascon, N. Longépé, J. Nieke, Michal Gumiela, J. Nalepa","doi":"10.1109/MGRS.2023.3269979","DOIUrl":null,"url":null,"abstract":"Recent advances in remote sensing hyperspectral imaging and artificial intelligence (AI) bring exciting opportunities to various fields of science and industry that can directly benefit from in-orbit data processing. Taking AI into space may accelerate the response to various events, as massively large raw hyperspectral images (HSIs) can be turned into useful information onboard a satellite; hence, the images’ transfer to the ground becomes much faster and offers enormous scalability of AI solutions to areas across the globe. However, there are numerous challenges related to hardware and energy constraints, resource frugality of (deep) machine learning models, availability of ground truth data, and building trust in AI-based solutions. Unbiased, objective, and interpretable selection of an AI application is of paramount importance for emerging missions, as it influences all aspects of satellite design and operation. In this article, we tackle this issue and introduce a quantifiable procedure for objectively assessing potential AI applications considered for onboard deployment. To prove the flexibility of the suggested technique, we utilize the approach to evaluate AI applications for two fundamentally different missions: the Copernicus Hyperspectral Imaging Mission for the Environment (CHIME) [European Union/European Space Agency (ESA)] and the 6U nanosatellite Intuition-1 (KP Labs). We believe that our standardized process may become an important tool for maximizing the outcome of Earth observation (EO) missions through selecting the most relevant onboard AI applications in terms of scientific and industrial outcomes.","PeriodicalId":48660,"journal":{"name":"IEEE Geoscience and Remote Sensing Magazine","volume":"11 1","pages":"10-39"},"PeriodicalIF":16.2000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Geoscience and Remote Sensing Magazine","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1109/MGRS.2023.3269979","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOCHEMISTRY & GEOPHYSICS","Score":null,"Total":0}
引用次数: 2
Abstract
Recent advances in remote sensing hyperspectral imaging and artificial intelligence (AI) bring exciting opportunities to various fields of science and industry that can directly benefit from in-orbit data processing. Taking AI into space may accelerate the response to various events, as massively large raw hyperspectral images (HSIs) can be turned into useful information onboard a satellite; hence, the images’ transfer to the ground becomes much faster and offers enormous scalability of AI solutions to areas across the globe. However, there are numerous challenges related to hardware and energy constraints, resource frugality of (deep) machine learning models, availability of ground truth data, and building trust in AI-based solutions. Unbiased, objective, and interpretable selection of an AI application is of paramount importance for emerging missions, as it influences all aspects of satellite design and operation. In this article, we tackle this issue and introduce a quantifiable procedure for objectively assessing potential AI applications considered for onboard deployment. To prove the flexibility of the suggested technique, we utilize the approach to evaluate AI applications for two fundamentally different missions: the Copernicus Hyperspectral Imaging Mission for the Environment (CHIME) [European Union/European Space Agency (ESA)] and the 6U nanosatellite Intuition-1 (KP Labs). We believe that our standardized process may become an important tool for maximizing the outcome of Earth observation (EO) missions through selecting the most relevant onboard AI applications in terms of scientific and industrial outcomes.
期刊介绍:
The IEEE Geoscience and Remote Sensing Magazine (GRSM) serves as an informative platform, keeping readers abreast of activities within the IEEE GRS Society, its technical committees, and chapters. In addition to updating readers on society-related news, GRSM plays a crucial role in educating and informing its audience through various channels. These include:Technical Papers,International Remote Sensing Activities,Contributions on Education Activities,Industrial and University Profiles,Conference News,Book Reviews,Calendar of Important Events.