{"title":"使用改进的交叉验证 LGBM 对航空事故原因进行分类","authors":"Xiaomei Ni, Huawei Wang, Lingzi Chen, Ruiguan Lin","doi":"10.23919/jsee.2024.000035","DOIUrl":null,"url":null,"abstract":"Aviation accidents are currently one of the leading causes of significant injuries and deaths worldwide. This entices researchers to investigate aircraft safety using data analysis approaches based on an advanced machine learning algorithm. To assess aviation safety and identify the causes of incidents, a classification model with light gradient boosting machine (LGBM) based on the aviation safety reporting system (ASRS) has been developed. It is improved by k-fold cross-validation with hybrid sampling model (HSCV), which may boost classification performance and maintain data balance. The results show that employing the LGBM-HSCV model can significantly improve accuracy while alleviating data imbalance. Vertical comparison with other cross-validation (CV) methods and lateral comparison with different fold times comprise the comparative approach. Aside from the comparison, two further CV approaches based on the improved method in this study are discussed: one with a different sampling and folding order, and the other with more CV. According to the assessment indices with different methods, the LGBM-HSCV model proposed here is effective at detecting incident causes. The improved model for imbalanced data categorization proposed may serve as a point of reference for similar data processing, and the model's accurate identification of civil aviation incident causes can assist to improve civil aviation safety.","PeriodicalId":50030,"journal":{"name":"Journal of Systems Engineering and Electronics","volume":"41 1","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Classification of Aviation Incident Causes using LGBM with Improved Cross-Validation\",\"authors\":\"Xiaomei Ni, Huawei Wang, Lingzi Chen, Ruiguan Lin\",\"doi\":\"10.23919/jsee.2024.000035\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aviation accidents are currently one of the leading causes of significant injuries and deaths worldwide. This entices researchers to investigate aircraft safety using data analysis approaches based on an advanced machine learning algorithm. To assess aviation safety and identify the causes of incidents, a classification model with light gradient boosting machine (LGBM) based on the aviation safety reporting system (ASRS) has been developed. It is improved by k-fold cross-validation with hybrid sampling model (HSCV), which may boost classification performance and maintain data balance. The results show that employing the LGBM-HSCV model can significantly improve accuracy while alleviating data imbalance. Vertical comparison with other cross-validation (CV) methods and lateral comparison with different fold times comprise the comparative approach. Aside from the comparison, two further CV approaches based on the improved method in this study are discussed: one with a different sampling and folding order, and the other with more CV. According to the assessment indices with different methods, the LGBM-HSCV model proposed here is effective at detecting incident causes. The improved model for imbalanced data categorization proposed may serve as a point of reference for similar data processing, and the model's accurate identification of civil aviation incident causes can assist to improve civil aviation safety.\",\"PeriodicalId\":50030,\"journal\":{\"name\":\"Journal of Systems Engineering and Electronics\",\"volume\":\"41 1\",\"pages\":\"\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-05-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Systems Engineering and Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.23919/jsee.2024.000035\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Systems Engineering and Electronics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.23919/jsee.2024.000035","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
航空事故是目前造成全球重大伤亡的主要原因之一。这促使研究人员使用基于先进机器学习算法的数据分析方法来研究飞机安全问题。为了评估航空安全并找出事故原因,我们开发了一种基于航空安全报告系统(ASRS)的轻梯度提升机(LGBM)分类模型。该模型通过混合采样模型(HSCV)的 k 倍交叉验证进行了改进,从而提高了分类性能并保持了数据平衡。结果表明,采用 LGBM-HSCV 模型可以显著提高准确率,同时缓解数据不平衡问题。比较方法包括与其他交叉验证(CV)方法的纵向比较以及与不同折叠时间的横向比较。除了比较之外,还讨论了基于本研究改进方法的两种进一步的 CV 方法:一种是采用不同的采样和折叠顺序,另一种是采用更多的 CV。根据不同方法的评估指数,本文提出的 LGBM-HSCV 模型能有效检测事件原因。所提出的不平衡数据分类改进模型可作为类似数据处理的参考,该模型对民航事故原因的准确识别有助于提高民航安全。
Classification of Aviation Incident Causes using LGBM with Improved Cross-Validation
Aviation accidents are currently one of the leading causes of significant injuries and deaths worldwide. This entices researchers to investigate aircraft safety using data analysis approaches based on an advanced machine learning algorithm. To assess aviation safety and identify the causes of incidents, a classification model with light gradient boosting machine (LGBM) based on the aviation safety reporting system (ASRS) has been developed. It is improved by k-fold cross-validation with hybrid sampling model (HSCV), which may boost classification performance and maintain data balance. The results show that employing the LGBM-HSCV model can significantly improve accuracy while alleviating data imbalance. Vertical comparison with other cross-validation (CV) methods and lateral comparison with different fold times comprise the comparative approach. Aside from the comparison, two further CV approaches based on the improved method in this study are discussed: one with a different sampling and folding order, and the other with more CV. According to the assessment indices with different methods, the LGBM-HSCV model proposed here is effective at detecting incident causes. The improved model for imbalanced data categorization proposed may serve as a point of reference for similar data processing, and the model's accurate identification of civil aviation incident causes can assist to improve civil aviation safety.