Amelia Kinsella, Edward Bynum, R. Jordan Hinson, Katherine Berry, Michael Sawyer
{"title":"Project AVIAN: Implications of Utilizing the Novel AVIAN-S Machine Learning Model in Analyzing Aviation Safety Event Reports","authors":"Amelia Kinsella, Edward Bynum, R. Jordan Hinson, Katherine Berry, Michael Sawyer","doi":"10.1177/21695067231192913","DOIUrl":null,"url":null,"abstract":"Voluntary Safety Reporting Programs (VSRPs) create an opportunity for actively identifying potential safety issues within aviation operations. However, manually reading and analyzing these reports can be labor-intensive and heavily relies on subject-matter experts. The full potential of VSRP data is difficult to achieve due to limited resources available to extract meaningful human factors (HF) data from reports. New machine learning (ML) techniques involving natural language processing (NLP) offer opportunities to label factors of interest within safety reports more efficiently and effectively. A novel ML model was developed to identify HF issues within aviation safety reports. The AVIAN-S model was trained on over 50,000 rows of manually classified VSRPs. The model uses ML and NLP to automate the process of labeling aviation safety reporting data and coding reporter narratives according to an established HF taxonomy. Preliminary results and implications for using the AVIAN-S model for analyzing aviation safety event reports are described.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"85 4","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/21695067231192913","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Voluntary Safety Reporting Programs (VSRPs) create an opportunity for actively identifying potential safety issues within aviation operations. However, manually reading and analyzing these reports can be labor-intensive and heavily relies on subject-matter experts. The full potential of VSRP data is difficult to achieve due to limited resources available to extract meaningful human factors (HF) data from reports. New machine learning (ML) techniques involving natural language processing (NLP) offer opportunities to label factors of interest within safety reports more efficiently and effectively. A novel ML model was developed to identify HF issues within aviation safety reports. The AVIAN-S model was trained on over 50,000 rows of manually classified VSRPs. The model uses ML and NLP to automate the process of labeling aviation safety reporting data and coding reporter narratives according to an established HF taxonomy. Preliminary results and implications for using the AVIAN-S model for analyzing aviation safety event reports are described.