With the progressive nature of Human-Agent Teams becoming more and more useful for high-quality work output, there is a proportional need for bi-directional communication between teammates to increase efficient collaboration. This need is centered around the well-known issue of innate mistrust between humans and artificial intelligence, resulting in sub-optimal work. To combat this, computer scientists and humancomputer interaction researchers alike have presented and refined specific solutions to this issue through different methods of AI interpretability. These different methods include explicit AI explanations as well as implicit manipulations of the AI interface, otherwise known as AI transparency. Individually these solutions hold considerable merit in repairing the relationship of trust between teammates, but also have individual flaws. We posit that the combination of different interpretable mechanisms mitigates each other’s flaws and extenuates their strengths within human-agent teams.
{"title":"Balancing the Scales of Explainable and Transparent AI Agents within Human-Agent Teams","authors":"Sarvesh Sawant, Rohit Mallick, Camden Brady, Kapil Chalil Madathil, Nathan McNeese, Jeffrey Bertrand, Nikhil Rangaraju","doi":"10.1177/21695067231192250","DOIUrl":"https://doi.org/10.1177/21695067231192250","url":null,"abstract":"With the progressive nature of Human-Agent Teams becoming more and more useful for high-quality work output, there is a proportional need for bi-directional communication between teammates to increase efficient collaboration. This need is centered around the well-known issue of innate mistrust between humans and artificial intelligence, resulting in sub-optimal work. To combat this, computer scientists and humancomputer interaction researchers alike have presented and refined specific solutions to this issue through different methods of AI interpretability. These different methods include explicit AI explanations as well as implicit manipulations of the AI interface, otherwise known as AI transparency. Individually these solutions hold considerable merit in repairing the relationship of trust between teammates, but also have individual flaws. We posit that the combination of different interpretable mechanisms mitigates each other’s flaws and extenuates their strengths within human-agent teams.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"19 1","pages":"2082 - 2087"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344907","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231193679
Maryam Tabibzadeh, Apurva Shivakumar
Amid the COVID-19 outbreak, healthcare systems have undergone a transformation with telehealth playing a key role. There has been a dramatic shift in the use of telehealth due to its benefits including the convenience it has offered. With the use of telehealth to monitor patients’ health on the rise, it has become more critical to improve the quality of care by identifying and resolving barriers to virtual care delivery systems. In this study, we apply the Systems Engineering Initiative for Patient Safety (SEIPS) 2.0 framework to systematically investigate telemonitoring implementation, as a main category of telehealth services, and identify barriers to high quality of care while monitoring care virtually. We analyze those barriers by capturing them across different work systems of the SEIPS framework, which are: people (patients, healthcare providers, nurses, telemonitoring staff), organization, tools and technology, tasks, internal environment, and external environment. We then, through some research, determine some of those barriers that are more influential and conduct Fault Tree Analysis to identify their root causes. Furthermore, some recommendations are provided to address the identified barriers and their root causes.
{"title":"Systemic Analysis of Barriers of High Quality of Care in Telemonitoring: Integrating the Seips Framework and Fault Tree Analysis","authors":"Maryam Tabibzadeh, Apurva Shivakumar","doi":"10.1177/21695067231193679","DOIUrl":"https://doi.org/10.1177/21695067231193679","url":null,"abstract":"Amid the COVID-19 outbreak, healthcare systems have undergone a transformation with telehealth playing a key role. There has been a dramatic shift in the use of telehealth due to its benefits including the convenience it has offered. With the use of telehealth to monitor patients’ health on the rise, it has become more critical to improve the quality of care by identifying and resolving barriers to virtual care delivery systems. In this study, we apply the Systems Engineering Initiative for Patient Safety (SEIPS) 2.0 framework to systematically investigate telemonitoring implementation, as a main category of telehealth services, and identify barriers to high quality of care while monitoring care virtually. We analyze those barriers by capturing them across different work systems of the SEIPS framework, which are: people (patients, healthcare providers, nurses, telemonitoring staff), organization, tools and technology, tasks, internal environment, and external environment. We then, through some research, determine some of those barriers that are more influential and conduct Fault Tree Analysis to identify their root causes. Furthermore, some recommendations are provided to address the identified barriers and their root causes.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"66 1","pages":"626 - 632"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139345821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192597
Benjamin R. Stephens, Michaela Cuoco
We discuss two case studies that illustrate the application of conspicuity measures to evaluate two near miss events. Conspicuity distance measurements in both cases suggest that the hazards were not noticed during the user’s normal activities. Near miss events can suggest the presence of hazardous situations. Near miss events also illustrate forensic analysis that may generalize to cases with more serious injuries.
{"title":"Case Study Analysis of Near Miss Events: A Misstep and a Trip","authors":"Benjamin R. Stephens, Michaela Cuoco","doi":"10.1177/21695067231192597","DOIUrl":"https://doi.org/10.1177/21695067231192597","url":null,"abstract":"We discuss two case studies that illustrate the application of conspicuity measures to evaluate two near miss events. Conspicuity distance measurements in both cases suggest that the hazards were not noticed during the user’s normal activities. Near miss events can suggest the presence of hazardous situations. Near miss events also illustrate forensic analysis that may generalize to cases with more serious injuries.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"40 1","pages":"1623 - 1627"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The National Surgical Quality Improvement Program (NSQIP) calculator is a risk-predicting calculator, that predicts the likelihood of postoperative complications. Card sorting methodology was used to capture feedback from expert and non-expert participants regarding the severity of surgical complications. The study result indicated ambiguity of postoperative complications. To overcome this barrier, a proposed order of postoperative complications was developed based on the Borda count ranking performed by surgeon.
{"title":"Systematic Ranking of NSQIP Surgical Risk Calculator Outputs","authors":"Nejc Sitar, Staci Turoski, Bernadette McCrory, Caleb T. Gardner, Corey Guildner","doi":"10.1177/21695067231193660","DOIUrl":"https://doi.org/10.1177/21695067231193660","url":null,"abstract":"The National Surgical Quality Improvement Program (NSQIP) calculator is a risk-predicting calculator, that predicts the likelihood of postoperative complications. Card sorting methodology was used to capture feedback from expert and non-expert participants regarding the severity of surgical complications. The study result indicated ambiguity of postoperative complications. To overcome this barrier, a proposed order of postoperative complications was developed based on the Borda count ranking performed by surgeon.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"17 1","pages":"2404 - 2409"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192430
Amelia C Warden, Christopher D Wickens, Benjamin A. Clegg, Francisco R. Ortega
Costs and benefits are associated with how information is presented depending on the type of task required. A meta-analysis was conducted to examine the costs and benefits associated with overlaying information on a single display, as in the case with a head-mounted display, or presenting information more separately, as in the case with a head-down display (e.g., a tablet). Seventeen studies contributed a total of 82 individual effect sizes that met the inclusion criteria for the meta-analysis. Overall, overlaid displays led to a response time benefit for integration tasks without compromising accuracy, whereas separate displays led to an accuracy benefit for focused attention tasks. The findings here speak favorably to the use of head-mounted displays for tasks that require integrating information on the display with information in the real world.
{"title":"A Meta-Analytic Examination of the Cost and Benefits of Overlay versus Separate Displays","authors":"Amelia C Warden, Christopher D Wickens, Benjamin A. Clegg, Francisco R. Ortega","doi":"10.1177/21695067231192430","DOIUrl":"https://doi.org/10.1177/21695067231192430","url":null,"abstract":"Costs and benefits are associated with how information is presented depending on the type of task required. A meta-analysis was conducted to examine the costs and benefits associated with overlaying information on a single display, as in the case with a head-mounted display, or presenting information more separately, as in the case with a head-down display (e.g., a tablet). Seventeen studies contributed a total of 82 individual effect sizes that met the inclusion criteria for the meta-analysis. Overall, overlaid displays led to a response time benefit for integration tasks without compromising accuracy, whereas separate displays led to an accuracy benefit for focused attention tasks. The findings here speak favorably to the use of head-mounted displays for tasks that require integrating information on the display with information in the real world.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"60 1","pages":"1501 - 1502"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192259
Julia K. Diebol, Kelly LoVoi, Chason J. Coelho
This paper reviews research published from 1998 to 2022 that involved collection of original data related to behavioral compliance with safety signs and labels. This review provides a needed update to previous similar reviews using a published taxonomical approach. The approach was used here to categorize study methodology and was extended to further categorize studies by whether they addressed behavioral compliance or intention/predicted likelihood of compliance. Nearly all of the studies reviewed assessed behavior in laboratories or via surveys of hypothetical scenarios, and relatively few used real-world experimental or real-world observational methods. Results revealed a lack of empirical demonstrations that intention and predicted likelihood of compliance are reliable predictors of real-world behavioral compliance. There was also a notable lack of evidence that warnings design aspects impact such real-world compliance.
{"title":"Behavioral Compliance with Safety Signs and Labels: An Analysis of Research Methods from the Past 25 Years","authors":"Julia K. Diebol, Kelly LoVoi, Chason J. Coelho","doi":"10.1177/21695067231192259","DOIUrl":"https://doi.org/10.1177/21695067231192259","url":null,"abstract":"This paper reviews research published from 1998 to 2022 that involved collection of original data related to behavioral compliance with safety signs and labels. This review provides a needed update to previous similar reviews using a published taxonomical approach. The approach was used here to categorize study methodology and was extended to further categorize studies by whether they addressed behavioral compliance or intention/predicted likelihood of compliance. Nearly all of the studies reviewed assessed behavior in laboratories or via surveys of hypothetical scenarios, and relatively few used real-world experimental or real-world observational methods. Results revealed a lack of empirical demonstrations that intention and predicted likelihood of compliance are reliable predictors of real-world behavioral compliance. There was also a notable lack of evidence that warnings design aspects impact such real-world compliance.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"5 1","pages":"1031 - 1037"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139344624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231193666
Misty R. Hechinger, Steven C. Howell, Triet M. Le, Rickey P. Thomas
In the paper, we consider a modification of the Recursive Bayesian Estimation technique and incorporate the Fast Sweeping Method to extend recent work in search applications with an algorithm capable of calculating optimal trajectories in the context of multiple targets and searchers. In addition to providing a computational overview of the algorithm, we demonstrate how incorporating knowledge, deception, and belief biases into the algorithm alters the optimal trajectories of the searchers. Finally, we present Monte-Carlo simulations of how these psychological factors influence the mean probability that the searchers detect the target. We will discuss the implications of the findings, current limitations and future extensions of the model, and potential applications to decision support.
{"title":"Recursive Bayesian Estimation Search with Environmental Constraints and Psychological Beliefs and Biases","authors":"Misty R. Hechinger, Steven C. Howell, Triet M. Le, Rickey P. Thomas","doi":"10.1177/21695067231193666","DOIUrl":"https://doi.org/10.1177/21695067231193666","url":null,"abstract":"In the paper, we consider a modification of the Recursive Bayesian Estimation technique and incorporate the Fast Sweeping Method to extend recent work in search applications with an algorithm capable of calculating optimal trajectories in the context of multiple targets and searchers. In addition to providing a computational overview of the algorithm, we demonstrate how incorporating knowledge, deception, and belief biases into the algorithm alters the optimal trajectories of the searchers. Finally, we present Monte-Carlo simulations of how these psychological factors influence the mean probability that the searchers detect the target. We will discuss the implications of the findings, current limitations and future extensions of the model, and potential applications to decision support.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"19 1","pages":"755 - 761"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192456
M. Sanaei, Arthur J. Perron, Stephen B. Gilbert
Despite advances in VR hardware, cybersickness remains a key barrier to VR. Having a common customizable research platform could help the research community. This paper introduces a cybersickness research platform called Pendulum Chair for “spinning world” (egocentric rotation) experiences. The design of Pendulum Chair is justified and four different conditions are described from a Pendulum Chair study as validation. The conditions were defined as two different background scenes and two conditions of music. Data from 56 participants were collected and results showed that in all four conditions, participants reported cybersickness. The use of the open-source Pendulum Chair Unity project could enable stronger comparisons across cybersickness studies.
{"title":"Pendulum Chair: A Research Platform for Cybersickness","authors":"M. Sanaei, Arthur J. Perron, Stephen B. Gilbert","doi":"10.1177/21695067231192456","DOIUrl":"https://doi.org/10.1177/21695067231192456","url":null,"abstract":"Despite advances in VR hardware, cybersickness remains a key barrier to VR. Having a common customizable research platform could help the research community. This paper introduces a cybersickness research platform called Pendulum Chair for “spinning world” (egocentric rotation) experiences. The design of Pendulum Chair is justified and four different conditions are described from a Pendulum Chair study as validation. The conditions were defined as two different background scenes and two conditions of music. Data from 56 participants were collected and results showed that in all four conditions, participants reported cybersickness. The use of the open-source Pendulum Chair Unity project could enable stronger comparisons across cybersickness studies.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"13 1","pages":"1837 - 1843"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139346396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231192543
{"title":"OE7: Biomechanical Modeling and Simulation - Part 1","authors":"","doi":"10.1177/21695067231192543","DOIUrl":"https://doi.org/10.1177/21695067231192543","url":null,"abstract":"","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"222 1","pages":"847 - 851"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139347060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01DOI: 10.1177/21695067231208169
McKenna C. Tooker, Paige Lawton, Gabriela Rosado, Sabrina Ehrenfort, Albert Boquet
The operating room (OR) is a complex environment in which highly trained individuals perform cognitively demanding tasks. Distractions in this environment may lead to deleterious effects, as a loss of situational awareness can interfere with surgical procedures. The present study aims to quantify the frequency and nature of distracting events associated with personal electronic devices (PEDs) during twenty elective orthopedic surgery cases. PED use was coded using a real-time, custom data collection tool beginning in the pre-operative area and terminating at the time of handoff with the post-anesthesia care team. PED use accounted for 242 flow disruptions in the OR. The vendor showed the highest frequency of flow disruptions (73), followed by the circulating nurse (52) and the certified registered nurse anesthetist (CRNA) (52). Thus, taking a proactive safety approach to account for intraoperative distractions associated with PEDs among OR team members will be critical to ensure high-quality patient care.
{"title":"Flow Disruptions as A Result of Personal Electronic Devices in Orthopedic Surgery","authors":"McKenna C. Tooker, Paige Lawton, Gabriela Rosado, Sabrina Ehrenfort, Albert Boquet","doi":"10.1177/21695067231208169","DOIUrl":"https://doi.org/10.1177/21695067231208169","url":null,"abstract":"The operating room (OR) is a complex environment in which highly trained individuals perform cognitively demanding tasks. Distractions in this environment may lead to deleterious effects, as a loss of situational awareness can interfere with surgical procedures. The present study aims to quantify the frequency and nature of distracting events associated with personal electronic devices (PEDs) during twenty elective orthopedic surgery cases. PED use was coded using a real-time, custom data collection tool beginning in the pre-operative area and terminating at the time of handoff with the post-anesthesia care team. PED use accounted for 242 flow disruptions in the OR. The vendor showed the highest frequency of flow disruptions (73), followed by the circulating nurse (52) and the certified registered nurse anesthetist (CRNA) (52). Thus, taking a proactive safety approach to account for intraoperative distractions associated with PEDs among OR team members will be critical to ensure high-quality patient care.","PeriodicalId":20673,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"50 1","pages":"2534 - 2537"},"PeriodicalIF":0.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139343663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：