Feasibility analysis of wearables for use by airline crew

Abstract

Jeppesen GmbH is researching new communication and interaction systems for the next generation flight deck. One such opportunity is the determination of use cases for wearable technology in support of airline personnel. Key attributes of wearables, pertinent to the ongoing research efforts, include mobility, persistence, ability to be proactive, and context awareness. Wearables also enable hands-free use. The current study attempts to exploit these characteristics to determine their efficacy in the flight deck. The study used a Sony SmartWatch 3 to test two identified use-cases for wearables by delivering Air Traffic Control commands and other flight relevant information graphically and textually to pilots while conducting flights in a simulator setting. These trials were compared with the delivery of the same information via traditional voice instructions and the Controller-Pilot Data Link Communications screen as is integrated in a Boeing 787 auxiliary panel, next to the Primary Flight Display. A preliminary symbology for Air Traffic Control instructions was developed. In the first experiment, instructions depicted on the SmartWatch were evaluated for subjective usability, subjective workload, performance, and effect on pilot situation awareness. In the study, performance was determined by response time, detection of intentionally placed anomalies in, and the correct execution of Air Traffic Control instructions. Performance from instructions displayed graphically and textually on the SmartWatch was not significantly different than on the datalink communications screen. The three aforementioned methods, however, significantly improved response times in comparison with voice communication with Air Traffic Control. The study also determined that a smartwatch is not preferred by pilots for delivering textual Air Traffic Control commands due to the added workload of turning the wrist to view Air Traffic Control messages. In a second experiment, flight-relevant information was provided on the SmartWatch, such as live field winds and Minimum Equipment List items, in reduced visibility, terminal area operations to test acceptance by pilots. This information was considered useful by pilots. Further research needs to be conducted to understand the interactions between information type, information delivery method, and the effects on pilot acceptance. Additional findings of the two-part study include the preference of graphical data over textual information, and for live field winds to be displayed in field of view, when field winds affect the target threshold speed. The implications of this work are two-fold. Firstly, future research should be conducted to expand on and test the identified use cases of wearables in the aviation industry. Additionally, the representation of Air Traffic Control communications graphically should be investigated on other display areas, e.g. Multi-Functional Display, Head-Up Display, and datalink communication sections on a Primary Flight Display or Flight Management Computer. The symbology needs to be refined and expanded to accurately represent a broader range of Air Traffic Control commands. The graphical representation of information should be investigated further in its ability to improve communication efficiency and reduce analog radio and data link communication errors due to static, accent, and language barriers.