Pub Date : 2019-05-22DOI: 10.1177/1555343419847906
Jamison Heard, J. Adams
Humans commanding and monitoring robots’ actions are used in various high-stress environments, such as the Predator or MQ-9 Reaper remotely piloted unmanned aerial vehicles. The presence of stress and potential costly mistakes in these environments places considerable demands and workload on the human supervisors, which can reduce task performance. Performance may be augmented by implementing an adaptive workload human–machine teaming system that is capable of adjusting based on a human’s workload state. Such a teaming system requires a human workload assessment algorithm capable of estimating workload along multiple dimensions. A multi-dimensional algorithm that estimates workload in a supervisory environment is presented. The algorithm performs well in emulated real-world environments and generalizes across similar workload conditions and populations. This algorithm is a critical component for developing an adaptive human–robot teaming system that can adapt its interactions and intelligently (re-)allocate tasks in dynamic domains.
{"title":"Multi-Dimensional Human Workload Assessment for Supervisory Human–Machine Teams","authors":"Jamison Heard, J. Adams","doi":"10.1177/1555343419847906","DOIUrl":"https://doi.org/10.1177/1555343419847906","url":null,"abstract":"Humans commanding and monitoring robots’ actions are used in various high-stress environments, such as the Predator or MQ-9 Reaper remotely piloted unmanned aerial vehicles. The presence of stress and potential costly mistakes in these environments places considerable demands and workload on the human supervisors, which can reduce task performance. Performance may be augmented by implementing an adaptive workload human–machine teaming system that is capable of adjusting based on a human’s workload state. Such a teaming system requires a human workload assessment algorithm capable of estimating workload along multiple dimensions. A multi-dimensional algorithm that estimates workload in a supervisory environment is presented. The algorithm performs well in emulated real-world environments and generalizes across similar workload conditions and populations. This algorithm is a critical component for developing an adaptive human–robot teaming system that can adapt its interactions and intelligently (re-)allocate tasks in dynamic domains.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"146 - 170"},"PeriodicalIF":2.0,"publicationDate":"2019-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343419847906","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47256985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-04-29DOI: 10.1177/1555343419842776
K. Roundtree, M. Goodrich, J. Adams
Swarm robotic systems are gaining in interest with the prospect of their use for various applications, including monitoring, tracking, infrastructure support, and protection. Prior human-swarm system research investigated transparency for these systems, but assumed perfect communication scenarios. Real-world human-swarm systems will not have perfect communication due to human processing limitations caused by a large number of individual entities, emergent behavior due to varying environments, and bandwidth issues. Factors that affect transparency or are influenced by transparency were identified from various human–machine system domains; however, understanding the relationship between factors can help designers identify what criteria can be implemented to achieve transparency for swarms. Challenges that may arise based on transparency criteria from human–machine systems are examined to identify improvements for spatial swarm systems.
{"title":"Transparency: Transitioning From Human–Machine Systems to Human-Swarm Systems","authors":"K. Roundtree, M. Goodrich, J. Adams","doi":"10.1177/1555343419842776","DOIUrl":"https://doi.org/10.1177/1555343419842776","url":null,"abstract":"Swarm robotic systems are gaining in interest with the prospect of their use for various applications, including monitoring, tracking, infrastructure support, and protection. Prior human-swarm system research investigated transparency for these systems, but assumed perfect communication scenarios. Real-world human-swarm systems will not have perfect communication due to human processing limitations caused by a large number of individual entities, emergent behavior due to varying environments, and bandwidth issues. Factors that affect transparency or are influenced by transparency were identified from various human–machine system domains; however, understanding the relationship between factors can help designers identify what criteria can be implemented to achieve transparency for swarms. Challenges that may arise based on transparency criteria from human–machine systems are examined to identify improvements for spatial swarm systems.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"171 - 195"},"PeriodicalIF":2.0,"publicationDate":"2019-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343419842776","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48176879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-03-08DOI: 10.1177/1555343419830901
S. Casner, E. Hutchins
Each year, millions of automobile crashes occur when drivers fail to notice and respond to conflicts with other vehicles, bicyclists, and pedestrians. Today, manufacturers race to deploy automation technologies to help eliminate these mishaps. To date, little effort has been made to educate drivers about how these systems work or how they affect driver behavior. Driver education for automated systems amounts to additional pages in an owner’s manual that is known to be a seldom-used glove box reference. In this article, we review the history of automation deployed in the airline cockpit decades ago. We describe how automation helped avoid many common crash scenarios but at the same time gave rise to new kinds of crashes. It was only following a concerted effort to educate pilots about the automation, about themselves, and about the concept of a human-automation team that we reached the near-zero crash rate we enjoy today. Drawing parallels between the automation systems, the available pilot and driver research, and operational experience in both airplanes and automobiles, we outline knowledge standards for drivers of partially automated cars and argue that the safe operation of these vehicles will be enhanced by drivers’ incorporation of this knowledge in their everyday travels.
{"title":"What Do We Tell the Drivers? Toward Minimum Driver Training Standards for Partially Automated Cars","authors":"S. Casner, E. Hutchins","doi":"10.1177/1555343419830901","DOIUrl":"https://doi.org/10.1177/1555343419830901","url":null,"abstract":"Each year, millions of automobile crashes occur when drivers fail to notice and respond to conflicts with other vehicles, bicyclists, and pedestrians. Today, manufacturers race to deploy automation technologies to help eliminate these mishaps. To date, little effort has been made to educate drivers about how these systems work or how they affect driver behavior. Driver education for automated systems amounts to additional pages in an owner’s manual that is known to be a seldom-used glove box reference. In this article, we review the history of automation deployed in the airline cockpit decades ago. We describe how automation helped avoid many common crash scenarios but at the same time gave rise to new kinds of crashes. It was only following a concerted effort to educate pilots about the automation, about themselves, and about the concept of a human-automation team that we reached the near-zero crash rate we enjoy today. Drawing parallels between the automation systems, the available pilot and driver research, and operational experience in both airplanes and automobiles, we outline knowledge standards for drivers of partially automated cars and argue that the safe operation of these vehicles will be enhanced by drivers’ incorporation of this knowledge in their everyday travels.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"55 - 66"},"PeriodicalIF":2.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343419830901","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49149570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-03-05DOI: 10.1177/1555343419830183
Mario Nadj, A. Maedche
In aircraft ground handling, ramp agents manage the teams on the airport apron who prepare aircraft for the next takeoff. We examined the impact of using auditory and visual notification cues (NC) in an information system for supporting ramp agents, measuring the users’ situation awareness (SA), task performance, and perceived ease of use. Eighty-eight participants took part in a laboratory experiment and performed a realistic dispatching task of a ramp agent. Results showed that auditory cues facilitate superior SA compared with the application of visual cues or their absence. Our findings may serve as a foundation for future work aiming to design more effective notification systems to support SA.
{"title":"Situation Awareness in Aircraft Ground Handling: The Impact of Auditory and Visual Notification Cues","authors":"Mario Nadj, A. Maedche","doi":"10.1177/1555343419830183","DOIUrl":"https://doi.org/10.1177/1555343419830183","url":null,"abstract":"In aircraft ground handling, ramp agents manage the teams on the airport apron who prepare aircraft for the next takeoff. We examined the impact of using auditory and visual notification cues (NC) in an information system for supporting ramp agents, measuring the users’ situation awareness (SA), task performance, and perceived ease of use. Eighty-eight participants took part in a laboratory experiment and performed a realistic dispatching task of a ramp agent. Results showed that auditory cues facilitate superior SA compared with the application of visual cues or their absence. Our findings may serve as a foundation for future work aiming to design more effective notification systems to support SA.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"102 - 122"},"PeriodicalIF":2.0,"publicationDate":"2019-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343419830183","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49621535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-01-08DOI: 10.1177/1555343418821507
A. Naweed, Kate Kingshott
While not as glamorous as flying, aircraft maintenance is a fundamental of aviation safety, and improper or inadequate maintenance can have far reaching consequences. With this in mind, and considering the paucity of substantive research in aircraft maintenance engineering, this study investigated how affect influenced decision making and action tendency in real-world challenging maintenance engineering scenarios in general aviation (GA). A study was undertaken combining a naturalistic decision making (NDM) technique with the Appraisal Tendency Framework (ATF) to analyze 10 different scenarios collected from aircraft maintenance engineers. A total of 11 contextual factors were elicited from which seven specific emotions emerged: anger, frustration, pride, hope, guilt, fear, and contempt. In most instances, the emotion was found to be incidental, meaning that the feelings at the time of the decision were not normatively relevant for deciding. Anger and contempt created action tendencies for risk taking, while feelings of pride were found to have a protective effect. The findings suggest that affect regulation is an inherent part of the system, such that affect dysregulation may represent a potential contributing factor for negative outcomes arising from action tendencies associated with other complex system influences. Future research directions are given.
{"title":"Flying Off the Handle: Affective Influences on Decision Making and Action Tendencies in Real-World Aircraft Maintenance Engineering Scenarios","authors":"A. Naweed, Kate Kingshott","doi":"10.1177/1555343418821507","DOIUrl":"https://doi.org/10.1177/1555343418821507","url":null,"abstract":"While not as glamorous as flying, aircraft maintenance is a fundamental of aviation safety, and improper or inadequate maintenance can have far reaching consequences. With this in mind, and considering the paucity of substantive research in aircraft maintenance engineering, this study investigated how affect influenced decision making and action tendency in real-world challenging maintenance engineering scenarios in general aviation (GA). A study was undertaken combining a naturalistic decision making (NDM) technique with the Appraisal Tendency Framework (ATF) to analyze 10 different scenarios collected from aircraft maintenance engineers. A total of 11 contextual factors were elicited from which seven specific emotions emerged: anger, frustration, pride, hope, guilt, fear, and contempt. In most instances, the emotion was found to be incidental, meaning that the feelings at the time of the decision were not normatively relevant for deciding. Anger and contempt created action tendencies for risk taking, while feelings of pride were found to have a protective effect. The findings suggest that affect regulation is an inherent part of the system, such that affect dysregulation may represent a potential contributing factor for negative outcomes arising from action tendencies associated with other complex system influences. Future research directions are given.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"101 - 81"},"PeriodicalIF":2.0,"publicationDate":"2019-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343418821507","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45244076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-01-04DOI: 10.1177/1555343418819646
E. Fonseca, F. Lima, F. Duarte
In recent years, in the construction industry, facing the limitations of behavioral approaches, the approach to cognitive aspects has been considered an alternative to improve production and safety. The goal of this article is to understand the cognitive processes of the construction engineer that allow them to anticipate problems in several Levels of Anticipation of the construction process, planning, and decision making in production and safety. To achieve this goal we use, interacting with the ethnographic study, the methodology of activity analysis and, in particular, what is called approach of the course of action. Thus, the cases presented make it possible to understand how the construction engineer, using information available in the Levels of Anticipation of the construction process, manipulates resources—personal (tacit and explicit knowledge, skills, etc.), material (designs), and social (relationship with his team)—when he perceives problems. By understanding their fortes, we can better foment their cognitive process. Thus, the theory is relevant and contributes to describe and explain the processes of human problem solving, decision making, and planning.
{"title":"Cognitive Processes of the Construction Engineer: Planning and Decision Making in Production and Safety","authors":"E. Fonseca, F. Lima, F. Duarte","doi":"10.1177/1555343418819646","DOIUrl":"https://doi.org/10.1177/1555343418819646","url":null,"abstract":"In recent years, in the construction industry, facing the limitations of behavioral approaches, the approach to cognitive aspects has been considered an alternative to improve production and safety. The goal of this article is to understand the cognitive processes of the construction engineer that allow them to anticipate problems in several Levels of Anticipation of the construction process, planning, and decision making in production and safety. To achieve this goal we use, interacting with the ethnographic study, the methodology of activity analysis and, in particular, what is called approach of the course of action. Thus, the cases presented make it possible to understand how the construction engineer, using information available in the Levels of Anticipation of the construction process, manipulates resources—personal (tacit and explicit knowledge, skills, etc.), material (designs), and social (relationship with his team)—when he perceives problems. By understanding their fortes, we can better foment their cognitive process. Thus, the theory is relevant and contributes to describe and explain the processes of human problem solving, decision making, and planning.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"30 - 46"},"PeriodicalIF":2.0,"publicationDate":"2019-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343418819646","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42065512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2018-12-26DOI: 10.1177/1555343418819832
J. Schraagen
In the movie Back to the Future, Marty McFly accidentally travels back in time to 1955 to find his parents back in high school. Being stuck in the past, Marty needs to go back to the 1980s, in other words, the future. Hence, the movie’s title. If a cognitive engineer could travel back in time to, say, the early 1950s, what would they be able to discover? Today, most researchers would believe not much of interest was going on in the 1950s, as American academic psychology was still heavily dominated by behaviorism.
{"title":"Back to the Future and Forth to the Past","authors":"J. Schraagen","doi":"10.1177/1555343418819832","DOIUrl":"https://doi.org/10.1177/1555343418819832","url":null,"abstract":"In the movie Back to the Future, Marty McFly accidentally travels back in time to 1955 to find his parents back in high school. Being stuck in the past, Marty needs to go back to the 1980s, in other words, the future. Hence, the movie’s title. If a cognitive engineer could travel back in time to, say, the early 1950s, what would they be able to discover? Today, most researchers would believe not much of interest was going on in the 1950s, as American academic psychology was still heavily dominated by behaviorism.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"3 - 9"},"PeriodicalIF":2.0,"publicationDate":"2018-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343418819832","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41383523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2018-11-21DOI: 10.1177/1555343418810936
H. Klein, Mei-Hua Lin, Norma L. Miller, L. Militello, J. Lyons, Jessica G. Finkeldey
Trust assessment can be difficult during cross-cultural social and professional interactions. Structured interviews were used to contrast how young adults from three culturally distinct samples evaluate trustworthiness: Malaysia (Chinese), an Asian group; Panama, a Latin American group; and the United States, a Western group. The role of context in trust judgments (e.g., school, work, social encounters, encounters with strangers, encounters with danger) on the assessment of trustworthiness was examined. Findings affirm the importance of Mayer’s constructs of ability, benevolence, and integrity—but benevolence and integrity appeared more often than expected in the U.S. sample and less often than expected in the Chinese/Malaysian sample. Hofstede’s power distance variable was frequently cited by the Chinese/Malaysian sample and less often by the U.S. sample. H. A. Klein’s cultural lens model includes affect, cited most by the Panamanians; nonverbal communication, cited least by the U.S. and most by the Chinese/Malaysian samples; and dialectical reasoning, cited most by the Chinese/Malaysian sample and hardly at all by the U.S. sample. The results document the important role of context for assessing trust. These results illustrate the risks of assuming that other cultures make judgments such as trust assessments the way that Western cultures do.
在跨文化的社会和专业互动中,信任评估可能是困难的。结构化访谈用于对比来自三个不同文化样本的年轻人如何评估可信度:马来西亚(华人),一个亚洲群体;巴拿马,一个拉丁美洲集团;而美国是一个西方集团。考察了环境在信任判断(如学校、工作、社会遭遇、与陌生人的遭遇、与危险的遭遇)中对可信度评估的作用。研究结果肯定了Mayer的能力、仁慈和正直结构的重要性,但仁慈和正直在美国样本中出现的频率高于预期,而在中国/马来西亚样本中出现的频率低于预期。Hofstede的权力距离变量经常被中国/马来西亚样本引用,而较少被美国样本引用。H. A. Klein的文化透镜模型包括巴拿马人引用最多的情感;非语言沟通,美国人引用最少,中国/马来西亚人引用最多;辩证推理,被中国/马来西亚的样本引用最多,而几乎没有被美国的样本引用。结果证明了环境对评估信任的重要作用。这些结果表明,假设其他文化以西方文化的方式做出信任评估等判断是有风险的。
{"title":"Trust Across Culture and Context","authors":"H. Klein, Mei-Hua Lin, Norma L. Miller, L. Militello, J. Lyons, Jessica G. Finkeldey","doi":"10.1177/1555343418810936","DOIUrl":"https://doi.org/10.1177/1555343418810936","url":null,"abstract":"Trust assessment can be difficult during cross-cultural social and professional interactions. Structured interviews were used to contrast how young adults from three culturally distinct samples evaluate trustworthiness: Malaysia (Chinese), an Asian group; Panama, a Latin American group; and the United States, a Western group. The role of context in trust judgments (e.g., school, work, social encounters, encounters with strangers, encounters with danger) on the assessment of trustworthiness was examined. Findings affirm the importance of Mayer’s constructs of ability, benevolence, and integrity—but benevolence and integrity appeared more often than expected in the U.S. sample and less often than expected in the Chinese/Malaysian sample. Hofstede’s power distance variable was frequently cited by the Chinese/Malaysian sample and less often by the U.S. sample. H. A. Klein’s cultural lens model includes affect, cited most by the Panamanians; nonverbal communication, cited least by the U.S. and most by the Chinese/Malaysian samples; and dialectical reasoning, cited most by the Chinese/Malaysian sample and hardly at all by the U.S. sample. The results document the important role of context for assessing trust. These results illustrate the risks of assuming that other cultures make judgments such as trust assessments the way that Western cultures do.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"13 1","pages":"10 - 29"},"PeriodicalIF":2.0,"publicationDate":"2018-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343418810936","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45956386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2018-09-06DOI: 10.1177/1555343418799601
Alexis R. Neigel, Justine P. Caylor, S. Kase, M. Vanni, Jeff Hoye
Trust in automation has been linked to a multitude of performance improvements and implicated in the reduction of human error, stress, and workload. In the present study, trust in automation was examined in an experiment measuring the efficacy of linguistic annotation schemes for decision support and human performance. An automated aid provided decisional guidance to assist in intelligence task performance. Four hundred and fifty-eight participants were randomly assigned to one of three annotation schemes and then subsequently performed three simulated intelligence analysis task. The results indicated that trust played a significant role in intelligence task performance, though a significant trust by annotation scheme interaction did not emerge. Specifically, an increase in trust accompanied an increase in performance across the task types. We conclude with a discussion of trust and automated annotation schemes, which has implications for the intelligence operations community.
{"title":"The Role of Trust and Automation in an Intelligence Analyst Decisional Guidance Paradigm","authors":"Alexis R. Neigel, Justine P. Caylor, S. Kase, M. Vanni, Jeff Hoye","doi":"10.1177/1555343418799601","DOIUrl":"https://doi.org/10.1177/1555343418799601","url":null,"abstract":"Trust in automation has been linked to a multitude of performance improvements and implicated in the reduction of human error, stress, and workload. In the present study, trust in automation was examined in an experiment measuring the efficacy of linguistic annotation schemes for decision support and human performance. An automated aid provided decisional guidance to assist in intelligence task performance. Four hundred and fifty-eight participants were randomly assigned to one of three annotation schemes and then subsequently performed three simulated intelligence analysis task. The results indicated that trust played a significant role in intelligence task performance, though a significant trust by annotation scheme interaction did not emerge. Specifically, an increase in trust accompanied an increase in performance across the task types. We conclude with a discussion of trust and automated annotation schemes, which has implications for the intelligence operations community.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":"12 1","pages":"239 - 247"},"PeriodicalIF":2.0,"publicationDate":"2018-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1555343418799601","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45347111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}