Pub Date : 2004-09-01DOI: 10.1207/s15327590ijhc1703_4
K. Hornbæk, E. Frøkjær
A new usability inspection technique based on metaphors of human thinking has been experimentally compared to heuristic evaluation (HE). The aim of metaphors of thinking (MOT) is to focus inspection on users' mental activity and to make inspection easily applicable to different devices and use contexts. Building on classical introspective psychology, MOT bases inspection on metaphors of habit formation, stream of thought, awareness and associations, the relation between utterances and thought, and knowing. An experiment was conducted in which 87 novices evaluated a large Web application, and its key developer assessed the problems found. Compared to HE, MOT uncovered usability problems that were assessed as more severe for users and also appeared more complex to repair. The evaluators using HE found more cosmetic problems. The time spent learning and performing an evaluation with MOT was shorter. A discussion of strengths and weaknesses of MOT and HE is provided, which shows how MOT can be an effective al...
{"title":"Usability Inspection by Metaphors of Human Thinking Compared to Heuristic Evaluation","authors":"K. Hornbæk, E. Frøkjær","doi":"10.1207/s15327590ijhc1703_4","DOIUrl":"https://doi.org/10.1207/s15327590ijhc1703_4","url":null,"abstract":"A new usability inspection technique based on metaphors of human thinking has been experimentally compared to heuristic evaluation (HE). The aim of metaphors of thinking (MOT) is to focus inspection on users' mental activity and to make inspection easily applicable to different devices and use contexts. Building on classical introspective psychology, MOT bases inspection on metaphors of habit formation, stream of thought, awareness and associations, the relation between utterances and thought, and knowing. An experiment was conducted in which 87 novices evaluated a large Web application, and its key developer assessed the problems found. Compared to HE, MOT uncovered usability problems that were assessed as more severe for users and also appeared more complex to repair. The evaluators using HE found more cosmetic problems. The time spent learning and performing an evaluation with MOT was shorter. A discussion of strengths and weaknesses of MOT and HE is provided, which shows how MOT can be an effective al...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"112 37","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131914388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-12-01DOI: 10.1207/S15327590IJHC1104_3
E. Olsson, J. Gulliksen
Different professions adopt their own language such that the semantics involve elements very specific to their domain. System developers approaching users in a new domain often experience initial d ...
{"title":"A Corporate Style Guide That Includes Domain Knowledge","authors":"E. Olsson, J. Gulliksen","doi":"10.1207/S15327590IJHC1104_3","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1104_3","url":null,"abstract":"Different professions adopt their own language such that the semantics involve elements very specific to their domain. System developers approaching users in a new domain often experience initial d ...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124176607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-12-01DOI: 10.1207/S15327590IJHC1104_4
A. Murata
This study was designed to determine the acceptable mixture level of key and speech inputs in a bimodal interface in which users were permitted to use both key and speech input systems. The mixture level was a controlled experimental variable. Five mixture levels were used: 0%, 25%, 50%, 75%, and 100%. The experimental task was to edit a document. The 0% mixture level meant that the participant performed an editing task using only the keyboard. At the 100% mixture level, the participant performed an editing task using only speech input. After each experimental condition had been tested, the participants' mental workload was also measured using the National Aeronautics and Space Administration-Task Load Index. The results suggest that the mixture level between 25% and 50% was acceptable in view of both the completion time and workload.
{"title":"Identification of an Acceptable Mixture of Key and Speech Inputs in Bimodal Interfaces","authors":"A. Murata","doi":"10.1207/S15327590IJHC1104_4","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1104_4","url":null,"abstract":"This study was designed to determine the acceptable mixture level of key and speech inputs in a bimodal interface in which users were permitted to use both key and speech input systems. The mixture level was a controlled experimental variable. Five mixture levels were used: 0%, 25%, 50%, 75%, and 100%. The experimental task was to edit a document. The 0% mixture level meant that the participant performed an editing task using only the keyboard. At the 100% mixture level, the participant performed an editing task using only speech input. After each experimental condition had been tested, the participants' mental workload was also measured using the National Aeronautics and Space Administration-Task Load Index. The results suggest that the mixture level between 25% and 50% was acceptable in view of both the completion time and workload.","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"101 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125977829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-12-01DOI: 10.1207/S15327590IJHC1104_5
Wenlie Zhu, M. Lehto
This study introduces and evaluates the performance of two statistical models intended to support the automatic creation of a subject-based index containing links to hypertext documents. The fuzzy Bayes model makes strong dependence assumptions, and only considers the strongest evidence presented by single words occurring in a document, whereas the classic Bayes model makes strong independence assumptions and attempts to aggregate all the evidence. The links or index terms suggested by both indexing models overlapped greatly with those assigned by a human indexer. However, the probabilities calculated using the classic Bayes model were unstable because of data sparseness and severe violations of the independence assumptions. Subsequent analysis therefore focused on the fuzzy Bayes model. The latter analysis revealed that human experts rated index terms suggested by the model significantly higher than randomly selected index terms. When the index terms assigned by the fuzzy Bayes model were implemented as ...
{"title":"Decision Support for Indexing and Retrieval of Information in Hypertext Systems","authors":"Wenlie Zhu, M. Lehto","doi":"10.1207/S15327590IJHC1104_5","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1104_5","url":null,"abstract":"This study introduces and evaluates the performance of two statistical models intended to support the automatic creation of a subject-based index containing links to hypertext documents. The fuzzy Bayes model makes strong dependence assumptions, and only considers the strongest evidence presented by single words occurring in a document, whereas the classic Bayes model makes strong independence assumptions and attempts to aggregate all the evidence. The links or index terms suggested by both indexing models overlapped greatly with those assigned by a human indexer. However, the probabilities calculated using the classic Bayes model were unstable because of data sparseness and severe violations of the independence assumptions. Subsequent analysis therefore focused on the fuzzy Bayes model. The latter analysis revealed that human experts rated index terms suggested by the model significantly higher than randomly selected index terms. When the index terms assigned by the fuzzy Bayes model were implemented as ...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"88 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128339999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-12-01DOI: 10.1207/S15327590IJHC1104_2
Xiaowen Fang, G. Salvendy
A template for search queries was developed based on user-centered design principles and was proposed to assist users in formulating Web search queries. The user-centered design was characterized by predefined search queries organized as a hierarchy. Two experimental search engines and browsers were developed: One was based on currently available search engines and the other was based on the user-centered template design. An experiment was conducted to test the effectiveness of the template design. The dependent variables were (a) the number of relevant Web sites identified during a 1-hr test period, (b) the time to find the first relevant Web site, and (c) satisfaction. The independent variable was type of search engine. The experimental results indicated that the user-centered template design improved users' search performance by 70% and satisfaction of use by 23% as compared to the current search engine.
{"title":"Templates for Search Queries: A User-Centered Feature for Improving Web Search Tools","authors":"Xiaowen Fang, G. Salvendy","doi":"10.1207/S15327590IJHC1104_2","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1104_2","url":null,"abstract":"A template for search queries was developed based on user-centered design principles and was proposed to assist users in formulating Web search queries. The user-centered design was characterized by predefined search queries organized as a hierarchy. Two experimental search engines and browsers were developed: One was based on currently available search engines and the other was based on the user-centered template design. An experiment was conducted to test the effectiveness of the template design. The dependent variables were (a) the number of relevant Web sites identified during a 1-hr test period, (b) the time to find the first relevant Web site, and (c) satisfaction. The independent variable was type of search engine. The experimental results indicated that the user-centered template design improved users' search performance by 70% and satisfaction of use by 23% as compared to the current search engine.","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114229167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-12-01DOI: 10.1207/S15327590IJHC1104_1
Jennifer Watts-Perotti, D. Woods
This article provides a cognitive analysis of how people navigate in the computer medium. As the complexity of computerized information systems increases, interface designers face the formidable challenge of supporting navigation within these systems to allow users to quickly obtain relevant information. Instead of focusing on the comparison of a small subset of proposed techniques for aiding navigation, this study investigates how people handle navigation within the natural context of a familiar computer environment and reveals cognitive processes that can be better supported to aid navigation. The results of a field study and a field experiment converge to support previous navigation-related theories and contribute to a pattern of navigation behavior that has been noticed in domains like anesthesiology and nuclear power. This article describes the characteristics of the computer medium that influence people's ability to navigate, discusses typical navigation problems that arise in this medium, and descr...
{"title":"How Experienced Users Avoid Getting Lost in Large Display Networks","authors":"Jennifer Watts-Perotti, D. Woods","doi":"10.1207/S15327590IJHC1104_1","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1104_1","url":null,"abstract":"This article provides a cognitive analysis of how people navigate in the computer medium. As the complexity of computerized information systems increases, interface designers face the formidable challenge of supporting navigation within these systems to allow users to quickly obtain relevant information. Instead of focusing on the comparison of a small subset of proposed techniques for aiding navigation, this study investigates how people handle navigation within the natural context of a familiar computer environment and reveals cognitive processes that can be better supported to aid navigation. The results of a field study and a field experiment converge to support previous navigation-related theories and contribute to a pattern of navigation behavior that has been noticed in domains like anesthesiology and nuclear power. This article describes the characteristics of the computer medium that influence people's ability to navigate, discusses typical navigation problems that arise in this medium, and descr...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130261499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-09-01DOI: 10.1207/S15327590IJHC1103_2
W. Xu, M. Dainoff, L. Mark
The premise of this study was that practical problem solving within a complex work domain (ergonomic design and integration of computer workstations) could be enhanced by a hypertext representation of that work domain. Two alternative hypertext representations were developed. The first consisted of an ecological interface design based on the means-end abstraction hierarchy (AH) approach (Vicente & Rasmussen, 1992). In this design, the goal-relevant constraints and functional relations within the domain were explicitly represented on the interface. The second hypertext interface was based on a more traditional classification hierarchy (CH) in which supraordinate categories were broken down into their components (part-whole relation). The relative effectiveness of the 2 approaches was compared using an experimental procedure in which participants solved ergonomic problems of increasing complexity. The results supported the following research hypotheses: (a) When performing a complex or problem-solving task,...
{"title":"Facilitate Complex Search Tasks in Hypertext by Externalizing Functional Properties of a Work Domain","authors":"W. Xu, M. Dainoff, L. Mark","doi":"10.1207/S15327590IJHC1103_2","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1103_2","url":null,"abstract":"The premise of this study was that practical problem solving within a complex work domain (ergonomic design and integration of computer workstations) could be enhanced by a hypertext representation of that work domain. Two alternative hypertext representations were developed. The first consisted of an ecological interface design based on the means-end abstraction hierarchy (AH) approach (Vicente & Rasmussen, 1992). In this design, the goal-relevant constraints and functional relations within the domain were explicitly represented on the interface. The second hypertext interface was based on a more traditional classification hierarchy (CH) in which supraordinate categories were broken down into their components (part-whole relation). The relative effectiveness of the 2 approaches was compared using an experimental procedure in which participants solved ergonomic problems of increasing complexity. The results supported the following research hypotheses: (a) When performing a complex or problem-solving task,...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121440063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-09-01DOI: 10.1207/S15327590IJHC1103_3
A. Cockburn, P. Weir
This article reviews models and theoretical frameworks of collaborative awareness in the use of real-time groupware systems. The review is used to motivate and guide an investigation of distortion-oriented mechanisms for supporting collaborators' fluid and dynamic awareness requirements. We describe our development and evaluation of DOME, a distortion-oriented multiuser editor. Although we designed DOME to provide a realistic and useful platform for the investigation of awareness concepts, our evaluation revealed major flaws in its support for distortion-oriented awareness. We analyze the cause of these errors, some of which were not detected in prior work, and provide precise formulations that will overcome them.
{"title":"An Investigation of Groupware Support for Collaborative Awareness Through Distortion-Oriented Views","authors":"A. Cockburn, P. Weir","doi":"10.1207/S15327590IJHC1103_3","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1103_3","url":null,"abstract":"This article reviews models and theoretical frameworks of collaborative awareness in the use of real-time groupware systems. The review is used to motivate and guide an investigation of distortion-oriented mechanisms for supporting collaborators' fluid and dynamic awareness requirements. We describe our development and evaluation of DOME, a distortion-oriented multiuser editor. Although we designed DOME to provide a realistic and useful platform for the investigation of awareness concepts, our evaluation revealed major flaws in its support for distortion-oriented awareness. We analyze the cause of these errors, some of which were not detected in prior work, and provide precise formulations that will overcome them.","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115732812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 1999-09-01DOI: 10.1207/S15327590IJHC1103_1
A. Sears, David J. Hess
Inspection-based evaluation techniques are popular because they can be fast, require limited formal training, and can find numerous usability problems. Cognitive walkthroughs are one of the most studied techniques, and as a result, the technique has undergone a series of revisions. One such revision, made to speed the evaluation process and reduce the need for formal training in cognitive psychology, incorporated detailed step-by-step task descriptions to guide the evaluation process. This article reports on the first study that investigated the effects of this change when evaluators were learning to apply the technique. The results indicate that providing detailed task descriptions rather than shorter descriptions, as are often used in usability tests, significantly changes the types of problems found. Evaluators given detailed task descriptions found significantly more problems related to the feedback provided by the system but significantly fewer problems related to difficulties locating the necessary ...
{"title":"Cognitive Walkthroughs: Understanding the Effect of Task-Description Detail on Evaluator Performance","authors":"A. Sears, David J. Hess","doi":"10.1207/S15327590IJHC1103_1","DOIUrl":"https://doi.org/10.1207/S15327590IJHC1103_1","url":null,"abstract":"Inspection-based evaluation techniques are popular because they can be fast, require limited formal training, and can find numerous usability problems. Cognitive walkthroughs are one of the most studied techniques, and as a result, the technique has undergone a series of revisions. One such revision, made to speed the evaluation process and reduce the need for formal training in cognitive psychology, incorporated detailed step-by-step task descriptions to guide the evaluation process. This article reports on the first study that investigated the effects of this change when evaluators were learning to apply the technique. The results indicate that providing detailed task descriptions rather than shorter descriptions, as are often used in usability tests, significantly changes the types of problems found. Evaluators given detailed task descriptions found significantly more problems related to the feedback provided by the system but significantly fewer problems related to difficulties locating the necessary ...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129286494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This research was designed to develop the definition of effective target width in a 2-dimensional pointing task. The idea of effective target width in a 1-dimensional pointing task was extended to effective target width in a 2-dimensional pointing task using the 2-dimensional joint probability density function. The validity of this theoretical definition was empirically verified. In the experiment, the moving direction of the mouse was from lower left to upper right. The approach angle was fixed to 45°. The fit of conventional and new models to the experimental data was compared by means of contribution of the regression line that showed the relation between the index of difficulty and the mean pointing time. As a result, we could obtain higher values of contribution for the modeling that introduced effective target width than that for the conventional modeling without it. In conclusion, the proposed 2-dimensional definition of effective target width may be promising for predicting and modeling pointing t...
{"title":"Extending Effective Target Width in Fitts' Law to a Two-Dimensional Pointing Task","authors":"A. Murata","doi":"10.1207/S153275901102_4","DOIUrl":"https://doi.org/10.1207/S153275901102_4","url":null,"abstract":"This research was designed to develop the definition of effective target width in a 2-dimensional pointing task. The idea of effective target width in a 1-dimensional pointing task was extended to effective target width in a 2-dimensional pointing task using the 2-dimensional joint probability density function. The validity of this theoretical definition was empirically verified. In the experiment, the moving direction of the mouse was from lower left to upper right. The approach angle was fixed to 45°. The fit of conventional and new models to the experimental data was compared by means of contribution of the regression line that showed the relation between the index of difficulty and the mean pointing time. As a result, we could obtain higher values of contribution for the modeling that introduced effective target width than that for the conventional modeling without it. In conclusion, the proposed 2-dimensional definition of effective target width may be promising for predicting and modeling pointing t...","PeriodicalId":208962,"journal":{"name":"Int. J. Hum. Comput. Interact.","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1999-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116395017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}