Tim Hussein, S. Lukosch, Heiko Paulheim, J. Ziegler, Gaëlle Calvary
The International Workshop on Semantic Models for Adaptive Interactive Systems (SEMAIS 2012) aims to identify emerging trends in interactive system design using semantic models.
{"title":"3rd workshop on semantic models for adaptive interactive systems (SEMAIS): (SEMAIS)","authors":"Tim Hussein, S. Lukosch, Heiko Paulheim, J. Ziegler, Gaëlle Calvary","doi":"10.1145/2166966.2167059","DOIUrl":"https://doi.org/10.1145/2166966.2167059","url":null,"abstract":"The International Workshop on Semantic Models for Adaptive Interactive Systems (SEMAIS 2012) aims to identify emerging trends in interactive system design using semantic models.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76234306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper presents a recommender system for teams of medical professionals working collaboratively in hospital operating rooms. The system recommends relevant virtual actions, such as retrieval of information resources and initiation of communication with professionals outside the operating rooms. Recommendations are based on the current state of the ongoing operation as recognised from sensor data using machine learning techniques. The selection and non-selection of virtual actions during operations are interpreted as implicit feedback and used to update the weight matrices that guide recommendations. A pilot user study involving medical professionals indicates that the adaptation mechanism is effective and that the system provides adequate recommendations.
{"title":"Activity-aware recommendation for collaborative work in operating rooms","authors":"Afsaneh Doryab, J. Togelius, J. Bardram","doi":"10.1145/2166966.2167023","DOIUrl":"https://doi.org/10.1145/2166966.2167023","url":null,"abstract":"This paper presents a recommender system for teams of medical professionals working collaboratively in hospital operating rooms. The system recommends relevant virtual actions, such as retrieval of information resources and initiation of communication with professionals outside the operating rooms. Recommendations are based on the current state of the ongoing operation as recognised from sensor data using machine learning techniques. The selection and non-selection of virtual actions during operations are interpreted as implicit feedback and used to update the weight matrices that guide recommendations. A pilot user study involving medical professionals indicates that the adaptation mechanism is effective and that the system provides adequate recommendations.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73362430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
As applications are developed, functional tests ensure they continue to function as expected. Nowadays, functional testing is mostly done manually, with human testers verifying a system's functionality themselves, following hand-written instructions. While there exist tools supporting functional test automation, in practice they are hard to use, require programming skills, and do not provide good support for test maintenance. In this paper, we take an alternative approach: we semi-automatically convert hand-written instructions into automated tests. Our approach consists of two stages: first, employing machine learning and natural language processing to compute an intermediate representation from test steps; and second, interactively disambiguating that representation to create a fully automated test. These two stages comprise a complete system for converting hand-written functional tests into automated tests. We also present a quantitative study analyzing the effectiveness of our approach. Our results show that 70% of manual test steps can be automatically converted to automated test steps with no user intervention.
{"title":"Towards automatic functional test execution","authors":"Pablo Pedemonte, J. Mahmud, T. Lau","doi":"10.1145/2166966.2167005","DOIUrl":"https://doi.org/10.1145/2166966.2167005","url":null,"abstract":"As applications are developed, functional tests ensure they continue to function as expected. Nowadays, functional testing is mostly done manually, with human testers verifying a system's functionality themselves, following hand-written instructions. While there exist tools supporting functional test automation, in practice they are hard to use, require programming skills, and do not provide good support for test maintenance. In this paper, we take an alternative approach: we semi-automatically convert hand-written instructions into automated tests. Our approach consists of two stages: first, employing machine learning and natural language processing to compute an intermediate representation from test steps; and second, interactively disambiguating that representation to create a fully automated test. These two stages comprise a complete system for converting hand-written functional tests into automated tests. We also present a quantitative study analyzing the effectiveness of our approach. Our results show that 70% of manual test steps can be automatically converted to automated test steps with no user intervention.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80278682","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Information technology (IT) support of office work has increased rapidly in functionality, but the interaction styles have evolved more slowly. This project explores interaction design opportunities of IT supported tools in the context of office work. A series of (contextual) interviews was conducted with Generation Y office workers, aiming to identify their interaction qualities. Three interactive prototypes were built to map these interaction qualities and to demonstrate future ways of working. This project resulted in a set of design guidelines, aiming to support Generation Y interactions in future office work. Designers and researchers who focus on understanding (rich interactions in) the work context would benefit from the result of this project.
{"title":"Generation Y interactions","authors":"W. Liu","doi":"10.1145/2166966.2167046","DOIUrl":"https://doi.org/10.1145/2166966.2167046","url":null,"abstract":"Information technology (IT) support of office work has increased rapidly in functionality, but the interaction styles have evolved more slowly. This project explores interaction design opportunities of IT supported tools in the context of office work. A series of (contextual) interviews was conducted with Generation Y office workers, aiming to identify their interaction qualities. Three interactive prototypes were built to map these interaction qualities and to demonstrate future ways of working. This project resulted in a set of design guidelines, aiming to support Generation Y interactions in future office work. Designers and researchers who focus on understanding (rich interactions in) the work context would benefit from the result of this project.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85764847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Villa, Fernando Aparicio, Manuel J. Maña López, M. Rodríguez
The search for truthful health information through Internet is an increasingly complex process due to the growing amount of resources. Access to information can be difficult to control even in environments where the goal pursued is well-defined, as in the case of learning activities with medical students. In this paper, we present a computer tool devised to ease the process of understanding medical concepts from information in clinical case histories. To this end, it automatically constructs concept maps and presents reliable information from different ontologies and knowledge bases. The two main components of the system are an Intelligent Information Access interface and a Concept Map Graph that retrieves medical concepts from a text input, and provides rich information and semantically related concepts. The paper includes a user evaluation of the first component and a systematic assessment for the second component. Results show that our proposal can be efficient and useful for students in a medical learning environment.
{"title":"A learning support tool with clinical cases based on concept maps and medical entity recognition","authors":"M. Villa, Fernando Aparicio, Manuel J. Maña López, M. Rodríguez","doi":"10.1145/2166966.2166978","DOIUrl":"https://doi.org/10.1145/2166966.2166978","url":null,"abstract":"The search for truthful health information through Internet is an increasingly complex process due to the growing amount of resources. Access to information can be difficult to control even in environments where the goal pursued is well-defined, as in the case of learning activities with medical students. In this paper, we present a computer tool devised to ease the process of understanding medical concepts from information in clinical case histories. To this end, it automatically constructs concept maps and presents reliable information from different ontologies and knowledge bases. The two main components of the system are an Intelligent Information Access interface and a Concept Map Graph that retrieves medical concepts from a text input, and provides rich information and semantically related concepts. The paper includes a user evaluation of the first component and a systematic assessment for the second component. Results show that our proposal can be efficient and useful for students in a medical learning environment.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82531416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We present PhysicsBook, a prototype system that enables users to solve physics problems using a sketch-based interface and then animates any diagram used in solving the problem to show that the solution is correct. PhysicsBook recognizes the diagrams in the solution and infers relationships among diagram components through the recognition of mathematics and annotations such as arrows and dotted lines. For animation, PhysicsBook uses a customized physics engine that provides entry points for hand-written mathematics and diagrams. We discuss the design of PhysicsBook, including details of algorithms for sketch recognition, inference of user intent and creation of animations based on the mathematics written by a user. Specifically, we describe how the physics engine uses domain knowledge to perform data transformations in instances where it cannot use a given equation directly. This enables PhysicsBook to deal with domains of problems that are not directly related to classical mechanics. We provide examples of scenarios of how PhysicsBook could be used as part of an intelligent tutoring system and discuss the strengths and weaknesses of our current prototype. Lastly, we present the findings of a preliminary usability study with five participants.
{"title":"PhysicsBook: a sketch-based interface for animating physics diagrams","authors":"Salman Cheema, J. Laviola","doi":"10.1145/2166966.2166977","DOIUrl":"https://doi.org/10.1145/2166966.2166977","url":null,"abstract":"We present PhysicsBook, a prototype system that enables users to solve physics problems using a sketch-based interface and then animates any diagram used in solving the problem to show that the solution is correct. PhysicsBook recognizes the diagrams in the solution and infers relationships among diagram components through the recognition of mathematics and annotations such as arrows and dotted lines. For animation, PhysicsBook uses a customized physics engine that provides entry points for hand-written mathematics and diagrams. We discuss the design of PhysicsBook, including details of algorithms for sketch recognition, inference of user intent and creation of animations based on the mathematics written by a user. Specifically, we describe how the physics engine uses domain knowledge to perform data transformations in instances where it cannot use a given equation directly. This enables PhysicsBook to deal with domains of problems that are not directly related to classical mechanics. We provide examples of scenarios of how PhysicsBook could be used as part of an intelligent tutoring system and discuss the strengths and weaknesses of our current prototype. Lastly, we present the findings of a preliminary usability study with five participants.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84770786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Bigdelou, L. Schwarz, Tobias Benz, Nassir Navab
In this paper, we introduce a flexible framework that can facilitate the definition of 3D gesture-based interfaces. Highlighting the need for context awareness in complex domains, such as the operating room, we argue how the proposed architecture can overcome integration challenges. Through a real-life scenario, an intra-operative medical image viewer, we demonstrate how the proposed framework can be used in practice to define user interfaces in collaborative environments, where the behavior and the system response can be adapted based on the current workflow stage and individual user requirements. Finally, we demonstrate how the defined interface can be manipulated using a high-level visual programming interface. The extensibility of the proposed architecture makes it applicable to a wide range of scenarios.
{"title":"A flexible platform for developing context-aware 3D gesture-based interfaces","authors":"A. Bigdelou, L. Schwarz, Tobias Benz, Nassir Navab","doi":"10.1145/2166966.2167040","DOIUrl":"https://doi.org/10.1145/2166966.2167040","url":null,"abstract":"In this paper, we introduce a flexible framework that can facilitate the definition of 3D gesture-based interfaces. Highlighting the need for context awareness in complex domains, such as the operating room, we argue how the proposed architecture can overcome integration challenges. Through a real-life scenario, an intra-operative medical image viewer, we demonstrate how the proposed framework can be used in practice to define user interfaces in collaborative environments, where the behavior and the system response can be adapted based on the current workflow stage and individual user requirements. Finally, we demonstrate how the defined interface can be manipulated using a high-level visual programming interface. The extensibility of the proposed architecture makes it applicable to a wide range of scenarios.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78849459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Ajmera, Om Deshmukh, Anupam Jain, A. A. Nanavati, Nitendra Rajput, Saurabh Srivastava
Word clouds are extensively used to present a summary of the prominent words in a document on the World Wide Web. Such clouds give the user an idea about the content of the document. In this paper we present a mechanism to create and render an audio cloud for audio content. Such audio clouds are expected to provide a similar summary of the audio documents. They have wide applicability in various domains, especially for low-literate users who currently do not use the Internet but interact with audio-based systems. Detecting words from an audio content is challenging, especially if the audio is in languages for which a speech recognition system does not exist. We present a language-independent mechanism to detect frequently occurring words within an audio document. We then present four ways to render these words that form an audio cloud. The four prototypes for rendering the audio cloud are based on varying the amplitude, the voice quality, echo and the repetition of audio words. An evaluation study conducted across 32 users suggests that literate and low-literate users easily understand the concept of audio cloud.
{"title":"Audio cloud: creation and rendering","authors":"J. Ajmera, Om Deshmukh, Anupam Jain, A. A. Nanavati, Nitendra Rajput, Saurabh Srivastava","doi":"10.1145/2166966.2167017","DOIUrl":"https://doi.org/10.1145/2166966.2167017","url":null,"abstract":"Word clouds are extensively used to present a summary of the prominent words in a document on the World Wide Web. Such clouds give the user an idea about the content of the document. In this paper we present a mechanism to create and render an audio cloud for audio content. Such audio clouds are expected to provide a similar summary of the audio documents. They have wide applicability in various domains, especially for low-literate users who currently do not use the Internet but interact with audio-based systems.\u0000 Detecting words from an audio content is challenging, especially if the audio is in languages for which a speech recognition system does not exist. We present a language-independent mechanism to detect frequently occurring words within an audio document. We then present four ways to render these words that form an audio cloud. The four prototypes for rendering the audio cloud are based on varying the amplitude, the voice quality, echo and the repetition of audio words. An evaluation study conducted across 32 users suggests that literate and low-literate users easily understand the concept of audio cloud.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73526522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Access to Information and Communication Technology (ICT) has the potential to improve the quality of life for many members of the ageing population. However, some older users lack the intrinsic motivation to learn to use this technology, and poor user interface design is partly to blame. The research presented here investigates how motivation theory can be applied to interface design in order to encourage older users to learn to use ICT. In addition to a brief literature review, an overview of methods, research goals, and current research status are presented.
{"title":"Using theories of intrinsic motivation to support ICT learning for the ageing population","authors":"Tanya Goldhaber","doi":"10.1145/2166966.2167048","DOIUrl":"https://doi.org/10.1145/2166966.2167048","url":null,"abstract":"Access to Information and Communication Technology (ICT) has the potential to improve the quality of life for many members of the ageing population. However, some older users lack the intrinsic motivation to learn to use this technology, and poor user interface design is partly to blame. The research presented here investigates how motivation theory can be applied to interface design in order to encourage older users to learn to use ICT. In addition to a brief literature review, an overview of methods, research goals, and current research status are presented.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75847096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Over the last few years, the conventional brick and mortar business model has been challenged by the proliferation of smartphone-based shopping apps, which exploit the weaknesses of this conventional model. As an alternative to these apps, we have developed Ubira [1], a patent-pending service platform that allows healthy online/offline competition rather than merely exploiting the weaknesses. This business model provides brick and mortar shops a fair chance to compete with online stores while creating a seamless shopping experience for in-store customers based on an online/offline partnership. The main design challenge in Ubira has been to promote serendipity in shopping rather than bargain hunting, and integrate the legacy inventory systems of brick and mortar businesses into the platform. To overcome these challenges, we have made some critical design choices based on context awareness and seamful design methods.
{"title":"Seamless online/offline shopping experience design for in-store customers","authors":"U. Bandara","doi":"10.1145/2166966.2167036","DOIUrl":"https://doi.org/10.1145/2166966.2167036","url":null,"abstract":"Over the last few years, the conventional brick and mortar business model has been challenged by the proliferation of smartphone-based shopping apps, which exploit the weaknesses of this conventional model. As an alternative to these apps, we have developed Ubira [1], a patent-pending service platform that allows healthy online/offline competition rather than merely exploiting the weaknesses. This business model provides brick and mortar shops a fair chance to compete with online stores while creating a seamless shopping experience for in-store customers based on an online/offline partnership. The main design challenge in Ubira has been to promote serendipity in shopping rather than bargain hunting, and integrate the legacy inventory systems of brick and mortar businesses into the platform. To overcome these challenges, we have made some critical design choices based on context awareness and seamful design methods.","PeriodicalId":87287,"journal":{"name":"IUI. International Conference on Intelligent User Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2012-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74821626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}