首页 > 最新文献

Proceedings of the 2019 Conference on Human Information Interaction and Retrieval最新文献

英文 中文
Examining and Supporting Laypeople's Learning in Online Health Information Seeking 检查和支持外行人在线健康信息查询学习
Yu Chi
It has long been understood that knowledge acquisition is an important component in the information seeking process [2,18]. Further, empirical studies have demonstrated that learning is a common phenomenon in information seeking[8, 10, 20]. However, for users, especially laypeople, who must gain knowledge through their interactions with a search engine, the current general-purpose search engine does not sufficiently support learning through search. Health information seeking (HIS, hereafter) is a domain-specific search [14], where users who possess higher knowledge tend to have better strategies and performances in solving their search tasks [3, 21]. While learning clearly plays an important role in the HIS process, there has been little research in this area. Little is known about the factors that might enhance or impede such learning during online HIS. Therefore, this project aims at examining health consumers, especially laypeople's search as learning behaviors and performances. A mixed method design will be adopted, consisting of experimental-based studies and interviews. So far, we have conducted 24 user studies and semi-structured interviews, investigating the source selection behaviors in the HIS tasks with increasing levels of learning goals. The results of this phase of the study will be used to guide the following analysis and predict laypeople's knowledge levels in the HIS process and provide corresponding support.
人们早就认识到,知识获取是信息寻求过程中的一个重要组成部分[2,18]。此外,实证研究表明,学习是信息寻找中的一种普遍现象[8,10,20]。然而,对于必须通过与搜索引擎的交互来获取知识的用户,特别是外行人来说,目前的通用搜索引擎并没有足够的支持通过搜索来学习。健康信息搜索(HIS,下文简称HIS)是一种特定领域的搜索[14],拥有更高知识的用户在解决搜索任务时往往具有更好的策略和性能[3,21]。虽然学习显然在HIS过程中起着重要作用,但这方面的研究却很少。在在线高等教育中,可能促进或阻碍这种学习的因素知之甚少。因此,本项目旨在研究健康消费者,特别是外行人的搜索作为学习行为和表现。将采用混合方法设计,包括基于实验的研究和访谈。到目前为止,我们已经进行了24项用户研究和半结构化访谈,调查了随着学习目标水平的提高,HIS任务中的资源选择行为。这一阶段的研究结果将用于指导接下来的分析,并预测外行人在卫生信息系统过程中的知识水平,并提供相应的支持。
{"title":"Examining and Supporting Laypeople's Learning in Online Health Information Seeking","authors":"Yu Chi","doi":"10.1145/3295750.3298975","DOIUrl":"https://doi.org/10.1145/3295750.3298975","url":null,"abstract":"It has long been understood that knowledge acquisition is an important component in the information seeking process [2,18]. Further, empirical studies have demonstrated that learning is a common phenomenon in information seeking[8, 10, 20]. However, for users, especially laypeople, who must gain knowledge through their interactions with a search engine, the current general-purpose search engine does not sufficiently support learning through search. Health information seeking (HIS, hereafter) is a domain-specific search [14], where users who possess higher knowledge tend to have better strategies and performances in solving their search tasks [3, 21]. While learning clearly plays an important role in the HIS process, there has been little research in this area. Little is known about the factors that might enhance or impede such learning during online HIS. Therefore, this project aims at examining health consumers, especially laypeople's search as learning behaviors and performances. A mixed method design will be adopted, consisting of experimental-based studies and interviews. So far, we have conducted 24 user studies and semi-structured interviews, investigating the source selection behaviors in the HIS tasks with increasing levels of learning goals. The results of this phase of the study will be used to guide the following analysis and predict laypeople's knowledge levels in the HIS process and provide corresponding support.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130859849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Towards Non-Visual Web Search 走向非视觉网络搜索
Alexandra Vtyurina
Speech-based user interfaces and, in particular, voice-activated digital assistants are gaining popularity. Assistants provide their users with an opportunity for hands-free interaction, and present an additional accessibility level for people who are blind. According to prior research, informational searches form a noticeable fraction of user interactions with the assistants. All major commercially available assistants handle factoid questions well by providing an answer that is quick, concise, and to-the-point. However, for complex information seeking intents, when a deeper exploration and multi-turn interaction may be required, the assistants often do not produce the desired results. One of the main challenges for designing a voice-based web search system is the higher cognitive load for audio perception compared to visual perception. Additionally, close attention should be paid at differences in designing for different user groups, as their information seeking styles and design needs and may differ. In this work, we discuss the challenges of designing systems for non-visual ad-hoc web search and exploration and outline a set of proposed experiments tackling various aspects of non-visual web search.
基于语音的用户界面,特别是语音激活的数字助理越来越受欢迎。助手为用户提供了免提交互的机会,并为盲人提供了额外的访问级别。根据之前的研究,信息搜索在用户与助手的交互中占据了相当大的比例。所有主要的商业助理都能很好地处理假设性问题,提供快速、简洁、切中要害的答案。然而,对于复杂的信息搜索意图,当需要更深入的探索和多回合交互时,助手往往不能产生预期的结果。设计基于语音的网络搜索系统的主要挑战之一是音频感知比视觉感知具有更高的认知负荷。此外,应密切关注不同用户群体的设计差异,因为他们的信息寻求风格和设计需求可能有所不同。在这项工作中,我们讨论了设计非视觉自组织网络搜索和探索系统所面临的挑战,并概述了一组针对非视觉网络搜索各个方面的拟议实验。
{"title":"Towards Non-Visual Web Search","authors":"Alexandra Vtyurina","doi":"10.1145/3295750.3298976","DOIUrl":"https://doi.org/10.1145/3295750.3298976","url":null,"abstract":"Speech-based user interfaces and, in particular, voice-activated digital assistants are gaining popularity. Assistants provide their users with an opportunity for hands-free interaction, and present an additional accessibility level for people who are blind. According to prior research, informational searches form a noticeable fraction of user interactions with the assistants. All major commercially available assistants handle factoid questions well by providing an answer that is quick, concise, and to-the-point. However, for complex information seeking intents, when a deeper exploration and multi-turn interaction may be required, the assistants often do not produce the desired results. One of the main challenges for designing a voice-based web search system is the higher cognitive load for audio perception compared to visual perception. Additionally, close attention should be paid at differences in designing for different user groups, as their information seeking styles and design needs and may differ. In this work, we discuss the challenges of designing systems for non-visual ad-hoc web search and exploration and outline a set of proposed experiments tackling various aspects of non-visual web search.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129606283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A Study of Academic Search Scenarios and Information Seeking Behaviour 学术搜索情境与信息搜寻行为研究
O. Hoeber, Dolinkumar Patel, D. Storie
An important contribution in the development of interactive information retrieval as a research discipline has been the specification of information seeking models. A variety of such models have been documented, some of which apply generally to a broad set of search settings, and others which are specific to settings such as academic search. Within the domain of academic search, it is unclear to what extent searchers employ the strategies specified in such models when faced with different types of information needs (ranging from fact verification to knowledge discovery). Using an online questionnaire that presented four different academic search scenarios, we collected data on the self-reported likelihood of researchers (professors, graduate students) to use specific strategies from each of five different information seeking models. Preliminary analysis of data from a pilot study (n=10) has revealed differences in which of the strategies are employed depending on the type of search scenario as well as the level of expertise of the searcher.
在交互式信息检索作为一门研究学科的发展中,一个重要的贡献是信息查找模型的规范。已经记录了各种这样的模型,其中一些通常适用于广泛的搜索设置,而另一些则特定于诸如学术搜索之类的设置。在学术搜索领域,当面对不同类型的信息需求(从事实验证到知识发现)时,搜索者在多大程度上使用这些模型中指定的策略是不清楚的。我们使用一份在线问卷,展示了四种不同的学术搜索场景,收集了研究人员(教授、研究生)使用五种不同信息搜索模型中每种特定策略的自我报告可能性的数据。对一项试点研究(n=10)数据的初步分析显示,根据搜索情景的类型以及搜索者的专业知识水平,所采用的策略有所不同。
{"title":"A Study of Academic Search Scenarios and Information Seeking Behaviour","authors":"O. Hoeber, Dolinkumar Patel, D. Storie","doi":"10.1145/3295750.3298943","DOIUrl":"https://doi.org/10.1145/3295750.3298943","url":null,"abstract":"An important contribution in the development of interactive information retrieval as a research discipline has been the specification of information seeking models. A variety of such models have been documented, some of which apply generally to a broad set of search settings, and others which are specific to settings such as academic search. Within the domain of academic search, it is unclear to what extent searchers employ the strategies specified in such models when faced with different types of information needs (ranging from fact verification to knowledge discovery). Using an online questionnaire that presented four different academic search scenarios, we collected data on the self-reported likelihood of researchers (professors, graduate students) to use specific strategies from each of five different information seeking models. Preliminary analysis of data from a pilot study (n=10) has revealed differences in which of the strategies are employed depending on the type of search scenario as well as the level of expertise of the searcher.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134080083","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Collaborative Information Seeking in Tourism: A Study of Young Chinese Leisure Tourists Visiting Australia 旅游中的协同信息寻求:中国青年赴澳休闲游客研究
Mouda Ye
People often travel in groups where information seeking occurs throughout the whole course of travel before various decisions can be made. This qualitative study investigates how small groups of young Chinese leisure tourists conduct collaborative information seeking (CIS) to support their joint decision-making as travelling to Australia through a grounded theory approach. Most of existing literature in CIS are limited to workplace contexts. In addition, previous studies often failed to include the outcome of information seeking to better understand collaboration as a process of joint decision-making. This study aims to develop new models and theories of tourist CIS, propose appropriate methods to study CIS in leisure contexts and provide practical implication regarding the design of CIS tools and systems for tourists. This research contributes to existing understandings of CIS by exploring the understudied leisure context, investigating it in a broader framework of joint decision-making, and looking at a comprehensive project where CIS occurs instead of individual information seeking tasks.
人们经常组团旅行,在做出各种决定之前,信息搜索贯穿于整个旅行过程。本定性研究通过基于理论的方法,探讨了中国年轻休闲游客小团体如何进行协同信息寻求(CIS),以支持他们在澳大利亚旅游时的共同决策。大多数关于CIS的现有文献都局限于工作场所环境。此外,以前的研究往往没有包括信息寻求的结果,以更好地理解协作作为一个共同决策的过程。本研究旨在建立新的旅游CIS模型和理论,提出适合休闲情境下旅游CIS研究的方法,并为旅游CIS工具和系统的设计提供实践启示。本研究通过探索未被充分研究的休闲环境,在更广泛的联合决策框架中进行调查,并研究一个综合项目,其中CIS发生而不是个人信息寻求任务,从而有助于对CIS的现有理解。
{"title":"Collaborative Information Seeking in Tourism: A Study of Young Chinese Leisure Tourists Visiting Australia","authors":"Mouda Ye","doi":"10.1145/3295750.3298979","DOIUrl":"https://doi.org/10.1145/3295750.3298979","url":null,"abstract":"People often travel in groups where information seeking occurs throughout the whole course of travel before various decisions can be made. This qualitative study investigates how small groups of young Chinese leisure tourists conduct collaborative information seeking (CIS) to support their joint decision-making as travelling to Australia through a grounded theory approach. Most of existing literature in CIS are limited to workplace contexts. In addition, previous studies often failed to include the outcome of information seeking to better understand collaboration as a process of joint decision-making. This study aims to develop new models and theories of tourist CIS, propose appropriate methods to study CIS in leisure contexts and provide practical implication regarding the design of CIS tools and systems for tourists. This research contributes to existing understandings of CIS by exploring the understudied leisure context, investigating it in a broader framework of joint decision-making, and looking at a comprehensive project where CIS occurs instead of individual information seeking tasks.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116263201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The CLARIAH Media Suite: a Hybrid Approach to System Design in the Humanities CLARIAH媒体套件:人文学科系统设计的混合方法
L. M. Estrada, M. Koolen, K. Beelen, Hugo C. Huurdeman, Mari Wigham, C. Martinez-Ortiz, Jaap Blom, R. Ordelman
The practices of digital humanists are evolving, highly diversified and experimental. There is also a lack of agreement about whether or not digital humanists should have data and programming skills. Thus, their underlying needs for higher levels of flexibility and transparency may be contradicted by their explicit requests for user-friendly graphic user interfaces (GUIs), creating challenges for designing information systems in the digital humanities. This paper describes the experience of designing the Media Suite, which provides access to important Dutch audiovisual collections and is part of the Dutch infrastructure for digital humanities. We outline a solution to the conflicting needs of scholars, by combining a semi-traditional GUI with Jupyter Notebooks. This solution tackles the needs of both novice and advanced users in digital research methods in the humanities. This demonstration paper explains how the Media Suite and the Jupyter notebooks work together, and elaborates on the rationale behind the design choices. We also outline the implications this hybrid and extensible approach has for interface design for the information science and scholarly community.
数字人文主义者的实践正在不断发展,高度多样化和实验性。对于数字人文主义者是否应该具备数据和编程技能,也缺乏共识。因此,他们对更高水平的灵活性和透明度的潜在需求可能与他们对用户友好图形用户界面(gui)的明确要求相矛盾,从而为设计数字人文领域的信息系统带来挑战。本文描述了设计媒体套件的经验,它提供了访问重要的荷兰视听收藏,是荷兰数字人文基础设施的一部分。我们通过将半传统GUI与Jupyter notebook相结合,概述了解决学者冲突需求的解决方案。该解决方案解决了新手和高级用户在人文学科数字研究方法方面的需求。这篇演示论文解释了Media Suite和Jupyter笔记本如何协同工作,并详细说明了设计选择背后的基本原理。我们还概述了这种混合和可扩展的方法对信息科学和学术社区的界面设计的影响。
{"title":"The CLARIAH Media Suite: a Hybrid Approach to System Design in the Humanities","authors":"L. M. Estrada, M. Koolen, K. Beelen, Hugo C. Huurdeman, Mari Wigham, C. Martinez-Ortiz, Jaap Blom, R. Ordelman","doi":"10.1145/3295750.3298918","DOIUrl":"https://doi.org/10.1145/3295750.3298918","url":null,"abstract":"The practices of digital humanists are evolving, highly diversified and experimental. There is also a lack of agreement about whether or not digital humanists should have data and programming skills. Thus, their underlying needs for higher levels of flexibility and transparency may be contradicted by their explicit requests for user-friendly graphic user interfaces (GUIs), creating challenges for designing information systems in the digital humanities. This paper describes the experience of designing the Media Suite, which provides access to important Dutch audiovisual collections and is part of the Dutch infrastructure for digital humanities. We outline a solution to the conflicting needs of scholars, by combining a semi-traditional GUI with Jupyter Notebooks. This solution tackles the needs of both novice and advanced users in digital research methods in the humanities. This demonstration paper explains how the Media Suite and the Jupyter notebooks work together, and elaborates on the rationale behind the design choices. We also outline the implications this hybrid and extensible approach has for interface design for the information science and scholarly community.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123867764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A Rank-biased Neural Network Model for Click Modeling 基于秩偏神经网络的点击建模
Haitao Yu, A. Jatowt, Roi Blanco, J. Jose, K. Zhou
Query logs contain rich feedback information from a large number of users interacting with search engines. Various click models have been developed to decode users' search behavior and to extract useful knowledge from query logs. Although the state-of-the-art neural click models have been shown to be very effective in click modeling, the input representations of queries and documents rely on either manually crafted features or on automatic methods suffering from the high-dimensionality issue. Moreover, these neural click models are still rather restrictive when coping with commonly biased user clicks. In this paper, we investigate how to effectively deploy a neural network model for decoding users' click behavior. First, we present two novel rank-biased neural network models ($RBNN$ and $RBNN^* $) for click modeling. The key idea is to deploy different weight matrices across different rank positions. Second, we introduce a new method ($QDmymathhyphen DCCA$) for automatically learning the vector representations for both queries and documents within the same low-dimensional space, which provides high-quality inputs for $RBNN$ and $RBNN^* $. Finally, a series of experiments are conducted on two different real query logs to validate the effectiveness and efficiency of the proposed neural click models. The experiments demonstrate that: (1) The proposed models can achieve substantially improved performance over the state-of-the-art baseline on two datasets across multiple metrics. By incorporating rank-specific weight matrices, $RBNN$ and $RBNN^* $ are more capable of dealing with the position-bias problem. (2) The input representations of queries, documents and context information significantly affect the performance of neural click models. Thanks to the application of $QDmymathhyphen DCCA$, not only $RBNN$ and $RBNN^* $ but also the baseline method exhibit enhanced performance. Furthermore, the training cost under the proposed models is greatly reduced.
查询日志包含了大量用户与搜索引擎交互的丰富反馈信息。人们开发了各种点击模型来解码用户的搜索行为,并从查询日志中提取有用的知识。尽管最先进的神经点击模型在点击建模方面非常有效,但是查询和文档的输入表示要么依赖于手工制作的特征,要么依赖于受高维问题困扰的自动方法。此外,这些神经点击模型在处理普遍存在偏差的用户点击时仍然相当有限。在本文中,我们研究了如何有效地部署神经网络模型来解码用户的点击行为。首先,我们提出了两个新的秩偏神经网络模型($RBNN$和$RBNN^* $)用于点击建模。关键思想是在不同的等级位置上部署不同的权重矩阵。其次,我们引入了一种新方法($QDmymathhyphen DCCA$),用于自动学习同一低维空间内查询和文档的向量表示,该方法为$RBNN$和$RBNN^* $提供了高质量的输入。最后,在两种不同的真实查询日志上进行了一系列实验,以验证所提出的神经点击模型的有效性和效率。实验表明:(1)在两个数据集的多个指标上,所提出的模型可以在最先进的基线上取得显着提高的性能。通过结合秩相关权重矩阵,$RBNN$和$RBNN^* $能够更好地处理位置偏差问题。(2)查询、文档和上下文信息的输入表示显著影响神经点击模型的性能。由于使用了$QDmymathhyphen DCCA$,不仅$RBNN$和$RBNN^* $,而且基线方法的性能也得到了提高。此外,所提模型下的训练成本也大大降低。
{"title":"A Rank-biased Neural Network Model for Click Modeling","authors":"Haitao Yu, A. Jatowt, Roi Blanco, J. Jose, K. Zhou","doi":"10.1145/3295750.3298920","DOIUrl":"https://doi.org/10.1145/3295750.3298920","url":null,"abstract":"Query logs contain rich feedback information from a large number of users interacting with search engines. Various click models have been developed to decode users' search behavior and to extract useful knowledge from query logs. Although the state-of-the-art neural click models have been shown to be very effective in click modeling, the input representations of queries and documents rely on either manually crafted features or on automatic methods suffering from the high-dimensionality issue. Moreover, these neural click models are still rather restrictive when coping with commonly biased user clicks. In this paper, we investigate how to effectively deploy a neural network model for decoding users' click behavior. First, we present two novel rank-biased neural network models ($RBNN$ and $RBNN^* $) for click modeling. The key idea is to deploy different weight matrices across different rank positions. Second, we introduce a new method ($QDmymathhyphen DCCA$) for automatically learning the vector representations for both queries and documents within the same low-dimensional space, which provides high-quality inputs for $RBNN$ and $RBNN^* $. Finally, a series of experiments are conducted on two different real query logs to validate the effectiveness and efficiency of the proposed neural click models. The experiments demonstrate that: (1) The proposed models can achieve substantially improved performance over the state-of-the-art baseline on two datasets across multiple metrics. By incorporating rank-specific weight matrices, $RBNN$ and $RBNN^* $ are more capable of dealing with the position-bias problem. (2) The input representations of queries, documents and context information significantly affect the performance of neural click models. Thanks to the application of $QDmymathhyphen DCCA$, not only $RBNN$ and $RBNN^* $ but also the baseline method exhibit enhanced performance. Furthermore, the training cost under the proposed models is greatly reduced.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115920827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Data-Driven Design: Beyond A/B Testing 数据驱动设计:超越A/B测试
Ranjitha Kumar
A/B testing has become the de facto standard for optimizing design, helping designers craft more effective user experiences by leveraging data. A typical A/B test involves dividing user traffic between two experimental conditions (A and B), and looking for statistically significant differences in performance indicators (e.g., conversion rates) between them. While this technique is popular, there are other, powerful data-driven methods --- complementary to A/B testing --- that can tie design choices to desired outcomes. Mining data from existing designs can expose designers to a greater space of divergent solutions than A/B testing [1,4] ,RICO:2017. Since companies cannot predict a priori if the engineering effort for creating alternatives will be commensurate with a performance increase, they often test small changes, along gradients to local optima. With the millions of websites and mobile apps available today, it is likely that almost any UX problem a designer encounters has already been considered and solved by someone. The challenges are finding relevant existing solutions, measuring their performance, and correlating these metrics with design features. Recent systems that capture and aggregate interaction data from third-party Android apps --- with zero code integration --- open-source analytics that were previously locked away in each app, allowing designers to test and compare UI/UX patterns found in the wild: [2,3] 2017. Lightweight prototypes with tight user feedback loops, or experimentation engines, can bootstrap product design involving technologies that are actively being developed (e.g., artificial intelligence, virtual/augmented reality), where both use cases and capabilities are not well-understood [5]. These systems afford staged automation: initially, "Wizard of Oz'' techniques can scaffold needfinding, and eventually be replaced with automated solutions informed by the collected data. For example, a chatbot deployed on social media can serve as an experimentation engine for automating fashion advice [7]. At first, a pool of personal stylists can power the chatbot to collect organic conversations revealing common fashion problems, effective interaction patterns for addressing them, and design considerations for automation. Once technologies are developed to scale useful interventions [8,9], the chatbot platform provides a testbed for iteratively refining them. Generative models trained on a set of effective design examples can support predictive workflows that allow designers to rapidly prototype new, performant solutions [6]. Models such as generative adversarial networks and variational autoencoders can produce designs based on high-level constraints, or complete them given partial specifications. For example, a mobile wireframing tool backed by such a model could suggest adding "username" and "password" input fields to a screen with a centrally placed "login" button.
A/B测试已经成为优化设计的标准,帮助设计师利用数据创造更有效的用户体验。典型的A/B测试包括在两个实验条件(A和B)之间划分用户流量,并寻找它们之间性能指标(如转化率)的统计显著差异。虽然这种技术很流行,但还有其他强大的数据驱动方法(作为A/B测试的补充)可以将设计选择与期望的结果联系起来。从现有设计中挖掘数据可以让设计师接触到比a /B测试更大的不同解决方案空间[1,4],RICO:2017。由于公司不能先验地预测创造替代方案的工程努力是否与性能提升相称,他们经常测试小的变化,沿着梯度到局部最优。如今有数以百万计的网站和移动应用程序,设计师遇到的几乎所有UX问题都已经有人考虑过并解决了。挑战在于找到相关的现有解决方案,衡量它们的性能,并将这些指标与设计特性联系起来。最近的系统捕获和汇总来自第三方Android应用程序的交互数据-零代码集成-以前锁定在每个应用程序中的开源分析,允许设计师测试和比较在野外发现的UI/UX模式:[2,3]2017。轻量级原型与紧密的用户反馈循环,或实验引擎,可以引导产品设计涉及正在积极开发的技术(例如,人工智能,虚拟/增强现实),其中用例和功能都不是很好地理解[5]。这些系统提供了阶段性的自动化:最初,“绿野仙踪”技术可以帮助找到需求,最终被收集到的数据提供的自动化解决方案所取代。例如,部署在社交媒体上的聊天机器人可以作为自动提供时尚建议的实验引擎[7]。首先,一群个人造型师可以为聊天机器人提供动力,收集揭示常见时尚问题的有机对话,解决这些问题的有效交互模式,以及自动化的设计考虑因素。一旦技术发展到可扩展有用的干预措施[8,9],聊天机器人平台就为迭代改进它们提供了一个测试平台。在一组有效的设计示例上训练的生成模型可以支持预测性工作流程,使设计人员能够快速构建新的高性能解决方案的原型[6]。生成对抗网络和变分自编码器等模型可以基于高级约束产生设计,或者在给定部分规范的情况下完成设计。例如,由这种模型支持的移动线框图工具可以建议在屏幕上添加“用户名”和“密码”输入字段,并在屏幕中央放置“登录”按钮。
{"title":"Data-Driven Design: Beyond A/B Testing","authors":"Ranjitha Kumar","doi":"10.1145/3295750.3300046","DOIUrl":"https://doi.org/10.1145/3295750.3300046","url":null,"abstract":"A/B testing has become the de facto standard for optimizing design, helping designers craft more effective user experiences by leveraging data. A typical A/B test involves dividing user traffic between two experimental conditions (A and B), and looking for statistically significant differences in performance indicators (e.g., conversion rates) between them. While this technique is popular, there are other, powerful data-driven methods --- complementary to A/B testing --- that can tie design choices to desired outcomes. Mining data from existing designs can expose designers to a greater space of divergent solutions than A/B testing [1,4] ,RICO:2017. Since companies cannot predict a priori if the engineering effort for creating alternatives will be commensurate with a performance increase, they often test small changes, along gradients to local optima. With the millions of websites and mobile apps available today, it is likely that almost any UX problem a designer encounters has already been considered and solved by someone. The challenges are finding relevant existing solutions, measuring their performance, and correlating these metrics with design features. Recent systems that capture and aggregate interaction data from third-party Android apps --- with zero code integration --- open-source analytics that were previously locked away in each app, allowing designers to test and compare UI/UX patterns found in the wild: [2,3] 2017. Lightweight prototypes with tight user feedback loops, or experimentation engines, can bootstrap product design involving technologies that are actively being developed (e.g., artificial intelligence, virtual/augmented reality), where both use cases and capabilities are not well-understood [5]. These systems afford staged automation: initially, \"Wizard of Oz'' techniques can scaffold needfinding, and eventually be replaced with automated solutions informed by the collected data. For example, a chatbot deployed on social media can serve as an experimentation engine for automating fashion advice [7]. At first, a pool of personal stylists can power the chatbot to collect organic conversations revealing common fashion problems, effective interaction patterns for addressing them, and design considerations for automation. Once technologies are developed to scale useful interventions [8,9], the chatbot platform provides a testbed for iteratively refining them. Generative models trained on a set of effective design examples can support predictive workflows that allow designers to rapidly prototype new, performant solutions [6]. Models such as generative adversarial networks and variational autoencoders can produce designs based on high-level constraints, or complete them given partial specifications. For example, a mobile wireframing tool backed by such a model could suggest adding \"username\" and \"password\" input fields to a screen with a centrally placed \"login\" button.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123425187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Experimental Methods in IIR: The Tension between Rigour and Ethics in Studies Involving Users with Dyslexia IIR的实验方法:涉及阅读障碍使用者的研究中严谨与伦理之间的张力
G. Berget, A. MacFarlane
Designing user studies in the interactive information retrieval (IIR) paradigm on people with impairments may sometimes require different methodological considerations than for other users. Consequently, there may be a tension between what the community regards as being a rigorous methodology against what researchers can do ethically with their users. This paper discusses issues to consider when designing IIR studies involving people with dyslexia, such as sampling, informed consent and data collection. The conclusion is that conducting user studies on participants with dyslexia requires special considerations at all stages of the experimental design. The purpose of this paper is to raise awareness and understanding in the research community about experimental methods involving users with dyslexia, and addresses researchers, as well as editors and reviewers. Several of the issues raised do not only apply to people with dyslexia, but have implications when researching other groups, for instance elderly people and users with learning, cognitive, sensory or motor impairments.
在交互式信息检索(IIR)范式中设计针对残疾人的用户研究有时可能需要与其他用户不同的方法考虑。因此,在社区所认为的严谨的方法论与研究人员对其用户所能做的合乎道德的事情之间可能存在紧张关系。本文讨论了在设计涉及阅读障碍患者的IIR研究时需要考虑的问题,如抽样、知情同意和数据收集。结论是,对有阅读障碍的参与者进行用户研究需要在实验设计的各个阶段都进行特殊的考虑。本文的目的是提高研究界对涉及阅读障碍用户的实验方法的认识和理解,并向研究人员、编辑和审稿人提出建议。提出的一些问题不仅适用于有阅读障碍的人,而且在研究其他群体时也有影响,例如老年人和有学习、认知、感觉或运动障碍的用户。
{"title":"Experimental Methods in IIR: The Tension between Rigour and Ethics in Studies Involving Users with Dyslexia","authors":"G. Berget, A. MacFarlane","doi":"10.1145/3295750.3298939","DOIUrl":"https://doi.org/10.1145/3295750.3298939","url":null,"abstract":"Designing user studies in the interactive information retrieval (IIR) paradigm on people with impairments may sometimes require different methodological considerations than for other users. Consequently, there may be a tension between what the community regards as being a rigorous methodology against what researchers can do ethically with their users. This paper discusses issues to consider when designing IIR studies involving people with dyslexia, such as sampling, informed consent and data collection. The conclusion is that conducting user studies on participants with dyslexia requires special considerations at all stages of the experimental design. The purpose of this paper is to raise awareness and understanding in the research community about experimental methods involving users with dyslexia, and addresses researchers, as well as editors and reviewers. Several of the issues raised do not only apply to people with dyslexia, but have implications when researching other groups, for instance elderly people and users with learning, cognitive, sensory or motor impairments.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"5 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128916545","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Measuring Learning During Search: Differences in Interactions, Eye-Gaze, and Semantic Similarity to Expert Knowledge 在搜索过程中测量学习:交互、眼睛注视和对专家知识的语义相似性的差异
Nilavra Bhattacharya, J. Gwizdka
We investigate the relationship between search behavior, eye -tracking measures, and learning. We conducted a user study where 30 participants performed searches on the web. We measured their verbal knowledge before and after each task in a content-independent manner, by assessing the semantic similarity of their entries to expert vocabulary. We hypothesize that differences in verbal knowledge-change of participants are reflected in their search behaviors and eye-gaze measures related to acquiring information and reading. Our results show that participants with higher change in verbal knowledge differ by reading significantly less, and entering more sophisticated queries, compared to those with lower change in knowledge. However, we do not find significant differences in other search interactions like page visits, and number of queries.
我们研究了搜索行为、眼动追踪测量和学习之间的关系。我们进行了一项用户研究,30名参与者在网上进行搜索。我们通过评估他们的词条与专家词汇的语义相似性,以一种与内容无关的方式测量了他们在每个任务之前和之后的词汇知识。我们假设参与者的语言知识变化差异反映在他们的搜索行为和与获取信息和阅读相关的目光测量中。我们的研究结果表明,与知识变化较小的参与者相比,语言知识变化较大的参与者在阅读和输入更复杂的查询方面明显减少。然而,我们没有发现其他搜索交互(如页面访问和查询数量)的显著差异。
{"title":"Measuring Learning During Search: Differences in Interactions, Eye-Gaze, and Semantic Similarity to Expert Knowledge","authors":"Nilavra Bhattacharya, J. Gwizdka","doi":"10.1145/3295750.3298926","DOIUrl":"https://doi.org/10.1145/3295750.3298926","url":null,"abstract":"We investigate the relationship between search behavior, eye -tracking measures, and learning. We conducted a user study where 30 participants performed searches on the web. We measured their verbal knowledge before and after each task in a content-independent manner, by assessing the semantic similarity of their entries to expert vocabulary. We hypothesize that differences in verbal knowledge-change of participants are reflected in their search behaviors and eye-gaze measures related to acquiring information and reading. Our results show that participants with higher change in verbal knowledge differ by reading significantly less, and entering more sophisticated queries, compared to those with lower change in knowledge. However, we do not find significant differences in other search interactions like page visits, and number of queries.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"108 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128608437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 38
Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019) 互动红外资源再利用障碍研讨会(BIIRRR 2019)
Toine Bogers, Samuel Dodson, Luanne Freund, Maria Gäde, M. Hall, M. Koolen, Vivien Petras, N. Pharo, M. Skov
ACM Reference Format: Toine Bogers, Samuel Dodson, Luanne Freund, Maria Gäde, Mark Hall, Marijn Koolen, Vivien Petras, Nils Pharo, and Mette Skov. 2019. Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019). In 2019 Conference on Human Information Interaction and Retrieval (CHIIR ’19), March 10–14, 2019, Glasgow, United Kingdom. ACM, New York, NY, USA, 4 pages. https://doi.org/10.1145/3295750.3298965
ACM参考格式:Toine Bogers, Samuel Dodson, Luanne Freund, Maria Gäde, Mark Hall, Marijn Koolen, Vivien Petras, Nils Pharo和Mette Skov。2019。互动红外资源再利用障碍研讨会(BIIRRR 2019)。2019人类信息交互与检索会议(CHIIR ' 19), 2019年3月10-14日,英国格拉斯哥。ACM,纽约,美国,4页。https://doi.org/10.1145/3295750.3298965
{"title":"Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019)","authors":"Toine Bogers, Samuel Dodson, Luanne Freund, Maria Gäde, M. Hall, M. Koolen, Vivien Petras, N. Pharo, M. Skov","doi":"10.1145/3295750.3298965","DOIUrl":"https://doi.org/10.1145/3295750.3298965","url":null,"abstract":"ACM Reference Format: Toine Bogers, Samuel Dodson, Luanne Freund, Maria Gäde, Mark Hall, Marijn Koolen, Vivien Petras, Nils Pharo, and Mette Skov. 2019. Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019). In 2019 Conference on Human Information Interaction and Retrieval (CHIIR ’19), March 10–14, 2019, Glasgow, United Kingdom. ACM, New York, NY, USA, 4 pages. https://doi.org/10.1145/3295750.3298965","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125421889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Proceedings of the 2019 Conference on Human Information Interaction and Retrieval
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1