首页 > 最新文献

Proceedings of the 2018 Conference on Human Information Interaction & Retrieval最新文献

英文 中文
How to Evaluate Humorous Response Generation, Seriously? 如何认真评估幽默回应生成?
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176879
Pavel Braslavski, Vladislav Blinov, Valeriia Bolotova-Baranova, Katya Pertsova
Nowadays natural language user interfaces, such as chatbots and conversational agents, are very common. A desirable trait of such applications is a sense of humor. It is, therefore, important to be able to measure quality of humorous responses. However, humor evaluation is hard since humor is highly subjective. To address this problem, we conducted an online evaluation of 30 dialog jokes from different sources by almost 300 participants -- volunteers and Mechanical Turk workers. We collected joke ratings along with participants» age, gender, and language proficiency. Results show that demographics and joke topics can partly explain variation in humor judgments. We expect that these insights will aid humor evaluation and interpretation. The findings can also be of interest for humor generation methods in conversational systems.
如今,自然语言用户界面,如聊天机器人和会话代理,非常常见。这类应聘者的一个可取的特点是幽默感。因此,能够衡量幽默回应的质量是很重要的。然而,幽默的评价是困难的,因为幽默是高度主观的。为了解决这个问题,我们对来自不同来源的30个对话笑话进行了在线评估,参与者有近300人——志愿者和土耳其机器人的工作人员。我们收集了笑话评分以及参与者的年龄、性别和语言水平。结果表明,人口统计学和笑话话题可以部分解释幽默判断的差异。我们期望这些见解将有助于幽默的评价和解释。这一发现也可能对会话系统中的幽默生成方法产生兴趣。
{"title":"How to Evaluate Humorous Response Generation, Seriously?","authors":"Pavel Braslavski, Vladislav Blinov, Valeriia Bolotova-Baranova, Katya Pertsova","doi":"10.1145/3176349.3176879","DOIUrl":"https://doi.org/10.1145/3176349.3176879","url":null,"abstract":"Nowadays natural language user interfaces, such as chatbots and conversational agents, are very common. A desirable trait of such applications is a sense of humor. It is, therefore, important to be able to measure quality of humorous responses. However, humor evaluation is hard since humor is highly subjective. To address this problem, we conducted an online evaluation of 30 dialog jokes from different sources by almost 300 participants -- volunteers and Mechanical Turk workers. We collected joke ratings along with participants» age, gender, and language proficiency. Results show that demographics and joke topics can partly explain variation in humor judgments. We expect that these insights will aid humor evaluation and interpretation. The findings can also be of interest for humor generation methods in conversational systems.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124786600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
QWERTY: The Effects of Typing on Web Search Behavior QWERTY:打字对网络搜索行为的影响
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176872
Kevin Ong, K. Järvelin, M. Sanderson, Falk Scholer
Typing is a common form of query input for search engines and other information retrieval systems; we therefore investigate the relationship between typing behavior and search interactions. The search process is interactive and typically requires entering one or more queries, and assessing both summaries from Search Engine Result Pages and the underlying documents, to ultimately satisfy some information need. Under the Search Economic Theory model of interactive information retrieval, differences in query costs will result in search behavior changes. We investigate how differences in query inputs themselves may relate to Search Economic Theory by conducting a lab-based experiment to observe how text entries influence subsequent search interactions. Our results indicate that for faster typing speeds, more queries are entered in a session, while both query lengths and assessment times are lower.
输入是搜索引擎和其他信息检索系统查询输入的常见形式;因此,我们研究键入行为和搜索交互之间的关系。搜索过程是交互式的,通常需要输入一个或多个查询,并评估来自search Engine Result Pages和底层文档的摘要,以最终满足某些信息需求。在交互式信息检索的搜索经济理论模型下,查询成本的差异会导致搜索行为的变化。我们通过进行基于实验室的实验来观察文本条目如何影响随后的搜索交互,研究查询输入本身的差异如何与搜索经济理论相关。我们的结果表明,对于更快的输入速度,在会话中输入的查询更多,而查询长度和评估时间都更短。
{"title":"QWERTY: The Effects of Typing on Web Search Behavior","authors":"Kevin Ong, K. Järvelin, M. Sanderson, Falk Scholer","doi":"10.1145/3176349.3176872","DOIUrl":"https://doi.org/10.1145/3176349.3176872","url":null,"abstract":"Typing is a common form of query input for search engines and other information retrieval systems; we therefore investigate the relationship between typing behavior and search interactions. The search process is interactive and typically requires entering one or more queries, and assessing both summaries from Search Engine Result Pages and the underlying documents, to ultimately satisfy some information need. Under the Search Economic Theory model of interactive information retrieval, differences in query costs will result in search behavior changes. We investigate how differences in query inputs themselves may relate to Search Economic Theory by conducting a lab-based experiment to observe how text entries influence subsequent search interactions. Our results indicate that for faster typing speeds, more queries are entered in a session, while both query lengths and assessment times are lower.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126272068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
SearchBots: User Engagement with ChatBots during Collaborative Search 搜索机器人:用户在协作搜索过程中与聊天机器人的互动
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176380
Sandeep Avula, Gordon Chadwick, Jaime Arguello, Robert G. Capra
Popular messaging platforms such as Slack have given rise to hundreds of chatbots that users can engage with individually or as a group. We present a Wizard of Oz study on the use of searchbots (i.e., chatbots that perform specific types of searches) during collaborative information-seeking tasks. Specifically, we study searchbots that intervene dynamically and compare between two intervention types: (1) the searchbot presents questions to users to gather the information it needs to produce results, and (2) the searchbot monitors the conversation among the collaborators, infers the necessary information, and then displays search results with no additional input from the users. We investigate three research questions: (RQ1) What is the effect of a searchbot (and its intervention type) on participants» collaborative experience' (RQ2) What is the effect of a searchbot»s intervention type on participants» perceptions about the searchbot and level of engagement with the searchbot' and (RQ3) What are participants» impressions of a dynamic searchbot? Our results suggest that dynamic searchbots can enhance users» collaborative experience and that the intervention type does not greatly affect users» perceptions and level of engagement. Participants» impressions of the searchbot suggest unique opportunities and challenges for future work.
Slack等流行的通讯平台已经产生了数百个聊天机器人,用户可以单独或作为一个群体与之互动。我们展示了一项关于搜索机器人(即执行特定类型搜索的聊天机器人)在协作信息搜索任务中的使用的绿野仙踪研究。具体来说,我们研究了动态干预的搜索机器人,并比较了两种干预类型:(1)搜索机器人向用户提出问题以收集产生结果所需的信息;(2)搜索机器人监控协作者之间的对话,推断必要的信息,然后在没有用户额外输入的情况下显示搜索结果。我们调查了三个研究问题:(RQ1)搜索机器人(及其干预类型)对参与者“协作体验”的影响(RQ2)搜索机器人的干预类型对参与者“对搜索机器人的感知和与搜索机器人的参与程度”的影响(RQ3)参与者对动态搜索机器人的印象是什么?我们的研究结果表明,动态搜索机器人可以增强用户的协作体验,并且干预类型不会对用户的感知和参与水平产生很大影响。参与者对搜索机器人的印象暗示了未来工作的独特机遇和挑战。
{"title":"SearchBots: User Engagement with ChatBots during Collaborative Search","authors":"Sandeep Avula, Gordon Chadwick, Jaime Arguello, Robert G. Capra","doi":"10.1145/3176349.3176380","DOIUrl":"https://doi.org/10.1145/3176349.3176380","url":null,"abstract":"Popular messaging platforms such as Slack have given rise to hundreds of chatbots that users can engage with individually or as a group. We present a Wizard of Oz study on the use of searchbots (i.e., chatbots that perform specific types of searches) during collaborative information-seeking tasks. Specifically, we study searchbots that intervene dynamically and compare between two intervention types: (1) the searchbot presents questions to users to gather the information it needs to produce results, and (2) the searchbot monitors the conversation among the collaborators, infers the necessary information, and then displays search results with no additional input from the users. We investigate three research questions: (RQ1) What is the effect of a searchbot (and its intervention type) on participants» collaborative experience' (RQ2) What is the effect of a searchbot»s intervention type on participants» perceptions about the searchbot and level of engagement with the searchbot' and (RQ3) What are participants» impressions of a dynamic searchbot? Our results suggest that dynamic searchbots can enhance users» collaborative experience and that the intervention type does not greatly affect users» perceptions and level of engagement. Participants» impressions of the searchbot suggest unique opportunities and challenges for future work.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"216 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131589930","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 58
Better Together: An Interdisciplinary Perspective on Information Retrieval 更好地在一起:信息检索的跨学科视角
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176571
S. Dumais
The success of information retrieval systems depends critically on both the ability of systems to efficiently and effectively retrieve information, and to support people in articulating their information needs and making sense of the results. This interdisciplinary, user-centered perspective on information systems motivated my early work on Latent Semantic Indexing (LSI), which sought to mitigate the disagreement between the vocabulary that authors use in writing and searchers use to express their information needs, and continues to shape my research today. Over the last two decades, search has become a core fabric of people's everyday lives, driven by advances in understanding context, natural language, and speech. I will illustrate how new capabilities in email and virtual assistants are driven by advances in both algorithms and user modeling. As we look forward to new types of information systems that anticipate information needs, interact via richer dialogs, and integrate physical and digital information, it is more important than ever to understand and support information seekers using interdisciplinary methods and perspectives.
信息检索系统的成功关键取决于系统高效和有效检索信息的能力,以及支持人们阐明其信息需求和理解结果的能力。这种跨学科的、以用户为中心的信息系统视角激发了我早期对潜在语义索引(LSI)的研究,它试图减轻作者在写作中使用的词汇和搜索者用来表达他们的信息需求之间的分歧,并继续塑造我今天的研究。在过去的二十年里,搜索已经成为人们日常生活的核心组成部分,这是在理解上下文、自然语言和语音的进步的推动下实现的。我将说明电子邮件和虚拟助手的新功能是如何由算法和用户建模的进步驱动的。当我们期待新型信息系统能够预测信息需求,通过更丰富的对话进行交互,并整合物理和数字信息时,使用跨学科的方法和观点来理解和支持信息寻求者比以往任何时候都更加重要。
{"title":"Better Together: An Interdisciplinary Perspective on Information Retrieval","authors":"S. Dumais","doi":"10.1145/3176349.3176571","DOIUrl":"https://doi.org/10.1145/3176349.3176571","url":null,"abstract":"The success of information retrieval systems depends critically on both the ability of systems to efficiently and effectively retrieve information, and to support people in articulating their information needs and making sense of the results. This interdisciplinary, user-centered perspective on information systems motivated my early work on Latent Semantic Indexing (LSI), which sought to mitigate the disagreement between the vocabulary that authors use in writing and searchers use to express their information needs, and continues to shape my research today. Over the last two decades, search has become a core fabric of people's everyday lives, driven by advances in understanding context, natural language, and speech. I will illustrate how new capabilities in email and virtual assistants are driven by advances in both algorithms and user modeling. As we look forward to new types of information systems that anticipate information needs, interact via richer dialogs, and integrate physical and digital information, it is more important than ever to understand and support information seekers using interdisciplinary methods and perspectives.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115731798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Improving Exploration of Topic Hierarchies: Comparative Testing of Simplified Library of Congress Subject Heading Structures 改进主题层次结构的探索:美国国会图书馆简化主题标题结构的比较测试
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176385
J. Dinneen, Banafsheh Asadi, I. Frissen, Fei Shu, C. Julien
Many large digital collections are organized by sorting their items into topics and arranging these topics hierarchically, such as those displayed in a tree view. The resulting information organization structures mitigate some of the challenges of searching digital information realms; however, the topic hierarchies are often large and complex, and thus difficult to navigate. Automated techniques have been shown to produce significantly smaller, simplified versions of existing topic hierarchies while preserving access to the majority of the collection, but these simplified topic hierarchies have never been tested with human participants, and so it is not clear what effect simplification would have on the exploration and use of such structures for browsing and retrieval. This study partly addresses this gap by performing a comparative test with three groups of university students (N=62) performing ten topic hierarchy exploration tasks using one of three versions of the Library of Congress Subject Headings (LCSH) hierarchy: 1) the original LCSH hierarchy, acting as a baseline, 2) a shallower version of 1), and 3) a narrower version of 2). A quantitative analysis of measures of accuracy, time, and browsing shows that participants using the simplified trees were significantly more accurate and faster than those using the unmodified tree, and the narrower, balanced tree was also faster than the shallower tree. These results show that automated topic hierarchy simplification can facilitate the use of such hierarchies, which has implications for the development of information organization theory and human-information interaction techniques for similar information structures.
许多大型数字集合的组织方式是将它们的项目分类为主题,并按层次结构排列这些主题,例如在树视图中显示的那些主题。由此产生的信息组织结构减轻了搜索数字信息领域的一些挑战;然而,主题层次结构通常又大又复杂,因此难以导航。自动化技术已经被证明可以产生更小、更简化的现有主题层次结构版本,同时保留对大部分集合的访问,但是这些简化的主题层次结构从未在人类参与者中进行过测试,因此尚不清楚简化会对浏览和检索这些结构的探索和使用产生什么影响。本研究通过对三组大学生(N=62)进行比较测试,使用国会图书馆主题标题(LCSH)层次结构的三种版本之一执行十个主题层次探索任务,部分解决了这一差距:1)原始的LCSH层次结构,作为基线;2)1)的较浅版本;3)2)的较窄版本。对准确性,时间和浏览量的定量分析表明,使用简化树的参与者比使用未修改树的参与者更准确和更快,并且较窄的平衡树也比较浅的树更快。这些结果表明,自动化主题层次简化可以促进这些层次的使用,这对信息组织理论和类似信息结构的人-信息交互技术的发展具有重要意义。
{"title":"Improving Exploration of Topic Hierarchies: Comparative Testing of Simplified Library of Congress Subject Heading Structures","authors":"J. Dinneen, Banafsheh Asadi, I. Frissen, Fei Shu, C. Julien","doi":"10.1145/3176349.3176385","DOIUrl":"https://doi.org/10.1145/3176349.3176385","url":null,"abstract":"Many large digital collections are organized by sorting their items into topics and arranging these topics hierarchically, such as those displayed in a tree view. The resulting information organization structures mitigate some of the challenges of searching digital information realms; however, the topic hierarchies are often large and complex, and thus difficult to navigate. Automated techniques have been shown to produce significantly smaller, simplified versions of existing topic hierarchies while preserving access to the majority of the collection, but these simplified topic hierarchies have never been tested with human participants, and so it is not clear what effect simplification would have on the exploration and use of such structures for browsing and retrieval. This study partly addresses this gap by performing a comparative test with three groups of university students (N=62) performing ten topic hierarchy exploration tasks using one of three versions of the Library of Congress Subject Headings (LCSH) hierarchy: 1) the original LCSH hierarchy, acting as a baseline, 2) a shallower version of 1), and 3) a narrower version of 2). A quantitative analysis of measures of accuracy, time, and browsing shows that participants using the simplified trees were significantly more accurate and faster than those using the unmodified tree, and the narrower, balanced tree was also faster than the shallower tree. These results show that automated topic hierarchy simplification can facilitate the use of such hierarchies, which has implications for the development of information organization theory and human-information interaction techniques for similar information structures.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"342 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115843685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Task-based Information Seeking in Different Study Settings 不同学习环境下基于任务的信息搜索
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176351
Yiwei Wang
Existing studies have presented the relationships between task characteristics and individuals» information seeking and searching behaviors. Some task characteristics are found to have predictable influences on information seeking behaviors. However, most studies took place in lab settings and focused on individuals» interactions with information systems. How a laboratory environment affects individuals» natural information seeking behaviors is open to question. This paper proposes a study investigating the differences between information seeking behaviors in a lab setting where individuals» activities and resources are controlled and in naturalistic settings where individuals have access to all types of sources.
已有研究提出了任务特征与个体信息寻找和搜索行为之间的关系。某些任务特征对信息寻找行为具有可预测的影响。然而,大多数研究都是在实验室环境下进行的,并且主要关注个人与信息系统的互动。实验室环境如何影响个人的自然信息寻求行为是一个值得商榷的问题。本文提出了一项研究,调查在实验室环境中,个人的活动和资源受到控制,而在自然环境中,个人可以获得所有类型的资源,信息寻求行为之间的差异。
{"title":"Task-based Information Seeking in Different Study Settings","authors":"Yiwei Wang","doi":"10.1145/3176349.3176351","DOIUrl":"https://doi.org/10.1145/3176349.3176351","url":null,"abstract":"Existing studies have presented the relationships between task characteristics and individuals» information seeking and searching behaviors. Some task characteristics are found to have predictable influences on information seeking behaviors. However, most studies took place in lab settings and focused on individuals» interactions with information systems. How a laboratory environment affects individuals» natural information seeking behaviors is open to question. This paper proposes a study investigating the differences between information seeking behaviors in a lab setting where individuals» activities and resources are controlled and in naturalistic settings where individuals have access to all types of sources.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125271138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of Open Answers to Survey Questions through Interactive Clustering and Theme Extraction 基于交互式聚类和主题抽取的调查问题开放性答案分析
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176892
Fredrik Espinoza, Ola Hamfors, Jussi Karlgren, Fredrik Olsson, Per Persson, L. Hamberg, Magnus Sahlgren
This paper describes design principles for and the implementation of Gavagai Explorer---a new application which builds on interactive text clustering to extract themes from topically coherent text sets such as open text answers to surveys or questionnaires. An automated system is quick, consistent, and has full coverage over the study material. A system allows an analyst to analyze more answers in a given time period; provides the same initial results regardless of who does the analysis, reducing the risks of inter-rater discrepancy; and does not risk miss responses due to fatige or boredom. These factors reduce the cost and increase the reliability of the service. The most important feature, however, is relieving the human analyst from the frustrating aspects of the coding task, freeing the effort to the central challenge of understanding themes. Gavagai Explorer is available on-line.
本文描述了Gavagai Explorer的设计原则和实现,这是一个新的应用程序,它建立在交互式文本聚类的基础上,从主题一致的文本集中提取主题,比如调查或问卷的开放文本答案。一个自动化的系统是快速的,一致的,并且对学习材料有全面的覆盖。系统允许分析人员在给定的时间段内分析更多的答案;无论谁进行分析,都能提供相同的初始结果,降低了评估者之间差异的风险;也不会因为疲劳或无聊而错过回应。这些因素降低了成本,提高了服务的可靠性。然而,最重要的特性是将人类分析师从编码任务中令人沮丧的方面解脱出来,将精力释放到理解主题的核心挑战上。Gavagai Explorer可以在线使用。
{"title":"Analysis of Open Answers to Survey Questions through Interactive Clustering and Theme Extraction","authors":"Fredrik Espinoza, Ola Hamfors, Jussi Karlgren, Fredrik Olsson, Per Persson, L. Hamberg, Magnus Sahlgren","doi":"10.1145/3176349.3176892","DOIUrl":"https://doi.org/10.1145/3176349.3176892","url":null,"abstract":"This paper describes design principles for and the implementation of Gavagai Explorer---a new application which builds on interactive text clustering to extract themes from topically coherent text sets such as open text answers to surveys or questionnaires. An automated system is quick, consistent, and has full coverage over the study material. A system allows an analyst to analyze more answers in a given time period; provides the same initial results regardless of who does the analysis, reducing the risks of inter-rater discrepancy; and does not risk miss responses due to fatige or boredom. These factors reduce the cost and increase the reliability of the service. The most important feature, however, is relieving the human analyst from the frustrating aspects of the coding task, freeing the effort to the central challenge of understanding themes. Gavagai Explorer is available on-line.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116845799","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
How do Information Source Selection Strategies Influence Users' Learning Outcomes' 信息源选择策略对用户学习效果的影响
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176876
Chang Liu, Xiaoxuan Song
Learning-related type of tasks has attracted much research attention recently but it is still not clear what factors would influence users learning outcomes and how. In this study, we conducted a user experiment to assess searchers learning outcomes and examine how information source selection strategies would influence their learning outcomes. In this experiment, thirty-two college students conducted search for two types of learning tasks: receptive tasks and critical tasks. Participants were asked to write down what they knew about the task before and after the search. For data analysis, we proposed a comprehensive assessment method, which used both quantitative measures (i.e. knowledge points, knowledge facets, knowledge scope, etc.) and qualitative measures to assess users' learning outcomes. Our results demonstrated that searchers' information source preferences influence their learning outcomes; i.e., encyclopedia-preferred sessions had better relevance of written summaries in receptive tasks and Q&A preferred sessions led to better relevance in critical tasks. Furthermore, searchers had two types of information source selection strategies: task-adaptive strategy and non-task-adaptive strategy. The results showed that searchers with task-adaptive strategy could gain better learning outcomes, e.g. knowledge points, facets, scope, depth, relevance and analyticity. This study highlighted the importance of information source selection strategies in learning-related type of tasks, and knowing how to select suitable information sources for different types of tasks may benefit the learning outcome for searchers.
学习相关类型的任务近年来引起了很多研究的关注,但目前还不清楚哪些因素会影响用户的学习结果,以及如何影响。在本研究中,我们通过用户实验来评估搜索者的学习效果,并考察信息源选择策略如何影响搜索者的学习效果。在本实验中,32名大学生对两种类型的学习任务进行了搜索:接受性任务和批判性任务。参与者被要求在搜索之前和之后写下他们对任务的了解。在数据分析方面,我们提出了一种综合评估方法,采用定量指标(即知识点、知识层面、知识范围等)和定性指标对用户的学习成果进行评估。研究结果表明,搜索者的信息源偏好影响其学习效果;也就是说,在接受性任务中,喜欢百科全书的会话与书面摘要有更好的相关性,而喜欢问答的会话与批判性任务有更好的相关性。此外,搜索者有两种信息源选择策略:任务自适应策略和非任务自适应策略。结果表明,采用任务适应策略的学习者在知识点、知识点、广度、深度、相关性和分析性等方面的学习效果更好。本研究强调了信息源选择策略在学习相关类型任务中的重要性,了解如何为不同类型的任务选择合适的信息源可能有利于搜索者的学习效果。
{"title":"How do Information Source Selection Strategies Influence Users' Learning Outcomes'","authors":"Chang Liu, Xiaoxuan Song","doi":"10.1145/3176349.3176876","DOIUrl":"https://doi.org/10.1145/3176349.3176876","url":null,"abstract":"Learning-related type of tasks has attracted much research attention recently but it is still not clear what factors would influence users learning outcomes and how. In this study, we conducted a user experiment to assess searchers learning outcomes and examine how information source selection strategies would influence their learning outcomes. In this experiment, thirty-two college students conducted search for two types of learning tasks: receptive tasks and critical tasks. Participants were asked to write down what they knew about the task before and after the search. For data analysis, we proposed a comprehensive assessment method, which used both quantitative measures (i.e. knowledge points, knowledge facets, knowledge scope, etc.) and qualitative measures to assess users' learning outcomes. Our results demonstrated that searchers' information source preferences influence their learning outcomes; i.e., encyclopedia-preferred sessions had better relevance of written summaries in receptive tasks and Q&A preferred sessions led to better relevance in critical tasks. Furthermore, searchers had two types of information source selection strategies: task-adaptive strategy and non-task-adaptive strategy. The results showed that searchers with task-adaptive strategy could gain better learning outcomes, e.g. knowledge points, facets, scope, depth, relevance and analyticity. This study highlighted the importance of information source selection strategies in learning-related type of tasks, and knowing how to select suitable information sources for different types of tasks may benefit the learning outcome for searchers.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129601855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Collaborative Information Seeking through Social Media Updates in Real-Time 通过社交媒体实时更新的协同信息搜索
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176869
K. Bhat, Andrés Moreno, M. Best
This paper describes co-located collaborative information seeking in the context of the Social Media Tracking Centre (SMTC) in Ghana. The SMTC was operational for three days during the Presidential elections in Dec 2016. The SMTC»s role was to collaboratively find and verify novel, actionable, and relevant information on social media and escalate it to the authorities to use that information to ensure a transparent and peaceful election process. We performed a qualitative analysis of semi-structured interviews with the volunteers at the SMTC as well as its managing team. We present, in this paper, the importance of volunteer motivation and co-location in the success of the SMTC, as well as the users» feedback on the collaborative tool, informing future design, derived from our analysis.
本文描述了在加纳的社交媒体跟踪中心(SMTC)的背景下的协同信息搜索。2016年12月总统选举期间,SMTC仅运行了三天。SMTC的职责是在社交媒体上共同发现和核实新颖、可操作和相关的信息,并将其上报给当局,以确保透明和平的选举过程。我们对SMTC志愿者及其管理团队的半结构化访谈进行了定性分析。在本文中,我们提出了志愿者激励和协同定位在SMTC成功中的重要性,以及来自我们分析的用户对协作工具的反馈,为未来的设计提供了信息。
{"title":"Collaborative Information Seeking through Social Media Updates in Real-Time","authors":"K. Bhat, Andrés Moreno, M. Best","doi":"10.1145/3176349.3176869","DOIUrl":"https://doi.org/10.1145/3176349.3176869","url":null,"abstract":"This paper describes co-located collaborative information seeking in the context of the Social Media Tracking Centre (SMTC) in Ghana. The SMTC was operational for three days during the Presidential elections in Dec 2016. The SMTC»s role was to collaboratively find and verify novel, actionable, and relevant information on social media and escalate it to the authorities to use that information to ensure a transparent and peaceful election process. We performed a qualitative analysis of semi-structured interviews with the volunteers at the SMTC as well as its managing team. We present, in this paper, the importance of volunteer motivation and co-location in the success of the SMTC, as well as the users» feedback on the collaborative tool, informing future design, derived from our analysis.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115048553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards Human-Like Conversational Search Systems 走向类人对话式搜索系统
Pub Date : 2018-03-01 DOI: 10.1145/3176349.3176360
Mateusz Dubiel
Voice search is currently widely available on the majority of mobile devices via use of Virtual Personal Assistants. However, despite its general availability, the use of voice interaction remains sporadic and is limited to basic search tasks such as checking weather updates and looking up answers to factual queries. Present-day voice search systems struggle to use relevant contextual information to maintain conversational state, and lack conversational initiative needed to clarify user's intent, which hampers their usability and prevents users from engaging in more complex interaction activities. This research investigates the potential of a hypothesised interactive information retrieval system with human-like conversational abilities. To this end, we propose a series of usability studies that involve a working prototype of a conversational system that uses real time speech synthesis. The proposed experiments seek to provide empirical evidence that enabling a voice search system with human-like conversational abilities can lead to increased likelihood of its adoption.
语音搜索目前通过虚拟个人助理在大多数移动设备上广泛使用。然而,尽管它的普遍可用性,语音交互的使用仍然是零星的,并且仅限于基本的搜索任务,如查看天气更新和查找事实问题的答案。当前的语音搜索系统很难使用相关的上下文信息来维持会话状态,并且缺乏澄清用户意图所需的会话主动性,这阻碍了它们的可用性,并阻止用户参与更复杂的交互活动。本研究探讨了具有类似人类对话能力的交互式信息检索系统的潜力。为此,我们提出了一系列可用性研究,其中包括使用实时语音合成的会话系统的工作原型。拟议的实验旨在提供经验证据,证明启用具有类似人类对话能力的语音搜索系统可以提高其采用的可能性。
{"title":"Towards Human-Like Conversational Search Systems","authors":"Mateusz Dubiel","doi":"10.1145/3176349.3176360","DOIUrl":"https://doi.org/10.1145/3176349.3176360","url":null,"abstract":"Voice search is currently widely available on the majority of mobile devices via use of Virtual Personal Assistants. However, despite its general availability, the use of voice interaction remains sporadic and is limited to basic search tasks such as checking weather updates and looking up answers to factual queries. Present-day voice search systems struggle to use relevant contextual information to maintain conversational state, and lack conversational initiative needed to clarify user's intent, which hampers their usability and prevents users from engaging in more complex interaction activities. This research investigates the potential of a hypothesised interactive information retrieval system with human-like conversational abilities. To this end, we propose a series of usability studies that involve a working prototype of a conversational system that uses real time speech synthesis. The proposed experiments seek to provide empirical evidence that enabling a voice search system with human-like conversational abilities can lead to increased likelihood of its adoption.","PeriodicalId":198379,"journal":{"name":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126543878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
期刊
Proceedings of the 2018 Conference on Human Information Interaction & Retrieval
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1