首页 > 最新文献

Proceedings of the 2019 Conference on Human Information Interaction and Retrieval最新文献

英文 中文
Understanding Context for Tasks and Activities 理解任务和活动的背景
Jan R. Benetka, John Krumm, Paul N. Bennett
Human activity is one of the most important pieces of context affecting an individual's information needs. Understanding the relationship between activities, time, location, and other contextual features can improve the quality of various intelligent systems, including contextual search engines, task managers, digital personal assistants, chat bots, and recommender systems. In this work, we propose a method for extraction of an extensive set of open-vocabulary activities from social media. In particular, we derive tens of thousands of ongoing activities from Twitter, where people share information about their past, present, and future events and, using attached metadata, we establish spatiotemporal models of these activities at the time of posting. While public Twitter content is subject to self-censorship (not all activities are tweeted about), we compare extracted data with unbiased survey data (ATUS) and show evidence that for activities which are tweeted about, the underlying spatiotemporal profiles correctly capture their real distributions of activity conditioned on time and location. Next, to better understand the set of activities present in this dataset (and what role self-censorship may play), we perform a qualitative analysis to understand the activities, locations, and their temporal properties. Finally, we go on to solve predictive tasks centered on the relationship between activity and spatiotemporal context that are aimed at supporting an individual's information needs. Our predictive models, which incorporate text, personal history and temporal features, show a significant performance gain over a strong frequency-based baseline.
人类活动是影响个人信息需求的最重要的环境之一。了解活动、时间、地点和其他上下文特征之间的关系可以提高各种智能系统的质量,包括上下文搜索引擎、任务管理器、数字个人助理、聊天机器人和推荐系统。在这项工作中,我们提出了一种从社交媒体中提取大量开放词汇活动的方法。特别是,我们从Twitter上获得了成千上万的正在进行的活动,人们在Twitter上分享他们过去、现在和未来事件的信息,并使用附加的元数据,我们在发布时建立了这些活动的时空模型。虽然公共Twitter内容受到自我审查(并非所有活动都被推特),但我们将提取的数据与无偏调查数据(ATUS)进行比较,并显示证据表明,对于被推特的活动,潜在的时空概况正确地捕捉了它们在时间和地点条件下的真实活动分布。接下来,为了更好地理解该数据集中存在的活动集(以及自我审查可能发挥的作用),我们执行定性分析以了解活动,位置及其时间属性。最后,我们继续解决以活动和时空背景之间的关系为中心的预测任务,旨在支持个人的信息需求。我们的预测模型结合了文本、个人历史和时间特征,在基于频率的基线上显示出显著的性能提升。
{"title":"Understanding Context for Tasks and Activities","authors":"Jan R. Benetka, John Krumm, Paul N. Bennett","doi":"10.1145/3295750.3298929","DOIUrl":"https://doi.org/10.1145/3295750.3298929","url":null,"abstract":"Human activity is one of the most important pieces of context affecting an individual's information needs. Understanding the relationship between activities, time, location, and other contextual features can improve the quality of various intelligent systems, including contextual search engines, task managers, digital personal assistants, chat bots, and recommender systems. In this work, we propose a method for extraction of an extensive set of open-vocabulary activities from social media. In particular, we derive tens of thousands of ongoing activities from Twitter, where people share information about their past, present, and future events and, using attached metadata, we establish spatiotemporal models of these activities at the time of posting. While public Twitter content is subject to self-censorship (not all activities are tweeted about), we compare extracted data with unbiased survey data (ATUS) and show evidence that for activities which are tweeted about, the underlying spatiotemporal profiles correctly capture their real distributions of activity conditioned on time and location. Next, to better understand the set of activities present in this dataset (and what role self-censorship may play), we perform a qualitative analysis to understand the activities, locations, and their temporal properties. Finally, we go on to solve predictive tasks centered on the relationship between activity and spatiotemporal context that are aimed at supporting an individual's information needs. Our predictive models, which incorporate text, personal history and temporal features, show a significant performance gain over a strong frequency-based baseline.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114291920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Holes in the Outline: Subject-dependent Abstract Quality and its Implications for Scientific Literature Search 大纲中的漏洞:与主题相关的摘要质量及其对科学文献检索的影响
Chien-yu Huang, Arlene Casey, D. Glowacka, A. Medlar
Scientific literature search engines typically index abstracts instead of the full-text of publications. The expectation is that the abstract provides a comprehensive summary of the article, enumerating key points for the reader to assess whether their information needs could be satisfied by reading the full-text. Furthermore, from a practical standpoint, obtaining the full-text is more complicated due to licensing issues, in the case of commercial publishers, and resource limitations of public repositories and pre-print servers. In this article, we use topic modelling to represent content in abstracts and full-text articles. Using Computer Science as a case study, we demonstrate that how well the abstract summarises the full-text is subfield-dependent. Indeed, we show that abstract representativeness has a direct impact on retrieval performance, with poorer abstracts leading to degraded performance. Finally, we present evidence that how well an abstract represents the full-text of an article is not random, but is a consequence of style and writing conventions in different subdisciplines and can be used to infer an "evolutionary" tree of subfields within Computer Science.
科学文献搜索引擎通常索引摘要,而不是出版物的全文。期望摘要提供对文章的全面总结,列举要点,供读者评估是否可以通过阅读全文来满足他们的信息需求。此外,从实际的角度来看,由于商业出版商的许可问题以及公共存储库和预印本服务器的资源限制,获得全文更加复杂。在本文中,我们使用主题建模来表示摘要和全文文章中的内容。以计算机科学为例,我们证明了摘要对全文的总结程度与子字段有关。事实上,我们表明抽象代表性对检索性能有直接影响,较差的抽象会导致性能下降。最后,我们提供的证据表明,摘要如何很好地代表一篇文章的全文不是随机的,而是不同子学科的风格和写作惯例的结果,可以用来推断计算机科学中子领域的“进化”树。
{"title":"Holes in the Outline: Subject-dependent Abstract Quality and its Implications for Scientific Literature Search","authors":"Chien-yu Huang, Arlene Casey, D. Glowacka, A. Medlar","doi":"10.1145/3295750.3298953","DOIUrl":"https://doi.org/10.1145/3295750.3298953","url":null,"abstract":"Scientific literature search engines typically index abstracts instead of the full-text of publications. The expectation is that the abstract provides a comprehensive summary of the article, enumerating key points for the reader to assess whether their information needs could be satisfied by reading the full-text. Furthermore, from a practical standpoint, obtaining the full-text is more complicated due to licensing issues, in the case of commercial publishers, and resource limitations of public repositories and pre-print servers. In this article, we use topic modelling to represent content in abstracts and full-text articles. Using Computer Science as a case study, we demonstrate that how well the abstract summarises the full-text is subfield-dependent. Indeed, we show that abstract representativeness has a direct impact on retrieval performance, with poorer abstracts leading to degraded performance. Finally, we present evidence that how well an abstract represents the full-text of an article is not random, but is a consequence of style and writing conventions in different subdisciplines and can be used to infer an \"evolutionary\" tree of subfields within Computer Science.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133353956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Coagmento v3.0: Rapid Prototyping of Web Search Experiments 凝固v3.0: Web搜索实验的快速原型
Diana Soltani, M. Mitsui, C. Shah
As understanding of web search behavior grows, researchers rapidly develop new study designs to capture and understand search behavior. Researchers have restricted time in which to design a study, develop a collection tool, collect data, analyze it, and report new insights. In particular, sufficient time and development skills are often required to create a tool that meets the needs of any particular web search behavior study. Coagmento is a tool that is developed for facilitating many of the needs for designing and running a lab study, from executing a session flow to collecting log data. By streamlining the programming of unique parts for a specific study, Coagmento helps researchers tailor various parts of running a user study, lowering the barrier for designing and conducting lab study experiments. One-click interactions with a graphical user interface permit researchers to operate through a web-based administrative service to generate stages, search tasks, and questionnaires for their interactive information retrieval studies. In this demonstration, Coagmento provides a solution to increase efficiency in the production of laboratory experiments for web search behavior.
随着对网络搜索行为理解的增长,研究人员迅速开发新的研究设计来捕捉和理解搜索行为。研究人员在设计研究、开发收集工具、收集数据、分析数据和报告新见解方面的时间有限。特别是,通常需要足够的时间和开发技能来创建满足任何特定网络搜索行为研究需求的工具。从执行会话流到收集日志数据,为满足设计和运行实验室研究的许多需求而开发的一种工具。通过简化特定研究的独特部分的编程,coagulmento可以帮助研究人员定制运行用户研究的各个部分,降低设计和进行实验室研究实验的障碍。与图形用户界面的一键交互允许研究人员通过基于web的管理服务来操作,为他们的交互式信息检索研究生成阶段、搜索任务和问卷。在这个演示中,coagulmento提供了一个解决方案,以提高网络搜索行为实验室实验的生产效率。
{"title":"Coagmento v3.0: Rapid Prototyping of Web Search Experiments","authors":"Diana Soltani, M. Mitsui, C. Shah","doi":"10.1145/3295750.3298917","DOIUrl":"https://doi.org/10.1145/3295750.3298917","url":null,"abstract":"As understanding of web search behavior grows, researchers rapidly develop new study designs to capture and understand search behavior. Researchers have restricted time in which to design a study, develop a collection tool, collect data, analyze it, and report new insights. In particular, sufficient time and development skills are often required to create a tool that meets the needs of any particular web search behavior study. Coagmento is a tool that is developed for facilitating many of the needs for designing and running a lab study, from executing a session flow to collecting log data. By streamlining the programming of unique parts for a specific study, Coagmento helps researchers tailor various parts of running a user study, lowering the barrier for designing and conducting lab study experiments. One-click interactions with a graphical user interface permit researchers to operate through a web-based administrative service to generate stages, search tasks, and questionnaires for their interactive information retrieval studies. In this demonstration, Coagmento provides a solution to increase efficiency in the production of laboratory experiments for web search behavior.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129256583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Making Meaning: A Focus for Information Interactions Research 意义生成:信息交互研究的一个焦点
I. Ruthven
In this perspectives paper, I discuss meaning-making as an information seeking and interaction enterprise. I present meaning-making as a vital human reaction to significant life changes and present indicative evidence of how people go about gathering information for making meaning within their lives. I discuss some of the various forms of information that can be used for meaning-making, why it is an information seeking task that is different to those we are used to in information seeking research, and motivate meaning-making as a new focus for information seeking and information interactions research.
在这篇展望性的文章中,我讨论了意义制造作为一种信息寻找和互动的过程。我认为意义创造是人类对重大生活变化的重要反应,并提出了人们如何收集信息以在生活中创造意义的指示性证据。本文讨论了可以用于意义构建的各种形式的信息,以及为什么它是一种不同于我们在信息寻求研究中所习惯的信息寻求任务,并激励意义构建成为信息寻求和信息交互研究的新焦点。
{"title":"Making Meaning: A Focus for Information Interactions Research","authors":"I. Ruthven","doi":"10.1145/3295750.3298938","DOIUrl":"https://doi.org/10.1145/3295750.3298938","url":null,"abstract":"In this perspectives paper, I discuss meaning-making as an information seeking and interaction enterprise. I present meaning-making as a vital human reaction to significant life changes and present indicative evidence of how people go about gathering information for making meaning within their lives. I discuss some of the various forms of information that can be used for meaning-making, why it is an information seeking task that is different to those we are used to in information seeking research, and motivate meaning-making as a new focus for information seeking and information interactions research.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131826770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Generating Tasks for Study of Struggling Search 为研究挣扎搜索生成任务
Luyan Xu, Xuan Zhou
Interactive information-seeking systems are designed to help users with their struggling during the searching for complex fact checking tasks, where a searcher may have clear information needs but experience difficulty in collecting required information. However, evaluation and comparison of such systems requires a large number of such tasks, which are difficult to collect or make up. To the best of our knowledge, there has not been a commonly used task set for evaluating struggling search of this kind. This paper proposes a convenient method to generate complex fact checking tasks. Each of the generated task has a clearly defined goal, which however takes an average searcher a significant amount of effort to reach. We conducted lab user studies to verify the feasibility of this method. The results confirmed its feasibility and efficiency.
交互式信息搜索系统旨在帮助用户在搜索复杂的事实核查任务时,在搜索者可能有明确的信息需求,但在收集所需信息时遇到困难。然而,评估和比较这些系统需要大量的此类任务,这些任务很难收集或弥补。据我们所知,目前还没有一个常用的任务集来评估这种挣扎搜索。本文提出了一种生成复杂事实检验任务的简便方法。每个生成的任务都有一个明确定义的目标,但是一般的搜索者需要付出大量的努力才能达到。我们进行了实验室用户研究,以验证该方法的可行性。结果证实了该方法的可行性和有效性。
{"title":"Generating Tasks for Study of Struggling Search","authors":"Luyan Xu, Xuan Zhou","doi":"10.1145/3295750.3298949","DOIUrl":"https://doi.org/10.1145/3295750.3298949","url":null,"abstract":"Interactive information-seeking systems are designed to help users with their struggling during the searching for complex fact checking tasks, where a searcher may have clear information needs but experience difficulty in collecting required information. However, evaluation and comparison of such systems requires a large number of such tasks, which are difficult to collect or make up. To the best of our knowledge, there has not been a commonly used task set for evaluating struggling search of this kind. This paper proposes a convenient method to generate complex fact checking tasks. Each of the generated task has a clearly defined goal, which however takes an average searcher a significant amount of effort to reach. We conducted lab user studies to verify the feasibility of this method. The results confirmed its feasibility and efficiency.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129914105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
NotifyMeHere: Intelligent Notification Delivery in Multi-Device Environments NotifyMeHere:多设备环境下的智能通知传递
Abhinav Mehrotra, R. Hendley, Mirco Musolesi
Personal interactions and information access are happening more and more through the mediation of computing devices of various types all around us. In our daily life we use many computing devices running different versions of the same application such as email clients or social media platforms, which alert users about a new piece of information or event on all devices. In this paper we first present a study investigating the factors influencing users' decisions in handling notifications in a multi-device environment. We collected 57,242 in-the-wild notifications from 24 users over a period of 21 days. We found that users' decisions in handling notifications are impacted by their physical activity, location, network connectivity, application category and the device used for handling the previous notification. Finally, we show that an individualized model can predict the device on which the user will handle a notification in the given context with 82% specificity and 91% sensitivity.
通过我们周围各种各样的计算设备,人与人之间的互动和信息获取正在越来越多地发生。在我们的日常生活中,我们使用许多运行相同应用程序的不同版本的计算设备,例如电子邮件客户端或社交媒体平台,它们会在所有设备上提醒用户一条新的信息或事件。在本文中,我们首先提出了一项研究,调查了在多设备环境中影响用户处理通知决策的因素。在21天的时间里,我们从24个用户那里收集了57,242个临时通知。我们发现用户处理通知的决定受到他们的身体活动、位置、网络连接、应用程序类别和用于处理先前通知的设备的影响。最后,我们表明,个性化模型可以预测用户将在给定上下文中处理通知的设备,其特异性为82%,灵敏度为91%。
{"title":"NotifyMeHere: Intelligent Notification Delivery in Multi-Device Environments","authors":"Abhinav Mehrotra, R. Hendley, Mirco Musolesi","doi":"10.1145/3295750.3298932","DOIUrl":"https://doi.org/10.1145/3295750.3298932","url":null,"abstract":"Personal interactions and information access are happening more and more through the mediation of computing devices of various types all around us. In our daily life we use many computing devices running different versions of the same application such as email clients or social media platforms, which alert users about a new piece of information or event on all devices. In this paper we first present a study investigating the factors influencing users' decisions in handling notifications in a multi-device environment. We collected 57,242 in-the-wild notifications from 24 users over a period of 21 days. We found that users' decisions in handling notifications are impacted by their physical activity, location, network connectivity, application category and the device used for handling the previous notification. Finally, we show that an individualized model can predict the device on which the user will handle a notification in the given context with 82% specificity and 91% sensitivity.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114299642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Do Metrics Matter? 指标重要吗?
Jacqueline Sachse
Scientific search engines enrich result lists with indicators of scientific quality, such as citation counts, in order to enhance user experience and improve performance. This dissertation project aims to study the effect of such integration of impact indicators in search result pages on relevance evaluation, considering both traditional citation-based and altmetric measures. The user behavior is analyzed with a combination of eye-tracking and think-aloud as well as a questionnaire. This paper describes the methodology of an experimental study designed to answer the question if the visibility of metrics alters the behavior during scientific literature search and if behavior varies depending on the kind of metric, specifically citation rate and altmetric score.
科学搜索引擎通过引用数等科学质量指标丰富结果列表,以增强用户体验,提高性能。本论文项目旨在研究搜索结果页面中影响力指标的整合对相关性评估的影响,同时考虑传统的基于引用的度量和替代度量。用户行为分析结合了眼动追踪和有声思考以及问卷调查。本文描述了一项实验研究的方法,旨在回答这样一个问题:指标的可见性是否会改变科学文献检索中的行为,以及行为是否会因指标的类型而变化,特别是引用率和替代指标得分。
{"title":"Do Metrics Matter?","authors":"Jacqueline Sachse","doi":"10.1145/3295750.3298973","DOIUrl":"https://doi.org/10.1145/3295750.3298973","url":null,"abstract":"Scientific search engines enrich result lists with indicators of scientific quality, such as citation counts, in order to enhance user experience and improve performance. This dissertation project aims to study the effect of such integration of impact indicators in search result pages on relevance evaluation, considering both traditional citation-based and altmetric measures. The user behavior is analyzed with a combination of eye-tracking and think-aloud as well as a questionnaire. This paper describes the methodology of an experimental study designed to answer the question if the visibility of metrics alters the behavior during scientific literature search and if behavior varies depending on the kind of metric, specifically citation rate and altmetric score.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114112704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Investigating Result Presentation in Conversational IR 会话式IR的结果呈现研究
Souvick Ghosh
Recent researches in conversational IR have explored problems related to context enhancement, question-answering, and query reformulations. However, very few researches have focused on result presentation over audio channels. The linear and transient nature of speech makes it cognitively challenging for the user to process a large amount of information. Presenting the search results (from SERP) is equally challenging as it is not feasible to read out the list of results. In this paper, we propose a study to evaluate the users' preference of modalities when using conversational search systems. The study will help us to understand how results should be presented in a conversational search system. As we observe how users search using audio queries, interact with the intermediary, and process the results presented, we aim to develop an insight on how to present results more efficiently in a conversational search setting. We also plan on exploring the effectiveness and consistency of different media in a conversational search setting. Our observations will inform future designs and help to create a better understanding of such systems.
近年来,会话式信息检索的研究主要集中在语境增强、问答和查询重新表述等方面。然而,针对音频通道上的结果呈现的研究却很少。语音的线性和瞬态特性使得用户在处理大量信息时面临认知上的挑战。呈现搜索结果(来自SERP)同样具有挑战性,因为读出结果列表是不可行的。在本文中,我们提出了一项研究,以评估用户在使用会话搜索系统时对模式的偏好。这项研究将帮助我们理解在会话搜索系统中应该如何呈现结果。当我们观察用户如何使用音频查询进行搜索、与中介交互以及处理呈现的结果时,我们的目标是深入了解如何在会话搜索设置中更有效地呈现结果。我们还计划探索在会话搜索环境中不同媒体的有效性和一致性。我们的观察将为未来的设计提供信息,并有助于更好地理解此类系统。
{"title":"Investigating Result Presentation in Conversational IR","authors":"Souvick Ghosh","doi":"10.1145/3295750.3298974","DOIUrl":"https://doi.org/10.1145/3295750.3298974","url":null,"abstract":"Recent researches in conversational IR have explored problems related to context enhancement, question-answering, and query reformulations. However, very few researches have focused on result presentation over audio channels. The linear and transient nature of speech makes it cognitively challenging for the user to process a large amount of information. Presenting the search results (from SERP) is equally challenging as it is not feasible to read out the list of results. In this paper, we propose a study to evaluate the users' preference of modalities when using conversational search systems. The study will help us to understand how results should be presented in a conversational search system. As we observe how users search using audio queries, interact with the intermediary, and process the results presented, we aim to develop an insight on how to present results more efficiently in a conversational search setting. We also plan on exploring the effectiveness and consistency of different media in a conversational search setting. Our observations will inform future designs and help to create a better understanding of such systems.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"458 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121181119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Clarifying False Memories in Voice-based Search 在语音搜索中澄清错误记忆
Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, Matthias Hagen
Queries containing false memories (i.e., attributes the user misremembered about a searched item) represent a challenge for search systems. A query with a false memory will match inadequate results or even no result, and an automatic query correction is necessary to satisfy the user expectations. For voice-based search interfaces, which aim at a natural, dialog-based search experience, a sensible answer to this kind of unintentionally ill-posed queries is even more crucial. However, the usual solutions in display-based interfaces for queries without matches (e.g., suggesting to drop some query terms) cannot really be transferred to the voice-based setting. Based on the assumption that false memory queries could be identified---a research problem in its own right---, we present the first user study on how voice-based search systems may communicate the respective corrections to a user. Our study compares the user satisfaction in a voice-based search setting for three kinds of false memory clarifications and a baseline case where the system just answers "I don't know.'' Our findings suggest that (1)~users are more satisfied when they receive a clarification that and how the system corrected a false memory, (2)~users even prefer failed correction attempts over no such attempt, and (3)~the tone of the clarification has to be considered for the best possible user satisfaction as well.
包含错误记忆的查询(例如,用户记错了搜索项的属性)对搜索系统来说是一个挑战。具有错误记忆的查询将匹配不充分的结果,甚至没有结果,并且需要自动查询更正以满足用户的期望。对于以自然的、基于对话的搜索体验为目标的基于语音的搜索界面来说,对这种无意中不恰当的查询的合理回答更为重要。然而,在基于显示的界面中,对于没有匹配的查询(例如,建议删除一些查询术语),通常的解决方案无法真正转移到基于语音的设置中。基于错误记忆查询可以被识别的假设——这本身就是一个研究问题——我们提出了关于基于语音的搜索系统如何将各自的更正传达给用户的第一个用户研究。我们的研究比较了三种错误记忆澄清的语音搜索设置和系统只回答“我不知道”的基线情况下的用户满意度。“我们的研究结果表明,(1)当用户收到系统如何纠正错误记忆的澄清时,他们会更满意;(2)用户甚至更喜欢失败的纠正尝试,而不是没有这样的尝试;(3)澄清的语气也必须考虑到最好的用户满意度。”
{"title":"Clarifying False Memories in Voice-based Search","authors":"Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, Matthias Hagen","doi":"10.1145/3295750.3298961","DOIUrl":"https://doi.org/10.1145/3295750.3298961","url":null,"abstract":"Queries containing false memories (i.e., attributes the user misremembered about a searched item) represent a challenge for search systems. A query with a false memory will match inadequate results or even no result, and an automatic query correction is necessary to satisfy the user expectations. For voice-based search interfaces, which aim at a natural, dialog-based search experience, a sensible answer to this kind of unintentionally ill-posed queries is even more crucial. However, the usual solutions in display-based interfaces for queries without matches (e.g., suggesting to drop some query terms) cannot really be transferred to the voice-based setting. Based on the assumption that false memory queries could be identified---a research problem in its own right---, we present the first user study on how voice-based search systems may communicate the respective corrections to a user. Our study compares the user satisfaction in a voice-based search setting for three kinds of false memory clarifications and a baseline case where the system just answers \"I don't know.'' Our findings suggest that (1)~users are more satisfied when they receive a clarification that and how the system corrected a false memory, (2)~users even prefer failed correction attempts over no such attempt, and (3)~the tone of the clarification has to be considered for the best possible user satisfaction as well.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131351920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Embedding Search into a Conversational Platform to Support Collaborative Search 将搜索嵌入到会话平台中以支持协作搜索
Sandeep Avula, Jaime Arguello, Robert G. Capra, Jordan Dodson, Yuhui Huang, Filip Radlinski
Popular messaging platforms such as Slack have given rise to thousands of applications (or bots) that users can engage with individually or as a group. In this paper, we study the use of searchbots (i.e., bots that perform specific types of searches) during collaborative information-seeking tasks mediated through Slack. We report on a user study in which 27 pairs of participants were exposed to three searchbot conditions (a within-subjects design). In the first condition, participants completed the task by searching independently and coordinating through Slack (no searchbot). In the second condition, participants could only search inside of Slack using the searchbot. In the third condition, participants could both search inside of Slack using the searchbot and outside of Slack using their own independent search interfaces. We investigate four research questions focusing on the influence of the searchbot condition on outcomes associated with: (RQ1) participants' levels of workload, (RQ2) collaborative awareness, (RQ3) experiences interacting with the searchbot, and (RQ4) search behaviors. Our results suggest opportunities and challenges in designing searchbots to support collaborative search. On one hand, access to the searchbot resulted in more collaborative awareness, ease of coordination, and fewer duplicated searches. On the other hand, forcing participants to share the querying environment resulted in fewer overall queries, fewer query refinements by individuals, and greater levels of effort. We discuss the implications of our findings for designing effective searchbots to support collaborative search.
Slack等流行的通讯平台催生了成千上万的应用程序(或机器人),用户可以单独或以群组的形式与之互动。在本文中,我们研究了搜索机器人(即执行特定类型搜索的机器人)在通过Slack介导的协作信息搜索任务中的使用情况。我们报告了一项用户研究,其中27对参与者暴露于三种搜索机器人条件(主题内设计)。在第一种情况下,参与者通过独立搜索和通过Slack(无搜索机器人)协调来完成任务。在第二种情况下,参与者只能使用搜索机器人在Slack内部进行搜索。在第三种情况下,参与者既可以使用搜索机器人在Slack内部搜索,也可以使用自己独立的搜索界面在Slack外部搜索。我们研究了四个研究问题,重点关注搜索机器人条件对相关结果的影响:(RQ1)参与者的工作量水平,(RQ2)协作意识,(RQ3)与搜索机器人交互的经验,以及(RQ4)搜索行为。我们的研究结果表明,在设计搜索机器人以支持协同搜索方面存在机遇和挑战。一方面,使用搜索机器人带来了更多的协作意识、更容易的协调和更少的重复搜索。另一方面,强制参与者共享查询环境会减少总体查询,减少个人的查询细化,并增加工作量。我们讨论了我们的发现对设计有效的搜索机器人来支持协作搜索的影响。
{"title":"Embedding Search into a Conversational Platform to Support Collaborative Search","authors":"Sandeep Avula, Jaime Arguello, Robert G. Capra, Jordan Dodson, Yuhui Huang, Filip Radlinski","doi":"10.1145/3295750.3298928","DOIUrl":"https://doi.org/10.1145/3295750.3298928","url":null,"abstract":"Popular messaging platforms such as Slack have given rise to thousands of applications (or bots) that users can engage with individually or as a group. In this paper, we study the use of searchbots (i.e., bots that perform specific types of searches) during collaborative information-seeking tasks mediated through Slack. We report on a user study in which 27 pairs of participants were exposed to three searchbot conditions (a within-subjects design). In the first condition, participants completed the task by searching independently and coordinating through Slack (no searchbot). In the second condition, participants could only search inside of Slack using the searchbot. In the third condition, participants could both search inside of Slack using the searchbot and outside of Slack using their own independent search interfaces. We investigate four research questions focusing on the influence of the searchbot condition on outcomes associated with: (RQ1) participants' levels of workload, (RQ2) collaborative awareness, (RQ3) experiences interacting with the searchbot, and (RQ4) search behaviors. Our results suggest opportunities and challenges in designing searchbots to support collaborative search. On one hand, access to the searchbot resulted in more collaborative awareness, ease of coordination, and fewer duplicated searches. On the other hand, forcing participants to share the querying environment resulted in fewer overall queries, fewer query refinements by individuals, and greater levels of effort. We discuss the implications of our findings for designing effective searchbots to support collaborative search.","PeriodicalId":187771,"journal":{"name":"Proceedings of the 2019 Conference on Human Information Interaction and Retrieval","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132937631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
期刊
Proceedings of the 2019 Conference on Human Information Interaction and Retrieval
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1