首页 > 最新文献

Information Systems Frontiers最新文献

英文 中文
Virtual Experiences, Real Memories? A Study on Information Recall and Recognition in the Metaverse 虚拟体验,真实记忆?元宇宙中的信息回忆与识别研究
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-08 DOI: 10.1007/s10796-024-10500-2
Nannan Xi, Juan Chen, Filipe Gama, Henry Korkeila, Juho Hamari

There are high expectations towards extended reality (XR), namely the “metaverse”. However, human performance in the metaverse has been called into question when undertaking everyday activities (e.g., working, shopping, and learning etc.), as complex human-technology interaction required may hinder cognitive abilities such as processing of information. Therefore, this study attempts to address whether and how XR impacts abilities to recall and recognize information in daily-life settings. We investigated the effects of VR and AR in a 2 (VR: yes vs. no) × 2 (AR: yes vs. no) between-subjects design experiment related to a shopping task (N = 153) on textual (product names) and pictorial (product pictures) recognition and recall. The results show that textual information recall and pictorial information recognition did not significantly suffer in XR compared to shopping in a brick-and-mortar store. While regarding textual information recognition performance, the results show that fully physical environments offered the highest performance compared to the different XR technologies being used. Overall, the study provides important findings and guidance for the use of extended reality technologies in consumer-facing businesses, as well as the use of XR in everyday life in general.

人们对扩展现实(XR),即 "元宇宙 "寄予厚望。然而,在进行日常活动(如工作、购物和学习等)时,人类在元宇宙中的表现却备受质疑,因为所需的复杂的人机交互可能会阻碍信息处理等认知能力。因此,本研究试图探讨 XR 是否以及如何影响人们在日常生活中回忆和识别信息的能力。我们在一个与购物任务相关的 2(VR:是 vs. 否)×2(AR:是 vs. 否)主体间设计实验中(N = 153)调查了 VR 和 AR 对文字(产品名称)和图像(产品图片)识别和回忆的影响。结果表明,与在实体店购物相比,在 XR 中文字信息的回忆和图片信息的识别没有受到明显影响。在文字信息识别性能方面,结果表明,与所使用的不同 XR 技术相比,完全物理环境提供的性能最高。总之,这项研究为在面向消费者的企业中使用扩展现实技术以及在日常生活中使用 XR 提供了重要的发现和指导。
{"title":"Virtual Experiences, Real Memories? A Study on Information Recall and Recognition in the Metaverse","authors":"Nannan Xi, Juan Chen, Filipe Gama, Henry Korkeila, Juho Hamari","doi":"10.1007/s10796-024-10500-2","DOIUrl":"https://doi.org/10.1007/s10796-024-10500-2","url":null,"abstract":"<p>There are high expectations towards extended reality (XR), namely the “metaverse”. However, human performance in the metaverse has been called into question when undertaking everyday activities (e.g., working, shopping, and learning etc.), as complex human-technology interaction required may hinder cognitive abilities such as processing of information. Therefore, this study attempts to address whether and how XR impacts abilities to recall and recognize information in daily-life settings. We investigated the effects of VR and AR in a 2 (VR: yes vs. no) × 2 (AR: yes vs. no) between-subjects design experiment related to a shopping task (N = 153) on textual (product names) and pictorial (product pictures) recognition and recall. The results show that textual information recall and pictorial information recognition did not significantly suffer in XR compared to shopping in a brick-and-mortar store. While regarding textual information recognition performance, the results show that fully physical environments offered the highest performance compared to the different XR technologies being used. Overall, the study provides important findings and guidance for the use of extended reality technologies in consumer-facing businesses, as well as the use of XR in everyday life in general.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"38 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141557112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital Sustainability for Energy-Efficient Behaviours: A User Representation and Touchpoint Model 数字可持续性促进节能行为:用户表征和接触点模型
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-08 DOI: 10.1007/s10796-024-10509-7
Stephen McCarthy, Titiana Ertiö, Ciara Fitzgerald, Nina Kahma

In response to climate change, nations have been tasked with reducing energy consumption and lessening their carbon footprint through targeted actions. While digital technologies can support this goal, our understanding of energy practices in a private household context remains nascent. This challenge is amplified by the ‘invisible’ nature of users’ interaction with energy systems and the impact of unconscious habits. Our objective is to explore how touchpoints embedded in digital sustainability platforms shape energy-efficiency behaviours among users. Building on data from semi-structured interviews and a two-hour co-creation workshop with 25 energy experts in the ECO2 project, we first identify three user representations of relevance to such platforms: energy-unaware, living in denial, and energy-aware and active. Our findings suggest that ‘static’ user representations (based on user demographics and average consumption) are giving way to socio-cognitive representations that follow users’ journeys in energy efficiency. We then develop a set of design principles to promote sustainable energy behaviours through digital sustainability platforms across user-owned, social/external, brand-owned, and partner-owned touchpoints. An analysis of user feedback from the ECO2 project shows support for our design principles across users’ journeys. Of 62 respondents covering all three representations, 76% of them intended to “implement changes in terms of energy consumption and energy efficiency”.

为应对气候变化,各国都肩负着通过有针对性的行动减少能源消耗和碳足迹的任务。虽然数字技术可以支持这一目标,但我们对私人家庭能源使用情况的了解仍处于起步阶段。用户与能源系统互动的 "无形 "性质以及无意识习惯的影响加剧了这一挑战。我们的目标是探索嵌入在数字可持续发展平台中的接触点如何影响用户的节能行为。在半结构化访谈和与 25 位 ECO2 项目能源专家进行的两小时共同创造研讨会所获得的数据基础上,我们首先确定了与此类平台相关的三种用户表征:缺乏能源意识、生活在否定中,以及积极的能源意识。我们的研究结果表明,"静态 "用户表征(基于用户人口统计和平均消耗量)正在让位于社会认知表征,即用户的节能历程。随后,我们制定了一套设计原则,通过用户、社交/外部、品牌和合作伙伴的数字可持续发展平台,促进可持续能源行为。对 ECO2 项目用户反馈的分析表明,我们的设计原则在用户的整个旅程中都得到了支持。在涵盖所有三种表现形式的 62 位受访者中,76% 的人打算 "在能源消耗和能源效率方面做出改变"。
{"title":"Digital Sustainability for Energy-Efficient Behaviours: A User Representation and Touchpoint Model","authors":"Stephen McCarthy, Titiana Ertiö, Ciara Fitzgerald, Nina Kahma","doi":"10.1007/s10796-024-10509-7","DOIUrl":"https://doi.org/10.1007/s10796-024-10509-7","url":null,"abstract":"<p>In response to climate change, nations have been tasked with reducing energy consumption and lessening their carbon footprint through targeted actions. While digital technologies can support this goal, our understanding of energy practices in a private household context remains nascent. This challenge is amplified by the ‘invisible’ nature of users’ interaction with energy systems and the impact of unconscious habits. Our objective is to explore how touchpoints embedded in digital sustainability platforms shape energy-efficiency behaviours among users. Building on data from semi-structured interviews and a two-hour co-creation workshop with 25 energy experts in the ECO2 project, we first identify three user representations of relevance to such platforms: <i>energy-unaware</i>, <i>living in denial</i>, and <i>energy-aware and active</i>. Our findings suggest that ‘static’ user representations (based on user demographics and average consumption) are giving way to socio-cognitive representations that follow users’ journeys in energy efficiency. We then develop a set of design principles to promote sustainable energy behaviours through digital sustainability platforms across <i>user-owned</i>, <i>social/external</i>, <i>brand-owned</i>, and <i>partner-owned</i> touchpoints. An analysis of user feedback from the ECO2 project shows support for our design principles across users’ journeys. Of 62 respondents covering all three representations, 76% of them intended to “implement changes in terms of energy consumption and energy efficiency”.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"26 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141557113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Taxonomy of Home Automation: Expert Perspectives on the Future of Smarter Homes 家庭自动化分类学:智能家居未来的专家视角
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-08 DOI: 10.1007/s10796-024-10496-9
Shabnam FakhrHosseini, Chaiwoo Lee, Sheng-Hung Lee, Joseph Coughlin

Recent advancements in digital technologies, including artificial intelligence (AI), Internet of Things (IoT), and information and communication technologies (ICT), are transforming homes into interconnected ecosystem of services. Yet, discourse on home technologies remains fragmented due to inconsistent terminologies. This paper addresses the lack of a framework, studying distinctions between smart and non-smart homes and forecasting connectivity and automation growth. Experts (21) participated in online surveys and interviews in 2021, exploring language, structure, and technical/social aspects of basic and smarter homes. Quantitative survey data and qualitative interview analyses yield insights on defining smarter homes, barriers to adoption, and framework improvements to establish universal definitions. This study underscores the urgency of harmonizing language and concepts in the domain of smart homes, revealing user understanding gaps and usability issues as barriers. This bridges gaps for consumer engagement and tech adoption.

人工智能(AI)、物联网(IoT)以及信息和通信技术(ICT)等数字技术的最新进展正在将家庭转变为相互关联的服务生态系统。然而,由于术语不一致,有关家居技术的讨论仍然支离破碎。本文针对缺乏框架的问题,研究了智能和非智能家居之间的区别,并预测了互联性和自动化的增长。专家(21 位)参与了 2021 年的在线调查和访谈,探讨了基本家庭和智能家居的语言、结构以及技术/社会方面的问题。通过定量调查数据和定性访谈分析,我们对智能家居的定义、采用障碍以及改进框架以建立通用定义有了深入了解。这项研究强调了统一智能家居领域的语言和概念的紧迫性,揭示了用户理解方面的差距和作为障碍的可用性问题。这将缩小消费者参与和技术采用方面的差距。
{"title":"A Taxonomy of Home Automation: Expert Perspectives on the Future of Smarter Homes","authors":"Shabnam FakhrHosseini, Chaiwoo Lee, Sheng-Hung Lee, Joseph Coughlin","doi":"10.1007/s10796-024-10496-9","DOIUrl":"https://doi.org/10.1007/s10796-024-10496-9","url":null,"abstract":"<p>Recent advancements in digital technologies, including artificial intelligence (AI), Internet of Things (IoT), and information and communication technologies (ICT), are transforming homes into interconnected ecosystem of services. Yet, discourse on home technologies remains fragmented due to inconsistent terminologies. This paper addresses the lack of a framework, studying distinctions between smart and non-smart homes and forecasting connectivity and automation growth. Experts (21) participated in online surveys and interviews in 2021, exploring language, structure, and technical/social aspects of basic and smarter homes. Quantitative survey data and qualitative interview analyses yield insights on defining smarter homes, barriers to adoption, and framework improvements to establish universal definitions. This study underscores the urgency of harmonizing language and concepts in the domain of smart homes, revealing user understanding gaps and usability issues as barriers. This bridges gaps for consumer engagement and tech adoption.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"15 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141557111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fighting Fire with Fire: Combating Criminal Abuse of Cryptocurrency with a P2P Mindset 以毒攻毒:以 P2P 思维打击滥用加密货币的犯罪行为
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-06 DOI: 10.1007/s10796-024-10498-7
Klein Galit, Assadi Djamchid, Zwilling Moti

As part of the P2P sharing economy, cryptocurrencies offer both creative and criminal opportunities. To deal with offenders, solutions such as legislation and regulation are proposed. However, these are foreign to the P2P spirit of trusted interactions and transactions. This paper aims to identify solutions that align with P2P technologies and relationships to combat the criminal use of cryptocurrencies. In line with our research question, we adopt the method of grounded theory. Based on 45 interviews on 1,500 h of podcasts, blogs, and TV shows, we observed how experts in finance, technology, and cryptocurrency analyzed the hazards, as well as, the solutions for cryptocurrencies schemes. The results indicate that this new technology has also engendered new types of criminal schemes; thus, we can categorize malicious behaviors into conventional and P2P hazards. In addition, experts also point to conventional and P2P solutions to crypto-crimes at the individual, organizational, communal, and national levels. As such, they underscore the discrepancies between those who push for solutions favoring conventional regulatory forces versus those advocating for normative legitimacy, hence pulling the industry to preserve the P2P identity. Following institutional theory and the need for legitimacy in this new and disruptive industry, we discuss the tension between agendas and suggest unorthodox solutions for an innovative yet troubled technology.

作为 P2P 共享经济的一部分,加密货币既提供了创造性机会,也提供了犯罪机会。为了对付犯罪者,人们提出了立法和监管等解决方案。然而,这些都与可信互动和交易的 P2P 精神格格不入。本文旨在找出符合 P2P 技术和关系的解决方案,以打击使用加密货币的犯罪行为。根据我们的研究问题,我们采用了基础理论的方法。基于对 1,500 h 的播客、博客和电视节目进行的 45 次访谈,我们观察了金融、技术和加密货币领域的专家如何分析加密货币计划的危害以及解决方案。结果表明,这项新技术也催生了新型犯罪计划;因此,我们可以将恶意行为分为传统危害和 P2P 危害。此外,专家们还指出了在个人、组织、社区和国家层面应对加密犯罪的传统和 P2P 解决方案。因此,他们强调了推动传统监管力量解决方案的人与倡导规范合法性的人之间的差异,从而拉动行业维护 P2P 特性。根据制度理论和这一新的颠覆性行业对合法性的需求,我们讨论了各种议程之间的紧张关系,并为这一创新但问题重重的技术提出了非正统的解决方案。
{"title":"Fighting Fire with Fire: Combating Criminal Abuse of Cryptocurrency with a P2P Mindset","authors":"Klein Galit, Assadi Djamchid, Zwilling Moti","doi":"10.1007/s10796-024-10498-7","DOIUrl":"https://doi.org/10.1007/s10796-024-10498-7","url":null,"abstract":"<p>As part of the P2P sharing economy, cryptocurrencies offer both creative and criminal opportunities. To deal with offenders, solutions such as legislation and regulation are proposed. However, these are foreign to the P2P spirit of trusted interactions and transactions. This paper aims to identify solutions that align with P2P technologies and relationships to combat the criminal use of cryptocurrencies. In line with our research question, we adopt the method of grounded theory. Based on 45 interviews on 1,500 h of podcasts, blogs, and TV shows, we observed how experts in finance, technology, and cryptocurrency analyzed the hazards, as well as, the solutions for cryptocurrencies schemes. The results indicate that this new technology has also engendered new types of criminal schemes; thus, we can categorize malicious behaviors into conventional and P2P hazards. In addition, experts also point to conventional and P2P solutions to crypto-crimes at the individual, organizational, communal, and national levels. As such, they underscore the discrepancies between those who push for solutions favoring conventional <i>regulatory</i> forces versus those advocating for <i>normative legitimacy</i>, hence pulling the industry to preserve the P2P identity. Following institutional theory and the need for legitimacy in this new and disruptive industry, we discuss the tension between agendas and suggest unorthodox solutions for an innovative yet troubled technology.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"38 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141553322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data Ingestion Validation Through Stable Conditional Metrics with Ranking and Filtering 通过具有排序和过滤功能的稳定条件度量对数据输入进行验证
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-05 DOI: 10.1007/s10796-024-10504-y
Niels Bylois, Frank Neven, Stijn Vansummeren

We introduce an advanced method for validating data quality, which is crucial for ensuring reliable analytics insights. Traditional data quality validation relies on data unit tests, which use global metrics to determine if data quality falls within expected ranges. Unfortunately, these existing approaches suffer from two limitations. Firstly, they offer only coarse-grained assessments, missing fine-grained errors. Secondly, they fail to pinpoint the specific data causing test failures. To address these issues, we propose a novel approach using conditional metrics, enabling more detailed analysis than global metrics. Our method involves two stages: unit test discovery and monitoring/error identification. In the discovery phase, we derive conditional metric-based unit tests from historical data, focusing on stability to select appropriate metrics. The monitoring phase involves using these tests for new data batches, with conditional metrics helping us identify potential errors. We validate the effectiveness of this approach using two datasets and seven synthetic error scenarios, showing significant improvements over global metrics and promising results in fine-grained error detection for data ingestion validation.

我们介绍了一种先进的数据质量验证方法,这对于确保可靠的分析洞察力至关重要。传统的数据质量验证依赖于数据单元测试,这些测试使用全局指标来确定数据质量是否在预期范围内。遗憾的是,这些现有方法存在两个局限性。首先,它们只能提供粗粒度的评估,缺少细粒度的误差。其次,它们无法精确定位导致测试失败的特定数据。为了解决这些问题,我们提出了一种使用条件度量的新方法,它能比全局度量进行更详细的分析。我们的方法包括两个阶段:单元测试发现和监控/错误识别。在发现阶段,我们从历史数据中推导出基于条件指标的单元测试,重点关注稳定性以选择合适的指标。在监控阶段,我们将这些测试用于新的数据批次,并利用条件指标帮助我们识别潜在的错误。我们使用两个数据集和七个合成错误场景验证了这种方法的有效性,结果表明它比全局度量方法有显著改进,在数据摄取验证的细粒度错误检测方面也取得了可喜成果。
{"title":"Data Ingestion Validation Through Stable Conditional Metrics with Ranking and Filtering","authors":"Niels Bylois, Frank Neven, Stijn Vansummeren","doi":"10.1007/s10796-024-10504-y","DOIUrl":"https://doi.org/10.1007/s10796-024-10504-y","url":null,"abstract":"<p>We introduce an advanced method for validating data quality, which is crucial for ensuring reliable analytics insights. Traditional data quality validation relies on data unit tests, which use global metrics to determine if data quality falls within expected ranges. Unfortunately, these existing approaches suffer from two limitations. Firstly, they offer only coarse-grained assessments, missing fine-grained errors. Secondly, they fail to pinpoint the specific data causing test failures. To address these issues, we propose a novel approach using conditional metrics, enabling more detailed analysis than global metrics. Our method involves two stages: unit test discovery and monitoring/error identification. In the discovery phase, we derive conditional metric-based unit tests from historical data, focusing on stability to select appropriate metrics. The monitoring phase involves using these tests for new data batches, with conditional metrics helping us identify potential errors. We validate the effectiveness of this approach using two datasets and seven synthetic error scenarios, showing significant improvements over global metrics and promising results in fine-grained error detection for data ingestion validation.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"22 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Making It Possible for the Auditing of AI: A Systematic Review of AI Audits and AI Auditability 让人工智能审计成为可能:对人工智能审计和人工智能可审计性的系统回顾
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-07-02 DOI: 10.1007/s10796-024-10508-8
Yueqi Li, Sanjay Goel

Artificial intelligence (AI) technologies have become the key driver of innovation in society. However, numerous vulnerabilities of AI systems can lead to negative consequences for society, such as biases encoded in the training data and algorithms and lack of transparency. This calls for AI systems to be audited to ensure that the impact on society is understood and mitigated. To enable AI audits, auditability measures need to be implemented. This study provides a systematic review of academic work and regulatory work on AI audits and AI auditability. Results reveal the current understanding of the AI audit scope, audit challenges, and auditability measures. We identify and categorize AI auditability measures for each audit area and specific process to be audited and the party responsible for each process to be audited. Our findings will guide existing efforts to make AI systems auditable across the lifecycle of AI systems.

人工智能(AI)技术已成为社会创新的主要驱动力。然而,人工智能系统的许多漏洞可能会给社会带来负面影响,例如训练数据和算法中的偏见以及缺乏透明度。这就要求对人工智能系统进行审计,以确保了解并减轻其对社会的影响。为实现人工智能审计,需要实施可审计性措施。本研究系统回顾了有关人工智能审计和人工智能可审计性的学术工作和监管工作。研究结果揭示了当前对人工智能审计范围、审计挑战和可审计性措施的理解。我们针对每个审计领域、待审计的具体流程以及每个待审计流程的责任方,确定了人工智能可审计性措施并进行了分类。我们的研究结果将指导现有的工作,使人工智能系统在整个生命周期内都具有可审计性。
{"title":"Making It Possible for the Auditing of AI: A Systematic Review of AI Audits and AI Auditability","authors":"Yueqi Li, Sanjay Goel","doi":"10.1007/s10796-024-10508-8","DOIUrl":"https://doi.org/10.1007/s10796-024-10508-8","url":null,"abstract":"<p>Artificial intelligence (AI) technologies have become the key driver of innovation in society. However, numerous vulnerabilities of AI systems can lead to negative consequences for society, such as biases encoded in the training data and algorithms and lack of transparency. This calls for AI systems to be audited to ensure that the impact on society is understood and mitigated. To enable AI audits, auditability measures need to be implemented. This study provides a systematic review of academic work and regulatory work on AI audits and AI auditability. Results reveal the current understanding of the AI audit scope, audit challenges, and auditability measures. We identify and categorize AI auditability measures for each audit area and specific process to be audited and the party responsible for each process to be audited. Our findings will guide existing efforts to make AI systems auditable across the lifecycle of AI systems.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"16 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141496024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing and Improving Active Learning Uncertainty Measures for Transformer Models by Discarding Outliers 通过剔除异常值比较和改进变压器模型的主动学习不确定性测量方法
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-06-26 DOI: 10.1007/s10796-024-10503-z
Julius Gonsior, Christian Falkenberg, Silvio Magino, Anja Reusch, Claudio Hartmann, Maik Thiele, Wolfgang Lehner

Despite achieving state-of-the-art results in nearly all Natural Language Processing applications, fine-tuning Transformer-encoder based language models still requires a significant amount of labeled data to achieve satisfying work. A well known technique to reduce the amount of human effort in acquiring a labeled dataset is Active Learning (AL): an iterative process in which only the minimal amount of samples is labeled. AL strategies require access to a quantified confidence measure of the model predictions. A common choice is the softmax activation function for the final Neural Network layer. In this paper, we compare eight alternatives on seven datasets and show that the softmax function provides misleading probabilities. Our finding is that most of the methods primarily identify hard-to-learn-from samples (commonly called outliers), resulting in worse than random performance, instead of samples, which actually reduce the uncertainty of the learned language model. As a solution, this paper proposes Uncertainty-Clipping, a heuristic to systematically exclude samples, which results in improvements for most methods compared to the softmax function.

尽管在几乎所有的自然语言处理应用中都取得了最先进的成果,但要对基于变换器编码器的语言模型进行微调,仍然需要大量的标注数据才能达到令人满意的效果。主动学习(Active Learning,AL)是一项众所周知的技术,它可以减少人类在获取标注数据集方面的工作量:这是一个迭代过程,在此过程中只对最小数量的样本进行标注。主动学习策略要求获得模型预测的量化置信度。一种常见的选择是神经网络最终层的软最大激活函数。在本文中,我们在七个数据集上比较了八种替代方法,结果表明,softmax 函数提供的概率具有误导性。我们的发现是,大多数方法主要识别难以学习的样本(通常称为离群值),结果比随机表现更差,而不是样本,这实际上降低了所学语言模型的不确定性。作为解决方案,本文提出了 "不确定性裁剪"(Uncertainty-Clipping),这是一种系统性地排除样本的启发式方法,与 softmax 函数相比,大多数方法都有所改进。
{"title":"Comparing and Improving Active Learning Uncertainty Measures for Transformer Models by Discarding Outliers","authors":"Julius Gonsior, Christian Falkenberg, Silvio Magino, Anja Reusch, Claudio Hartmann, Maik Thiele, Wolfgang Lehner","doi":"10.1007/s10796-024-10503-z","DOIUrl":"https://doi.org/10.1007/s10796-024-10503-z","url":null,"abstract":"<p>Despite achieving state-of-the-art results in nearly all Natural Language Processing applications, fine-tuning Transformer-encoder based language models still requires a significant amount of labeled data to achieve satisfying work. A well known technique to reduce the amount of human effort in acquiring a labeled dataset is <i>Active Learning</i> (AL): an iterative process in which only the minimal amount of samples is labeled. AL strategies require access to a quantified confidence measure of the model predictions. A common choice is the softmax activation function for the final Neural Network layer. In this paper, we compare eight alternatives on seven datasets and show that the softmax function provides misleading probabilities. Our finding is that most of the methods primarily identify hard-to-learn-from samples (commonly called outliers), resulting in worse than random performance, instead of samples, which actually reduce the uncertainty of the learned language model. As a solution, this paper proposes Uncertainty-Clipping, a heuristic to systematically exclude samples, which results in improvements for most methods compared to the softmax function.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"27 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141452945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Combating Fake News Using Implementation Intentions 利用实施意图打击假新闻
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-06-26 DOI: 10.1007/s10796-024-10502-0
Inaiya Armeen, Ross Niswanger, Chuan (Annie) Tian

The rise of misinformation on social media platforms is an extremely worrisome issue and calls for the development of interventions and strategies to combat fake news. This research investigates one potential mechanism that can help mitigate fake news: prompting users to form implementation intentions along with education. Previous research suggests that forming “if – then” plans, otherwise known as implementation intentions, is one of the best ways to facilitate behavior change. To evaluate the effectiveness of such plans, we used MTurk to conduct an experiment where we educated participants on fake news and then asked them to form implementation intentions about performing fact checking before sharing posts on social media. Participants who had received both the implementation intention intervention and the educational intervention significantly engaged more in fact checking behavior than those who did not receive any intervention as well as participants who had received only the educational intervention. This study contributes to the emerging literature on fake news by demonstrating that implementation intentions can be used in interventions to combat fake news.

社交媒体平台上虚假信息的增加是一个极其令人担忧的问题,需要制定干预措施和策略来打击假新闻。本研究调查了一种有助于减少假新闻的潜在机制:促使用户在接受教育的同时形成实施意图。以往的研究表明,形成 "如果-那么 "计划(又称实施意图)是促进行为改变的最佳方法之一。为了评估这种计划的有效性,我们使用 MTurk 进行了一项实验,在实验中我们对参与者进行了有关假新闻的教育,然后要求他们形成在社交媒体上分享帖子之前进行事实核查的实施意图。同时接受实施意图干预和教育干预的参与者的事实核查行为明显多于未接受任何干预的参与者以及仅接受教育干预的参与者。这项研究表明,实施意图可用于打击假新闻的干预措施,从而为有关假新闻的新兴文献做出了贡献。
{"title":"Combating Fake News Using Implementation Intentions","authors":"Inaiya Armeen, Ross Niswanger, Chuan (Annie) Tian","doi":"10.1007/s10796-024-10502-0","DOIUrl":"https://doi.org/10.1007/s10796-024-10502-0","url":null,"abstract":"<p>The rise of misinformation on social media platforms is an extremely worrisome issue and calls for the development of interventions and strategies to combat fake news. This research investigates one potential mechanism that can help mitigate fake news: prompting users to form implementation intentions along with education. Previous research suggests that forming “if – then” plans, otherwise known as implementation intentions, is one of the best ways to facilitate behavior change. To evaluate the effectiveness of such plans, we used MTurk to conduct an experiment where we educated participants on fake news and then asked them to form implementation intentions about performing fact checking before sharing posts on social media. Participants who had received both the implementation intention intervention and the educational intervention significantly engaged more in fact checking behavior than those who did not receive any intervention as well as participants who had received only the educational intervention. This study contributes to the emerging literature on fake news by demonstrating that implementation intentions can be used in interventions to combat fake news.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"17 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141453099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Skyline-based Exploration of Temporal Property Graphs 基于天际线的时态属性图探索
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-06-26 DOI: 10.1007/s10796-024-10505-x
Evangelia Tsoukanara, Georgia Koloniari, Evaggelia Pitoura

In this paper, we focus on temporal property graphs, that is, property graphs whose labeled nodes and edges as well as the values of the properties associated with them may change with time. A key challenge in studying temporal graphs lies in detecting interesting events in their evolution, defined as time intervals of significant stability, growth, or shrinkage. To address this challenge, we build aggregated graphs, where nodes are grouped based on the values of their properties, and seek events at the aggregated level. To locate such events, we propose a novel approach based on unified evolution skylines. A unified evolution skyline assesses the significance of an event in conjunction with the duration of the interval in which the event occurs. Significance is measured by a set of counts, where each count refers to the number of graph elements that remain stable, are created, or deleted, for a specific property value. Lastly, we share experimental findings that highlight the efficiency and effectiveness of our approach.

在本文中,我们重点研究时态属性图,即其标记的节点和边以及与之相关的属性值可能随时间变化的属性图。研究时间图的一个关键挑战在于检测其演变过程中的有趣事件,即显著稳定、增长或缩小的时间间隔。为了应对这一挑战,我们构建了聚合图,根据节点的属性值对节点进行分组,并在聚合层面上寻找事件。为了定位此类事件,我们提出了一种基于统一演化天际线的新方法。统一演化天际线结合事件发生的时间间隔评估事件的重要性。重要性通过一组计数来衡量,其中每个计数指的是在特定属性值下保持稳定、创建或删除的图元素数量。最后,我们将分享实验结果,以突出我们方法的效率和有效性。
{"title":"Skyline-based Exploration of Temporal Property Graphs","authors":"Evangelia Tsoukanara, Georgia Koloniari, Evaggelia Pitoura","doi":"10.1007/s10796-024-10505-x","DOIUrl":"https://doi.org/10.1007/s10796-024-10505-x","url":null,"abstract":"<p>In this paper, we focus on temporal property graphs, that is, property graphs whose labeled nodes and edges as well as the values of the properties associated with them may change with time. A key challenge in studying temporal graphs lies in detecting interesting events in their evolution, defined as time intervals of significant stability, growth, or shrinkage. To address this challenge, we build aggregated graphs, where nodes are grouped based on the values of their properties, and seek events at the aggregated level. To locate such events, we propose a novel approach based on <i>unified evolution skylines</i>. A unified evolution skyline assesses the significance of an event in conjunction with the duration of the interval in which the event occurs. Significance is measured by a set of counts, where each count refers to the number of graph elements that remain stable, are created, or deleted, for a specific property value. Lastly, we share experimental findings that highlight the efficiency and effectiveness of our approach.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"19 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141453104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploiting Shared Sub-Expression and Materialized View Reuse for Multi-Query Optimization 利用共享子表达式和物化视图重用实现多查询优化
IF 5.9 3区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-06-25 DOI: 10.1007/s10796-024-10506-w
Bala Gurumurthy, Vasudev Raghavendra Bidarkar, David Broneske, Thilo Pionteck, Gunter Saake

Querying in isolation lacks the potential of reusing intermediate results, which ends up wasting computational resources. Multi-Query Optimization (MQO) addresses this challenge by devising a shared execution strategy across queries, with two generally used strategies: batched or cached. These strategies are shown to improve performance, but hardly any study explores the combination of both. In this work we explore such a hybrid MQO, combining batching (Shared Sub-Expression) and caching (Materialized View Reuse) techniques. Our hybrid-MQO system merges batched query results as well as caches the intermediate results, thereby any new query is given a path within the previous plan as well as reusing the results. Since caching is a key component for improving performance, we measure the impact of common caching techniques such as FIFO, LRU, MRU and LFU. Our results show LRU to be the optimal for our usecase, which we use in our subsequent evaluations. To study the influence of batching, we vary the factor - derivability - which represents the similarity of the results within a query batch. Similarly, we vary the cache sizes to study the influence of caching. Moreover, we also study the role of different database operators in the performance of our hybrid system. The results suggest that, depending on the individual operators, our hybrid method gains a speed-up between 4x to a slowdown of 2x from using MQO techniques in isolation. Furthermore, our results show that workloads with a generously sized cache that contain similar queries benefit from using our hybrid method, with an observed speed-up of 2x over sequential execution in the best case.

孤立查询缺乏重复使用中间结果的潜力,最终会浪费计算资源。多查询优化(Multi-Query Optimization,MQO)通过设计一种跨查询的共享执行策略来应对这一挑战,通常使用两种策略:批处理或缓存。这些策略都被证明可以提高性能,但几乎没有研究探讨过如何将这两种策略结合起来。在这项工作中,我们探索了这样一种混合 MQO,它结合了批处理(共享子表达式)和缓存(物化视图重用)技术。我们的混合 MQO 系统合并了批处理查询结果,并缓存了中间结果,从而为任何新查询提供了先前计划中的路径,并重复使用了查询结果。由于缓存是提高性能的关键因素,我们衡量了 FIFO、LRU、MRU 和 LFU 等常用缓存技术的影响。我们的结果表明,LRU 对于我们的用例来说是最佳的,我们在随后的评估中使用了它。为了研究批处理的影响,我们改变了表示查询批处理中结果相似性的因素--可衍生性。同样,我们还改变了缓存大小,以研究缓存的影响。此外,我们还研究了不同数据库操作员对混合系统性能的影响。结果表明,与单独使用 MQO 技术相比,根据不同的操作员,我们的混合方法可以提高 4 倍的速度,降低 2 倍的速度。此外,我们的结果表明,使用我们的混合方法,缓存大小适中且包含类似查询的工作负载将受益匪浅,在最佳情况下,观察到的速度比顺序执行提高了 2 倍。
{"title":"Exploiting Shared Sub-Expression and Materialized View Reuse for Multi-Query Optimization","authors":"Bala Gurumurthy, Vasudev Raghavendra Bidarkar, David Broneske, Thilo Pionteck, Gunter Saake","doi":"10.1007/s10796-024-10506-w","DOIUrl":"https://doi.org/10.1007/s10796-024-10506-w","url":null,"abstract":"<p>Querying in isolation lacks the potential of reusing intermediate results, which ends up wasting computational resources. Multi-Query Optimization (MQO) addresses this challenge by devising a shared execution strategy across queries, with two generally used strategies: <i>batched</i> or <i>cached</i>. These strategies are shown to improve performance, but hardly any study explores the combination of both. In this work we explore such a hybrid MQO, combining batching (Shared Sub-Expression) and caching (Materialized View Reuse) techniques. Our hybrid-MQO system merges batched query results as well as caches the intermediate results, thereby any new query is given a path within the previous plan as well as reusing the results. Since caching is a key component for improving performance, we measure the impact of common caching techniques such as FIFO, LRU, MRU and LFU. Our results show LRU to be the optimal for our usecase, which we use in our subsequent evaluations. To study the influence of batching, we vary the factor - <span>derivability</span> - which represents the similarity of the results within a query batch. Similarly, we vary the cache sizes to study the influence of caching. Moreover, we also study the role of different database operators in the performance of our hybrid system. The results suggest that, depending on the individual operators, our hybrid method gains a speed-up between 4x to a slowdown of 2x from using MQO techniques in isolation. Furthermore, our results show that workloads with a generously sized cache that contain similar queries benefit from using our hybrid method, with an observed speed-up of 2x over sequential execution in the best case.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"1 1","pages":""},"PeriodicalIF":5.9,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141448351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Information Systems Frontiers
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1