首页 > 最新文献

ACM Transactions on Information Systems最新文献

英文 中文
Should Fairness be a Metric or a Model? A Model-based Framework for Assessing Bias in Machine Learning Pipelines 公平性应该是衡量标准还是模型?基于模型的机器学习管道偏差评估框架
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-23 DOI: 10.1145/3641276
John P. Lalor, Ahmed Abbasi, Kezia Oketch, Yi Yang, Nicole Forsgren

Fairness measurement is crucial for assessing algorithmic bias in various types of machine learning (ML) models, including ones used for search relevance, recommendation, personalization, talent analytics, and natural language processing. However, the fairness measurement paradigm is currently dominated by fairness metrics that examine disparities in allocation and/or prediction error as univariate key performance indicators (KPIs) for a protected attribute or group. Although important and effective in assessing ML bias in certain contexts such as recidivism, existing metrics don’t work well in many real-world applications of ML characterized by imperfect models applied to an array of instances encompassing a multivariate mixture of protected attributes, that are part of a broader process pipeline. Consequently, the upstream representational harm quantified by existing metrics based on how the model represents protected groups doesn’t necessarily relate to allocational harm in the application of such models in downstream policy/decision contexts. We propose FAIR-Frame, a model-based framework for parsimoniously modeling fairness across multiple protected attributes in regard to the representational and allocational harm associated with the upstream design/development and downstream usage of ML models. We evaluate the efficacy of our proposed framework on two testbeds pertaining to text classification using pretrained language models. The upstream testbeds encompass over fifty thousand documents associated with twenty-eight thousand users, seven protected attributes and five different classification tasks. The downstream testbeds span three policy outcomes and over 5.41 million total observations. Results in comparison with several existing metrics show that the upstream representational harm measures produced by FAIR-Frame and other metrics are significantly different from one another, and that FAIR-Frame’s representational fairness measures have the highest percentage alignment and lowest error with allocational harm observed in downstream applications. Our findings have important implications for various ML contexts, including information retrieval, user modeling, digital platforms, and text classification, where responsible and trustworthy AI are becoming an imperative.

公平性测量对于评估各类机器学习(ML)模型(包括用于搜索相关性、推荐、个性化、人才分析和自然语言处理的模型)中的算法偏差至关重要。然而,公平性测量范式目前主要由公平性指标主导,这些指标将分配和/或预测误差的差异作为受保护属性或群体的单变量关键性能指标(KPI)进行检查。尽管在某些情况下(如累犯)评估 ML 偏差非常重要且有效,但现有指标在 ML 的许多实际应用中效果并不理想,这些应用的特点是将不完善的模型应用于一系列实例,其中包括受保护属性的多变量混合物,而这些实例是更广泛流程管道的一部分。因此,基于模型如何代表受保护群体的现有指标所量化的上游代表危害并不一定与在下游政策/决策环境中应用此类模型时的分配危害相关。我们提出了 FAIR-Frame(公平框架),这是一个基于模型的框架,用于对多重受保护属性的公平性进行简化建模,以反映与 ML 模型的上游设计/开发和下游使用相关的代表性和分配性损害。我们在使用预训练语言模型进行文本分类的两个测试平台上评估了我们提出的框架的有效性。上游测试平台包含五万多份文档,涉及两万八千名用户、七个受保护属性和五个不同的分类任务。下游测试平台涵盖三种政策结果和超过 541 万个观察结果。与几种现有度量方法的比较结果表明,FAIR-Frame 和其他度量方法产生的上游代表性危害度量彼此差异显著,FAIR-Frame 的代表性公平度量与下游应用中观察到的分配性危害具有最高的一致性百分比和最低的误差。我们的发现对信息检索、用户建模、数字平台和文本分类等各种人工智能领域具有重要意义,在这些领域,负责任和可信赖的人工智能正成为当务之急。
{"title":"Should Fairness be a Metric or a Model? A Model-based Framework for Assessing Bias in Machine Learning Pipelines","authors":"John P. Lalor, Ahmed Abbasi, Kezia Oketch, Yi Yang, Nicole Forsgren","doi":"10.1145/3641276","DOIUrl":"https://doi.org/10.1145/3641276","url":null,"abstract":"<p>Fairness measurement is crucial for assessing algorithmic bias in various types of machine learning (ML) models, including ones used for search relevance, recommendation, personalization, talent analytics, and natural language processing. However, the fairness measurement paradigm is currently dominated by fairness metrics that examine disparities in allocation and/or prediction error as univariate key performance indicators (KPIs) for a protected attribute or group. Although important and effective in assessing ML bias in certain contexts such as recidivism, existing metrics don’t work well in many real-world applications of ML characterized by imperfect models applied to an array of instances encompassing a multivariate mixture of protected attributes, that are part of a broader process pipeline. Consequently, the upstream representational harm quantified by existing metrics based on how the model represents protected groups doesn’t necessarily relate to allocational harm in the application of such models in downstream policy/decision contexts. We propose FAIR-Frame, a model-based framework for parsimoniously modeling fairness across multiple protected attributes in regard to the representational and allocational harm associated with the upstream design/development and downstream usage of ML models. We evaluate the efficacy of our proposed framework on two testbeds pertaining to text classification using pretrained language models. The upstream testbeds encompass over fifty thousand documents associated with twenty-eight thousand users, seven protected attributes and five different classification tasks. The downstream testbeds span three policy outcomes and over 5.41 million total observations. Results in comparison with several existing metrics show that the upstream representational harm measures produced by FAIR-Frame and other metrics are significantly different from one another, and that FAIR-Frame’s representational fairness measures have the highest percentage alignment and lowest error with allocational harm observed in downstream applications. Our findings have important implications for various ML contexts, including information retrieval, user modeling, digital platforms, and text classification, where responsible and trustworthy AI are becoming an imperative.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139554160","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MultiCBR: Multi-view Contrastive Learning for Bundle Recommendation MultiCBR:用于捆绑推荐的多视角对比学习
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-23 DOI: 10.1145/3640810
Yunshan Ma, Yingzhi He, Xiang Wang, Yinwei Wei, Xiaoyu Du, Yuyangzi Fu, Tat-Seng Chua

Bundle recommendation seeks to recommend a bundle of related items to users to improve both user experience and the profits of platform. Existing bundle recommendation models have progressed from capturing only user-bundle interactions to the modeling of multiple relations among users, bundles and items. CrossCBR, in particular, incorporates cross-view contrastive learning into a two-view preference learning framework, significantly improving SOTA performance. It does, however, have two limitations: 1) the two-view formulation does not fully exploit all the heterogeneous relations among users, bundles and items; and 2) the ”early contrast and late fusion” framework is less effective in capturing user preference and difficult to generalize to multiple views.

In this paper, we present MultiCBR, a novel Multi-view Contrastive learning framework for Bundle Recommendation. First, we devise a multi-view representation learning framework capable of capturing all the user-bundle, user-item and bundle-item relations, especially better utilizing the bundle-item affiliations to enhance sparse bundles’ representations. Second, we innovatively adopt an ”early fusion and late contrast” design that first fuses the multi-view representations before performing self-supervised contrastive learning. In comparison to existing approaches, our framework reverses the order of fusion and contrast, introducing the following advantages: 1) our framework is capable of modeling both cross-view and ego-view preferences, allowing us to achieve enhanced user preference modeling; and 2) instead of requiring quadratic number of cross-view contrastive losses, we only require two self-supervised contrastive losses, resulting in minimal extra costs. Experimental results on three public datasets indicate that our method outperforms SOTA methods. The code and dataset can be found in the github repo https://github.com/HappyPointer/MultiCBR.

捆绑推荐旨在向用户推荐捆绑的相关项目,以改善用户体验和平台收益。现有的捆绑推荐模型已经从仅捕捉用户与捆绑商品之间的交互关系发展到对用户、捆绑商品和商品之间的多种关系进行建模。其中,CrossCBR 将跨视图对比学习纳入双视图偏好学习框架,显著提高了 SOTA 性能。不过,它也有两个局限性:1)双视图表述无法充分利用用户、捆绑和物品之间的所有异质关系;2)"早期对比和后期融合 "框架在捕捉用户偏好方面效果较差,而且难以推广到多视图。在本文中,我们提出了用于捆绑推荐的新型多视图对比学习框架 MultiCBR。首先,我们设计了一个多视图表征学习框架,能够捕捉用户-捆绑、用户-物品和捆绑-物品之间的所有关系,尤其是能更好地利用捆绑-物品之间的隶属关系来增强稀疏的捆绑表征。其次,我们创新性地采用了 "早期融合和后期对比 "设计,即首先融合多视图表征,然后再进行自监督对比学习。与现有方法相比,我们的框架颠倒了融合和对比的顺序,从而带来了以下优势:1)我们的框架能够对跨视角和自我视角偏好进行建模,从而实现增强的用户偏好建模;2)我们不需要四元数的跨视角对比损失,而只需要两个自监督对比损失,从而将额外成本降到最低。在三个公开数据集上的实验结果表明,我们的方法优于 SOTA 方法。代码和数据集可在 github repo https://github.com/HappyPointer/MultiCBR 上找到。
{"title":"MultiCBR: Multi-view Contrastive Learning for Bundle Recommendation","authors":"Yunshan Ma, Yingzhi He, Xiang Wang, Yinwei Wei, Xiaoyu Du, Yuyangzi Fu, Tat-Seng Chua","doi":"10.1145/3640810","DOIUrl":"https://doi.org/10.1145/3640810","url":null,"abstract":"<p>Bundle recommendation seeks to recommend a bundle of related items to users to improve both user experience and the profits of platform. Existing bundle recommendation models have progressed from capturing only user-bundle interactions to the modeling of multiple relations among users, bundles and items. CrossCBR, in particular, incorporates cross-view contrastive learning into a two-view preference learning framework, significantly improving SOTA performance. It does, however, have two limitations: 1) the two-view formulation does not fully exploit all the heterogeneous relations among users, bundles and items; and 2) the ”early contrast and late fusion” framework is less effective in capturing user preference and difficult to generalize to multiple views. </p><p>In this paper, we present MultiCBR, a novel <b>Multi</b>-view <b>C</b>ontrastive learning framework for <b>B</b>undle <b>R</b>ecommendation. First, we devise a multi-view representation learning framework capable of capturing all the user-bundle, user-item and bundle-item relations, especially better utilizing the bundle-item affiliations to enhance sparse bundles’ representations. Second, we innovatively adopt an ”early fusion and late contrast” design that first fuses the multi-view representations before performing self-supervised contrastive learning. In comparison to existing approaches, our framework reverses the order of fusion and contrast, introducing the following advantages: 1) our framework is capable of modeling both cross-view and ego-view preferences, allowing us to achieve enhanced user preference modeling; and 2) instead of requiring quadratic number of cross-view contrastive losses, we only require two self-supervised contrastive losses, resulting in minimal extra costs. Experimental results on three public datasets indicate that our method outperforms SOTA methods. The code and dataset can be found in the github repo https://github.com/HappyPointer/MultiCBR.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139554161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MCRPL: A Pretrain, Prompt & Fine-tune Paradigm for Non-overlapping Many-to-one Cross-domain Recommendation MCRPL:非重叠多对一跨域推荐的预训练、提示和微调范式
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-22 DOI: 10.1145/3641860
Hao Liu, Lei Guo, Lei Zhu, Yongqiang Jiang, Min Gao, Hongzhi Yin

Cross-domain Recommendation (CR) is the task that tends to improve the recommendations in the sparse target domain by leveraging the information from other rich domains. Existing methods of cross-domain recommendation mainly focus on overlapping scenarios by assuming users are totally or partially overlapped, which are taken as bridges to connect different domains. However, this assumption does not always hold since it is illegal to leak users’ identity information to other domains. Conducting Non-overlapping MCR (NMCR) is challenging since 1) The absence of overlapping information prevents us from directly aligning different domains, and this situation may get worse in the MCR scenario. 2) The distribution between source and target domains makes it difficult for us to learn common information across domains. To overcome the above challenges, we focus on NMCR, and devise MCRPL as our solution. To address Challenge 1, we first learn shared domain-agnostic and domain-dependent prompts, and pre-train them in the pre-training stage. To address Challenge 2, we further update the domain-dependent prompts with other parameters kept fixed to transfer the domain knowledge to the target domain. We conduct experiments on five real-world domains, and the results show the advance of our MCRPL method compared with several recent SOTA baselines. Moreover, Our source codes have been publicly released1.

跨域推荐(Cross-domain Recommendation,CR)是一项通过利用其他丰富域的信息来改进稀疏目标域推荐的任务。现有的跨域推荐方法主要关注重叠场景,假设用户完全或部分重叠,将其作为连接不同域的桥梁。然而,这一假设并不总是成立的,因为向其他域泄露用户身份信息是非法的。进行非重叠 MCR(NMCR)具有挑战性,因为 1)由于没有重叠信息,我们无法直接对不同域进行对齐,而这种情况在 MCR 场景中可能会变得更糟。2) 源域和目标域之间的分布使我们难以学习跨域的共同信息。为了克服上述挑战,我们将重点放在 NMCR 上,并设计了 MCRPL 作为我们的解决方案。针对挑战 1,我们首先学习与领域无关的和与领域相关的共享提示信息,并在预训练阶段对它们进行预训练。为了应对挑战 2,我们进一步更新了与领域相关的提示语,同时保持其他参数不变,以便将领域知识转移到目标领域。我们在五个真实世界的领域中进行了实验,结果表明,与最近的几种 SOTA 基线相比,我们的 MCRPL 方法是先进的。此外,我们的源代码已经公开发布1。
{"title":"MCRPL: A Pretrain, Prompt & Fine-tune Paradigm for Non-overlapping Many-to-one Cross-domain Recommendation","authors":"Hao Liu, Lei Guo, Lei Zhu, Yongqiang Jiang, Min Gao, Hongzhi Yin","doi":"10.1145/3641860","DOIUrl":"https://doi.org/10.1145/3641860","url":null,"abstract":"<p>Cross-domain Recommendation (CR) is the task that tends to improve the recommendations in the sparse target domain by leveraging the information from other rich domains. Existing methods of cross-domain recommendation mainly focus on overlapping scenarios by assuming users are totally or partially overlapped, which are taken as bridges to connect different domains. However, this assumption does not always hold since it is illegal to leak users’ identity information to other domains. Conducting Non-overlapping MCR (NMCR) is challenging since 1) The absence of overlapping information prevents us from directly aligning different domains, and this situation may get worse in the MCR scenario. 2) The distribution between source and target domains makes it difficult for us to learn common information across domains. To overcome the above challenges, we focus on NMCR, and devise MCRPL as our solution. To address Challenge 1, we first learn shared domain-agnostic and domain-dependent prompts, and pre-train them in the pre-training stage. To address Challenge 2, we further update the domain-dependent prompts with other parameters kept fixed to transfer the domain knowledge to the target domain. We conduct experiments on five real-world domains, and the results show the advance of our MCRPL method compared with several recent SOTA baselines. Moreover, Our source codes have been publicly released<sup>1</sup>.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139516392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting Representations of Information Needs from Digital Activity Context 从数字活动语境预测信息需求表征
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-15 DOI: 10.1145/3639819
Tung Vuong, Tuukka Ruotsalo

Information retrieval systems often consider search-session and immediately preceding web-browsing history as the context for predicting users’ present information needs. However, such context is only available when a user’s information needs originate from web context or when users have issued preceding queries in the search session. Here, we study the effect of more extensive context information recorded from users’ everyday digital activities by monitoring all information interacted with and communicated using personal computers. Twenty individuals were recruited for 14 days of 24/7 continuous monitoring of their digital activities, including screen contents, clicks, and operating system logs on Web and non-Web applications. Using this data, a transformer architecture is applied to model the digital activity context and predict representations of personalized information needs. Subsequently, the representations of information needs are used for query prediction, query auto-completion, selected search result prediction, and Web search re-ranking. The predictions of the models are evaluated against the ground truth data obtained from the activity recordings. The results reveal that the models accurately predict representations of information needs improving over the conventional search session and web-browsing contexts. The results indicate that the present practice for utilizing users’ contextual information is limited and can be significantly extended to achieve improved search interaction support and performance.

信息检索系统通常将搜索会话和紧接着的网络浏览历史作为预测用户当前信息需求的背景。然而,只有当用户的信息需求源于网络上下文或用户在搜索会话中发布了之前的查询时,这种上下文才可用。在这里,我们通过监测所有使用个人电脑进行交互和交流的信息,研究从用户日常数字活动中记录的更广泛的情境信息的效果。我们招募了 20 个人,对他们的数字活动进行了为期 14 天的全天候连续监控,包括网络和非网络应用程序的屏幕内容、点击和操作系统日志。利用这些数据,一个转换器架构被应用于建立数字活动上下文模型和预测个性化信息需求表征。随后,信息需求表征被用于查询预测、查询自动完成、选定搜索结果预测和网络搜索重新排序。根据从活动记录中获得的地面实况数据,对模型的预测结果进行了评估。结果表明,与传统的搜索会话和网络浏览环境相比,这些模型能准确预测信息需求的表征。结果表明,目前利用用户上下文信息的做法是有限的,可以大大扩展,以实现更好的搜索交互支持和性能。
{"title":"Predicting Representations of Information Needs from Digital Activity Context","authors":"Tung Vuong, Tuukka Ruotsalo","doi":"10.1145/3639819","DOIUrl":"https://doi.org/10.1145/3639819","url":null,"abstract":"<p>Information retrieval systems often consider search-session and immediately preceding web-browsing history as the context for predicting users’ present information needs. However, such context is only available when a user’s information needs originate from web context or when users have issued preceding queries in the search session. Here, we study the effect of more extensive context information recorded from users’ everyday digital activities by monitoring all information interacted with and communicated using personal computers. Twenty individuals were recruited for 14 days of 24/7 continuous monitoring of their digital activities, including screen contents, clicks, and operating system logs on Web and non-Web applications. Using this data, a transformer architecture is applied to model the digital activity context and predict representations of personalized information needs. Subsequently, the representations of information needs are used for query prediction, query auto-completion, selected search result prediction, and Web search re-ranking. The predictions of the models are evaluated against the ground truth data obtained from the activity recordings. The results reveal that the models accurately predict representations of information needs improving over the conventional search session and web-browsing contexts. The results indicate that the present practice for utilizing users’ contextual information is limited and can be significantly extended to achieve improved search interaction support and performance.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139476820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Intent-oriented Dynamic Interest Modeling for Personalized Web Search 面向意图的个性化网络搜索动态兴趣建模
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-08 DOI: 10.1145/3639817
Yutong Bai, Yujia Zhou, Zhicheng Dou, Ji-Rong Wen

Given a user, a personalized search model relies on her historical behaviors, such as issued queries and their clicked documents, to generate an interest profile and personalize search results accordingly. In interest profiling, most existing personalized search approaches use “static” document representations as the inputs, which do not change with the current search. However, a document is usually long and contains multiple pieces of information, a static fix-length document vector is usually insufficient to represent the important information related to the original query or the current query, and makes the profile noisy and ambiguous. To tackle this problem, we propose building dynamic and intent-oriented document representations which highlight important parts of a document rather than simply encode the entire text. Specifically, we divide each document into multiple passages, and then separately use the original query and the current query to interact with the passages. Thereafter we generate two “dynamic” document representations containing the key information around the historical and the current user intent, respectively. We then profile interest by capturing the interactions between these document representations, the historical queries, and the current query. Experimental results on a real-world search log dataset demonstrate that our model significantly outperforms state-of-the-art personalization methods.

给定用户后,个性化搜索模型会根据其历史行为(如已发布的查询及其点击的文档)生成兴趣档案,并据此个性化搜索结果。在兴趣分析中,大多数现有的个性化搜索方法都使用 "静态 "文档表示法作为输入,这些表示法不会随当前搜索而改变。然而,文档通常较长,且包含多种信息,固定长度的静态文档向量通常不足以表示与原始查询或当前查询相关的重要信息,从而使兴趣剖析变得嘈杂和模糊。为了解决这个问题,我们建议建立动态的、以意图为导向的文档表示法,突出文档的重要部分,而不是简单地对整个文本进行编码。具体来说,我们将每篇文档分为多个段落,然后分别使用原始查询和当前查询与段落进行交互。之后,我们生成两个 "动态 "文档表征,分别包含与历史和当前用户意图相关的关键信息。然后,我们通过捕捉这些文档表征、历史查询和当前查询之间的交互,对兴趣进行剖析。在真实世界搜索日志数据集上的实验结果表明,我们的模型明显优于最先进的个性化方法。
{"title":"Intent-oriented Dynamic Interest Modeling for Personalized Web Search","authors":"Yutong Bai, Yujia Zhou, Zhicheng Dou, Ji-Rong Wen","doi":"10.1145/3639817","DOIUrl":"https://doi.org/10.1145/3639817","url":null,"abstract":"<p>Given a user, a personalized search model relies on her historical behaviors, such as issued queries and their clicked documents, to generate an interest profile and personalize search results accordingly. In interest profiling, most existing personalized search approaches use “static” document representations as the inputs, which do not change with the current search. However, a document is usually long and contains multiple pieces of information, a static fix-length document vector is usually insufficient to represent the important information related to the original query or the current query, and makes the profile noisy and ambiguous. To tackle this problem, we propose building dynamic and intent-oriented document representations which highlight important parts of a document rather than simply encode the entire text. Specifically, we divide each document into multiple passages, and then separately use the original query and the current query to interact with the passages. Thereafter we generate two “dynamic” document representations containing the key information around the historical and the current user intent, respectively. We then profile interest by capturing the interactions between these document representations, the historical queries, and the current query. Experimental results on a real-world search log dataset demonstrate that our model significantly outperforms state-of-the-art personalization methods.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139411212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Causal Inference in Recommender Systems: A Survey and Future Directions 推荐系统中的因果推理:调查与未来方向
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2024-01-02 DOI: 10.1145/3639048
Chen Gao, Yu Zheng, Wenjie Wang, Fuli Feng, Xiangnan He, Yong Li

Recommender systems have become crucial in information filtering nowadays. Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature, or feature-behavior correlation in click-through rate prediction. However, unfortunately, the real world is driven by causality, not just correlation, and correlation does not imply causation. For instance, recommender systems might recommend a battery charger to a user after buying a phone, where the latter can serve as the cause of the former; such a causal relation cannot be reversed. Recently, to address this, researchers in recommender systems have begun utilizing causal inference to extract causality, thereby enhancing the recommender system. In this survey, we offer a comprehensive review of the literature on causal inference-based recommendation. Initially, we introduce the fundamental concepts of both recommender system and causal inference as the foundation for subsequent content. We then highlight the typical issues faced by non-causality recommender system. Following that, we thoroughly review the existing work on causal inference-based recommender systems, based on a taxonomy of three-aspect challenges that causal inference can address. Finally, we discuss the open problems in this critical research area and suggest important potential future works.

如今,推荐系统已成为信息过滤的关键。现有的推荐系统根据数据的相关性来提取用户偏好,如协同过滤中的行为相关性,点击率预测中的特征-特征或特征-行为相关性。然而,不幸的是,现实世界是由因果关系驱动的,而不仅仅是相关性,相关性并不意味着因果关系。例如,推荐系统可能会在用户购买手机后向其推荐电池充电器,而后者可能是前者的原因;这种因果关系无法逆转。最近,为了解决这个问题,推荐系统的研究人员开始利用因果推理来提取因果关系,从而增强推荐系统的功能。在本调查中,我们将对基于因果推理的推荐文献进行全面回顾。首先,我们介绍了推荐系统和因果推理的基本概念,作为后续内容的基础。然后,我们强调了非因果关系推荐系统所面临的典型问题。随后,我们根据因果推理可应对的三方面挑战的分类法,全面回顾了基于因果推理的推荐系统方面的现有工作。最后,我们讨论了这一关键研究领域的未决问题,并提出了未来可能开展的重要工作。
{"title":"Causal Inference in Recommender Systems: A Survey and Future Directions","authors":"Chen Gao, Yu Zheng, Wenjie Wang, Fuli Feng, Xiangnan He, Yong Li","doi":"10.1145/3639048","DOIUrl":"https://doi.org/10.1145/3639048","url":null,"abstract":"<p>Recommender systems have become crucial in information filtering nowadays. Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature, or feature-behavior correlation in click-through rate prediction. However, unfortunately, the real world is driven by <i>causality</i>, not just correlation, and correlation does not imply causation. For instance, recommender systems might recommend a battery charger to a user after buying a phone, where the latter can serve as the cause of the former; such a causal relation cannot be reversed. Recently, to address this, researchers in recommender systems have begun utilizing causal inference to extract causality, thereby enhancing the recommender system. In this survey, we offer a comprehensive review of the literature on causal inference-based recommendation. Initially, we introduce the fundamental concepts of both recommender system and causal inference as the foundation for subsequent content. We then highlight the typical issues faced by non-causality recommender system. Following that, we thoroughly review the existing work on causal inference-based recommender systems, based on a taxonomy of three-aspect challenges that causal inference can address. Finally, we discuss the open problems in this critical research area and suggest important potential future works.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139082213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
DiffuRec: A Diffusion Model for Sequential Recommendation DiffuRec:顺序推荐的扩散模型
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2023-12-29 DOI: 10.1145/3631116
Zihao Li, Aixin Sun, Chenliang Li

Mainstream solutions to sequential recommendation represent items with fixed vectors. These vectors have limited capability in capturing items’ latent aspects and users’ diverse preferences. As a new generative paradigm, diffusion models have achieved excellent performance in areas like computer vision and natural language processing. To our understanding, its unique merit in representation generation well fits the problem setting of sequential recommendation. In this article, we make the very first attempt to adapt the diffusion model to sequential recommendation and propose DiffuRec for item representation construction and uncertainty injection. Rather than modeling item representations as fixed vectors, we represent them as distributions in DiffuRec, which reflect a user’s multiple interests and an item’s various aspects adaptively. In the diffusion phase, DiffuRec corrupts the target item embedding into a Gaussian distribution via noise adding, which is further applied for sequential item distribution representation generation and uncertainty injection. Afterward, the item representation is fed into an approximator for target item representation reconstruction. In the reverse phase, based on a user’s historical interaction behaviors, we reverse a Gaussian noise into the target item representation, then apply a rounding operation for target item prediction. Experiments over four datasets show that DiffuRec outperforms strong baselines by a large margin.1

顺序推荐的主流解决方案是用固定向量表示项目。这些向量在捕捉项目的潜在方面和用户的不同偏好方面能力有限。作为一种新的生成范式,扩散模型在计算机视觉和自然语言处理等领域取得了优异的表现。据我们了解,它在表征生成方面的独特优点非常适合顺序推荐的问题设置。在本文中,我们首次尝试将扩散模型应用于顺序推荐,并提出了用于项目表示构建和不确定性注入的 DiffuRec。在 DiffuRec 中,我们不再将项目表示建模为固定向量,而是将其表示为分布,从而自适应地反映用户的多种兴趣和项目的各个方面。在扩散阶段,DiffuRec 通过添加噪声将目标项目嵌入破坏为高斯分布,并进一步应用于顺序项目分布表示的生成和不确定性注入。然后,将项目表示输入近似器,以重建目标项目表示。在反向阶段,根据用户的历史交互行为,我们将高斯噪声反向引入目标项目表示,然后应用舍入操作进行目标项目预测。在四个数据集上进行的实验表明,DiffuRec 的性能远远优于强基线1。
{"title":"DiffuRec: A Diffusion Model for Sequential Recommendation","authors":"Zihao Li, Aixin Sun, Chenliang Li","doi":"10.1145/3631116","DOIUrl":"https://doi.org/10.1145/3631116","url":null,"abstract":"<p>Mainstream solutions to sequential recommendation represent items with fixed vectors. These vectors have limited capability in capturing items’ latent aspects and users’ diverse preferences. As a new generative paradigm, <i>diffusion models</i> have achieved excellent performance in areas like computer vision and natural language processing. To our understanding, its unique merit in representation generation well fits the problem setting of sequential recommendation. In this article, we make the very first attempt to adapt the diffusion model to sequential recommendation and propose <span>DiffuRec</span> for item representation construction and uncertainty injection. Rather than modeling item representations as fixed vectors, we represent them as distributions in <span>DiffuRec</span>, which reflect a user’s multiple interests and an item’s various aspects adaptively. In the diffusion phase, <span>DiffuRec</span> corrupts the target item embedding into a Gaussian distribution via noise adding, which is further applied for sequential item distribution representation generation and uncertainty injection. Afterward, the item representation is fed into an approximator for target item representation reconstruction. In the reverse phase, based on a user’s historical interaction behaviors, we reverse a Gaussian noise into the target item representation, then apply a rounding operation for target item prediction. Experiments over four datasets show that <span>DiffuRec</span> outperforms strong baselines by a large margin.<sup>1</sup></p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2023-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139063803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FairGap: Fairness-aware Recommendation via Generating Counterfactual Graph FairGap:通过生成反事实图进行公平感知推荐
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2023-12-22 DOI: 10.1145/3638352
Wei Chen, Yiqing Wu, Zhao Zhang, Fuzhen Zhuang, Zhongshi He, Ruobing Xie, Feng xia
The emergence of Graph Neural Networks (GNNs) has greatly advanced the development of recommendation systems. Recently, many researchers have leveraged GNN-based models to learn fair representations for users and items. However, current GNN-based models suffer from biased user-item interaction data, which negatively impacts recommendation fairness. Although there have been several studies employed adversarial learning to mitigate this issue in recommendation systems, they mostly focus on modifying the model training approach with fairness regularization and neglect direct intervention of biased interaction. Different from these models, this paper introduces a novel perspective by directly intervening in observed interactions to generate a counterfactual graph (called FairGap) that is not influenced by sensitive node attributes, enabling us to learn fair representations for users and items easily. We design the FairGap to answer the key counterfactual question: “ Would interactions with an item remain unchanged if user’s sensitive attributes were concealed? ”. We also provide theoretical proofs to show that our learning strategy via the counterfactual graph is unbiased in expectation. Moreover, we propose a fairness-enhancing mechanism to continuously improve user fairness in the graph-based recommendation. Extensive experimental results against state-of-the-art competitors and base models on three real-world datasets validate the effectiveness of our proposed model.
图神经网络(GNN)的出现极大地推动了推荐系统的发展。最近,许多研究人员利用基于 GNN 的模型来学习用户和项目的公平表征。然而,目前基于 GNN 的模型存在用户与项目交互数据偏差的问题,这对推荐的公平性产生了负面影响。虽然已有一些研究采用对抗学习来缓解推荐系统中的这一问题,但它们大多侧重于通过公平正则化来修改模型训练方法,而忽视了对有偏差的交互的直接干预。与这些模型不同,本文引入了一个新的视角,即直接干预观察到的交互,生成一个不受敏感节点属性影响的反事实图(称为 FairGap),使我们能够轻松地学习用户和项目的公平表征。我们设计公平差距来回答关键的反事实问题:"如果用户的敏感属性被隐藏,与物品的交互会保持不变吗?".我们还提供了理论证明,表明我们通过反事实图的学习策略在预期上是无偏的。此外,我们还提出了一种公平性增强机制,以持续改善基于图的推荐中的用户公平性。在三个真实数据集上与最先进的竞争对手和基础模型进行的大量实验结果验证了我们提出的模型的有效性。
{"title":"FairGap: Fairness-aware Recommendation via Generating Counterfactual Graph","authors":"Wei Chen, Yiqing Wu, Zhao Zhang, Fuzhen Zhuang, Zhongshi He, Ruobing Xie, Feng xia","doi":"10.1145/3638352","DOIUrl":"https://doi.org/10.1145/3638352","url":null,"abstract":"The emergence of Graph Neural Networks (GNNs) has greatly advanced the development of recommendation systems. Recently, many researchers have leveraged GNN-based models to learn fair representations for users and items. However, current GNN-based models suffer from biased user-item interaction data, which negatively impacts recommendation fairness. Although there have been several studies employed adversarial learning to mitigate this issue in recommendation systems, they mostly focus on modifying the model training approach with fairness regularization and neglect direct intervention of biased interaction. Different from these models, this paper introduces a novel perspective by directly intervening in observed interactions to generate a counterfactual graph (called FairGap) that is not influenced by sensitive node attributes, enabling us to learn fair representations for users and items easily. We design the FairGap to answer the key counterfactual question: “ Would interactions with an item remain unchanged if user’s sensitive attributes were concealed? ”. We also provide theoretical proofs to show that our learning strategy via the counterfactual graph is unbiased in expectation. Moreover, we propose a fairness-enhancing mechanism to continuously improve user fairness in the graph-based recommendation. Extensive experimental results against state-of-the-art competitors and base models on three real-world datasets validate the effectiveness of our proposed model.","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2023-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138945901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Triple Sequence Learning for Cross-domain Recommendation 跨域推荐的三重序列学习
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2023-12-22 DOI: 10.1145/3638351
Haokai Ma, Ruobing Xie, Lei Meng, Xin Chen, Xu Zhang, Leyu Lin, Jie Zhou

Cross-domain recommendation (CDR) aims to leverage the correlation of users’ behaviors in both the source and target domains to improve the user preference modeling in the target domain. Conventional CDR methods typically explore the dual-relations between the source and target domains’ behaviors. However, this may ignore the informative mixed behaviors that naturally reflect the user’s global preference. To address this issue, we present a novel framework, termed triple sequence learning for cross-domain recommendation (Tri-CDR), which jointly models the source, target, and mixed behavior sequences to highlight the global and target preference and precisely model the triple correlation in CDR. Specifically, Tri-CDR independently models the hidden representations for the triple behavior sequences and proposes a triple cross-domain attention (TCA) method to emphasize the informative knowledge related to both user’s global and target-domain preference. To comprehensively explore the cross-domain correlations, we design a triple contrastive learning (TCL) strategy that simultaneously considers the coarse-grained similarities and fine-grained distinctions among the triple sequences, ensuring the alignment while preserving information diversity in multi-domain. We conduct extensive experiments and analyses on six cross-domain settings. The significant improvements of Tri-CDR with different sequential encoders verify its effectiveness and universality. The source code is avaliable in https://github.com/hulkima/Tri-CDR.

跨域推荐(CDR)旨在利用源域和目标域中用户行为的相关性来改进目标域中的用户偏好建模。传统的 CDR 方法通常会探索源域和目标域行为之间的双重关系。然而,这可能会忽略自然反映用户全局偏好的信息混合行为。为了解决这个问题,我们提出了一个新颖的框架,称为跨域推荐的三重序列学习(Tri-CDR),它可以对源域、目标域和混合行为序列进行联合建模,以突出全局和目标偏好,并对 CDR 中的三重相关性进行精确建模。具体来说,Tri-CDR 对三重行为序列的隐藏表示进行独立建模,并提出了一种三重跨域关注(TCA)方法,以强调与用户全域和目标域偏好相关的信息知识。为了全面探索跨域相关性,我们设计了一种三重对比学习(TCL)策略,该策略同时考虑了三重序列之间的粗粒度相似性和细粒度区别,在确保一致性的同时保留了多域信息的多样性。我们在六个跨域设置中进行了广泛的实验和分析。不同顺序编码器对 Tri-CDR 的明显改善验证了它的有效性和普遍性。源代码见 https://github.com/hulkima/Tri-CDR。
{"title":"Triple Sequence Learning for Cross-domain Recommendation","authors":"Haokai Ma, Ruobing Xie, Lei Meng, Xin Chen, Xu Zhang, Leyu Lin, Jie Zhou","doi":"10.1145/3638351","DOIUrl":"https://doi.org/10.1145/3638351","url":null,"abstract":"<p>Cross-domain recommendation (CDR) aims to leverage the correlation of users’ behaviors in both the source and target domains to improve the user preference modeling in the target domain. Conventional CDR methods typically explore the dual-relations between the source and target domains’ behaviors. However, this may ignore the informative mixed behaviors that naturally reflect the user’s global preference. To address this issue, we present a novel framework, termed triple sequence learning for cross-domain recommendation (Tri-CDR), which jointly models the source, target, and mixed behavior sequences to highlight the global and target preference and precisely model the triple correlation in CDR. Specifically, Tri-CDR independently models the hidden representations for the triple behavior sequences and proposes a triple cross-domain attention (TCA) method to emphasize the informative knowledge related to both user’s global and target-domain preference. To comprehensively explore the cross-domain correlations, we design a triple contrastive learning (TCL) strategy that simultaneously considers the coarse-grained similarities and fine-grained distinctions among the triple sequences, ensuring the alignment while preserving information diversity in multi-domain. We conduct extensive experiments and analyses on six cross-domain settings. The significant improvements of Tri-CDR with different sequential encoders verify its effectiveness and universality. The source code is avaliable in https://github.com/hulkima/Tri-CDR.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2023-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139020342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing DGEKT:知识追踪的双图集合学习法
IF 5.6 2区 计算机科学 Q1 Business, Management and Accounting Pub Date : 2023-12-22 DOI: 10.1145/3638350
Chaoran Cui, Yumo Yao, Chunyun Zhang, Hebo Ma, Yuling Ma, Zhaochun Ren, Chen Zhang, James Ko

Knowledge tracing aims to trace students’ evolving knowledge states by predicting their future performance on concept-related exercises. Recently, some graph-based models have been developed to incorporate the relationships between exercises to improve knowledge tracing, but only a single type of relationship information is generally explored. In this paper, we present a novel Dual Graph Ensemble learning method for Knowledge Tracing (DGEKT), which establishes a dual graph structure of students’ learning interactions to capture the heterogeneous exercise-concept associations and interaction transitions by hypergraph modeling and directed graph modeling, respectively. To combine the dual graph models, we introduce the technique of online knowledge distillation. This choice arises from the observation that, while the knowledge tracing model is designed to predict students’ responses to the exercises related to different concepts, it is optimized merely with respect to the prediction accuracy on a single exercise at each step. With online knowledge distillation, the dual graph models are adaptively combined to form a stronger ensemble teacher model, which provides its predictions on all exercises as extra supervision for better modeling ability. In the experiments, we compare DGEKT against eight knowledge tracing baselines on three benchmark datasets, and the results demonstrate that DGEKT achieves state-of-the-art performance.

知识追踪的目的是通过预测学生未来在与概念相关的练习中的表现来追踪他们不断变化的知识状态。最近,一些基于图的模型被开发出来,以结合练习之间的关系来改进知识追踪,但一般只探讨单一类型的关系信息。本文提出了一种新颖的知识追踪双图集合学习方法(DGEKT),通过超图建模和有向图建模,分别建立学生学习互动的双图结构,以捕捉异质的练习-概念关联和互动转换。为了结合双图模型,我们引入了在线知识提炼技术。我们之所以选择这种方法,是因为我们发现,虽然知识追踪模型旨在预测学生对不同概念相关练习的反应,但它仅仅是针对每一步单个练习的预测准确性进行了优化。通过在线知识提炼,双图模型被自适应地组合在一起,形成一个更强的集合教师模型,它对所有练习的预测作为额外的监督,以获得更好的建模能力。在实验中,我们将 DGEKT 与三个基准数据集上的八个知识追踪基线进行了比较,结果表明 DGEKT 达到了最先进的性能。
{"title":"DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing","authors":"Chaoran Cui, Yumo Yao, Chunyun Zhang, Hebo Ma, Yuling Ma, Zhaochun Ren, Chen Zhang, James Ko","doi":"10.1145/3638350","DOIUrl":"https://doi.org/10.1145/3638350","url":null,"abstract":"<p>Knowledge tracing aims to trace students’ evolving knowledge states by predicting their future performance on concept-related exercises. Recently, some graph-based models have been developed to incorporate the relationships between exercises to improve knowledge tracing, but only a single type of relationship information is generally explored. In this paper, we present a novel Dual Graph Ensemble learning method for Knowledge Tracing (DGEKT), which establishes a dual graph structure of students’ learning interactions to capture the heterogeneous exercise-concept associations and interaction transitions by hypergraph modeling and directed graph modeling, respectively. To combine the dual graph models, we introduce the technique of online knowledge distillation. This choice arises from the observation that, while the knowledge tracing model is designed to predict students’ responses to the exercises related to different concepts, it is optimized merely with respect to the prediction accuracy on a single exercise at each step. With online knowledge distillation, the dual graph models are adaptively combined to form a stronger ensemble teacher model, which provides its predictions on all exercises as extra supervision for better modeling ability. In the experiments, we compare DGEKT against eight knowledge tracing baselines on three benchmark datasets, and the results demonstrate that DGEKT achieves state-of-the-art performance.</p>","PeriodicalId":50936,"journal":{"name":"ACM Transactions on Information Systems","volume":null,"pages":null},"PeriodicalIF":5.6,"publicationDate":"2023-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139020371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
ACM Transactions on Information Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1