Pub Date : 2024-08-24DOI: 10.1007/s11257-024-09410-4
Matej Bevec, Marko Tkalčič, Matevž Pesek
Modern music streaming services rely on recommender systems to help users navigate within their large collections. Collaborative filtering (CF) methods, that leverage past user–item interactions, have been most successful, but have various limitations, like performing poorly among sparsely connected items. Conversely, content-based models circumvent the data-sparsity issue by recommending based on item content alone, but have seen limited success. Recently, graph-based machine learning approaches have shown, in other domains, to be able to address the aforementioned issues. Graph neural networks (GNN) in particular promise to learn from both the complex relationships within a user interaction graph, as well as content to generate hybrid recommendations. Here, we propose a music recommender system using a state-of-the-art GNN, PinSage, and evaluate it on a novel Spotify dataset against traditional CF, graph-based CF and content-based methods on a related song prediction task, venturing beyond accuracy in our evaluation. Our experiments show that (i) our approach is among the top performers and stands out as the most well rounded compared to baselines, (ii) graph-based CF methods outperform matrix-based CF approaches, suggesting that user interaction data may be better represented as a graph and (iii) in our evaluation, CF methods do not exhibit a performance drop in the long tail, where the hybrid approach does not offer an advantage.
{"title":"Hybrid music recommendation with graph neural networks","authors":"Matej Bevec, Marko Tkalčič, Matevž Pesek","doi":"10.1007/s11257-024-09410-4","DOIUrl":"https://doi.org/10.1007/s11257-024-09410-4","url":null,"abstract":"<p>Modern music streaming services rely on recommender systems to help users navigate within their large collections. Collaborative filtering (CF) methods, that leverage past user–item interactions, have been most successful, but have various limitations, like performing poorly among sparsely connected items. Conversely, content-based models circumvent the data-sparsity issue by recommending based on item content alone, but have seen limited success. Recently, graph-based machine learning approaches have shown, in other domains, to be able to address the aforementioned issues. Graph neural networks (GNN) in particular promise to learn from both the complex relationships within a user interaction graph, as well as content to generate hybrid recommendations. Here, we propose a music recommender system using a state-of-the-art GNN, PinSage, and evaluate it on a novel Spotify dataset against traditional CF, graph-based CF and content-based methods on a related song prediction task, venturing beyond accuracy in our evaluation. Our experiments show that (i) our approach is among the top performers and stands out as the most well rounded compared to baselines, (ii) graph-based CF methods outperform matrix-based CF approaches, suggesting that user interaction data may be better represented as a graph and (iii) in our evaluation, CF methods do not exhibit a performance drop in the long tail, where the hybrid approach does not offer an advantage.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"5 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142215718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-12DOI: 10.1007/s11257-024-09414-0
Angela Carrera-Rivera, Felix Larrinaga, Ganix Lasa, Giovanna Martinez-Arellano, Gorka Unamuno
Smart Product–Service Systems (S-PSS) represent an innovative business model that integrates intelligent products with advanced digital capabilities and corresponding e-services. The user experience (UX) within an S-PSS is heavily influenced by the customization of services and customer empowerment. However, conventional UX analysis primarily focuses on the design stage and may not adequately respond to the evolving user needs during the usage stage and how to exploit the data surrounding the use of S-PSS. To overcome these limitations, this article introduces a practical framework for developing Adaptive User Interfaces within S-PSS. This framework integrates ontologies and Context-aware recommendation systems, with user interactions serving as the primary data source, facilitating the development of adaptive user interfaces. One of the main contributions of this work lies on the integration of various components to achieve the creation of Adaptive User Interfaces for digital services. A case study of a smart device app is presented, to demonstrate the practical implementation of the framework, with a hands-on development approach, considering technological aspects and utilizing appropriate tools. The results of the evaluation of the recommendation engine show that using a context-aware approach improves the precision of recommendations. Furthermore, pragmatic aspects of UX, such as usefulness and system efficiency, are evaluated with participants with an overall positive impact on the use of the smart device.
{"title":"AdaptUI: A Framework for the development of Adaptive User Interfaces in Smart Product-Service Systems","authors":"Angela Carrera-Rivera, Felix Larrinaga, Ganix Lasa, Giovanna Martinez-Arellano, Gorka Unamuno","doi":"10.1007/s11257-024-09414-0","DOIUrl":"https://doi.org/10.1007/s11257-024-09414-0","url":null,"abstract":"<p>Smart Product–Service Systems (S-PSS) represent an innovative business model that integrates intelligent products with advanced digital capabilities and corresponding e-services. The user experience (UX) within an S-PSS is heavily influenced by the customization of services and customer empowerment. However, conventional UX analysis primarily focuses on the design stage and may not adequately respond to the evolving user needs during the usage stage and how to exploit the data surrounding the use of S-PSS. To overcome these limitations, this article introduces a practical framework for developing Adaptive User Interfaces within S-PSS. This framework integrates ontologies and Context-aware recommendation systems, with user interactions serving as the primary data source, facilitating the development of adaptive user interfaces. One of the main contributions of this work lies on the integration of various components to achieve the creation of Adaptive User Interfaces for digital services. A case study of a smart device app is presented, to demonstrate the practical implementation of the framework, with a hands-on development approach, considering technological aspects and utilizing appropriate tools. The results of the evaluation of the recommendation engine show that using a context-aware approach improves the precision of recommendations. Furthermore, pragmatic aspects of UX, such as usefulness and system efficiency, are evaluated with participants with an overall positive impact on the use of the smart device.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"85 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141932845","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-07DOI: 10.1007/s11257-024-09412-2
Alain D. Starke, Vegard R. Solberg, Sebastian Øverhaug, Christoph Trattner
Online news article recommendations are typically of the ‘more like this’ type, generated by similarity functions. Across three studies, we examined the representativeness of different similarity functions for news item retrieval, by comparing them to human judgments of similarity. In Study 1 ((N=401)), participants assessed the overall similarity of ten randomly paired news articles on politics and compared their judgments to different feature-specific similarity functions (e.g., based on body text or images). In Study 2, we checked for domain differences in a mixed-methods survey ((N=45)), surfacing evidence that the effectiveness of similarity functions differs across different news categories (‘Recent Events’, ‘Sport’). In Study 3 ((N=173)), we improved the design of Study 1, by controlling for how news articles were matched, differentiating between dissimilar news articles and articles that were matched on a shared topic, named entities, and/or date of publication, across ‘Recent Events’ and ‘Sport’ categories. Across all studies, we found that users mostly used text-based features (e.g., body text, title) for their similarity judgments, while BodyText:TF-IDF was found to be the most representative for their judgments. Moreover, the strength of similarity judgments by humans and similarity scores by feature-specific functions was strongly affected by how news article pairs were matched. We show that humans and similarity functions are better aligned when two news articles are more alike, such as in a news recommendation scenario.
{"title":"Examining the merits of feature-specific similarity functions in the news domain using human judgments","authors":"Alain D. Starke, Vegard R. Solberg, Sebastian Øverhaug, Christoph Trattner","doi":"10.1007/s11257-024-09412-2","DOIUrl":"https://doi.org/10.1007/s11257-024-09412-2","url":null,"abstract":"<p>Online news article recommendations are typically of the ‘more like this’ type, generated by similarity functions. Across three studies, we examined the representativeness of different similarity functions for news item retrieval, by comparing them to human judgments of similarity. In Study 1 (<span>(N=401)</span>), participants assessed the overall similarity of ten randomly paired news articles on politics and compared their judgments to different feature-specific similarity functions (e.g., based on body text or images). In Study 2, we checked for domain differences in a mixed-methods survey (<span>(N=45)</span>), surfacing evidence that the effectiveness of similarity functions differs across different news categories (‘Recent Events’, ‘Sport’). In Study 3 (<span>(N=173)</span>), we improved the design of Study 1, by controlling for how news articles were matched, differentiating between dissimilar news articles and articles that were matched on a shared topic, named entities, and/or date of publication, across ‘Recent Events’ and ‘Sport’ categories. Across all studies, we found that users mostly used text-based features (e.g., body text, title) for their similarity judgments, while BodyText:TF-IDF was found to be the most representative for their judgments. Moreover, the strength of similarity judgments by humans and similarity scores by feature-specific functions was strongly affected by how news article pairs were matched. We show that humans and similarity functions are better aligned when two news articles are more alike, such as in a news recommendation scenario.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"3 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141932901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-31DOI: 10.1007/s11257-024-09409-x
Ali Azizi, Saeedeh Momtazi
In recent years, research on transformer-based recommender systems has attracted a lot of attention. Our work examines how BERT, a transformer-based contextual language model, can be applied to build a session-based news recommender system. The session-based approach aims to recommend news by creating profiles for users and items and recommending items accordingly to maximize session length. The proposed model, called SNRBERT (Session-Based News Recommender using BERT), is fine-tuned to estimate the relationship between each user and item in a given session based on the interactions between the user and the item during that session. We introduce this method to address the challenges of session-based news recommendation, particularly in maximizing session length and capturing user–item relationships effectively. Given the limited information available about user preferences in session-based scenarios, the model estimates a score based on the amount of time users spend on each item in each session. The news recommendation is then performed based on this score. On top of BERT, we employed an Bi-LSTM network in order to capture more accurate information regarding the order in which users interact with items during a given session. We compare our results with the state-of-the-art models by using commonly known metrics: MRR, HR, and NDCG on the Adressa dataset, one of the most comprehensive datasets publicly available. Our results show that our SNRBERT model achieves HR@10 of 0.688, MRR@10 of 0.315, and nDCG@10 of 0.338. These results demonstrate that SNRBERT outperforms state-of-the-art models in terms of MRR@10 and HR@10 metrics, showcasing its effectiveness in addressing the challenges of session-based news recommendation.
{"title":"SNRBERT: session-based news recommender using BERT","authors":"Ali Azizi, Saeedeh Momtazi","doi":"10.1007/s11257-024-09409-x","DOIUrl":"https://doi.org/10.1007/s11257-024-09409-x","url":null,"abstract":"<p>In recent years, research on transformer-based recommender systems has attracted a lot of attention. Our work examines how BERT, a transformer-based contextual language model, can be applied to build a session-based news recommender system. The session-based approach aims to recommend news by creating profiles for users and items and recommending items accordingly to maximize session length. The proposed model, called SNRBERT (Session-Based News Recommender using BERT), is fine-tuned to estimate the relationship between each user and item in a given session based on the interactions between the user and the item during that session. We introduce this method to address the challenges of session-based news recommendation, particularly in maximizing session length and capturing user–item relationships effectively. Given the limited information available about user preferences in session-based scenarios, the model estimates a score based on the amount of time users spend on each item in each session. The news recommendation is then performed based on this score. On top of BERT, we employed an Bi-LSTM network in order to capture more accurate information regarding the order in which users interact with items during a given session. We compare our results with the state-of-the-art models by using commonly known metrics: MRR, HR, and NDCG on the Adressa dataset, one of the most comprehensive datasets publicly available. Our results show that our SNRBERT model achieves HR@10 of 0.688, MRR@10 of 0.315, and nDCG@10 of 0.338. These results demonstrate that SNRBERT outperforms state-of-the-art models in terms of MRR@10 and HR@10 metrics, showcasing its effectiveness in addressing the challenges of session-based news recommendation.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"45 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141862679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-28DOI: 10.1007/s11257-024-09413-1
Keshopan Arunthavachelvan, Shaina Raza, Chen Ding
With the prominence of online social networks, news has become more accessible to a global audience. However, in the meantime, it has become increasingly difficult for individuals to differentiate between real and fake news. To reduce the spread of fake news, researchers have developed different classification models to identify fake news. In this paper, we propose a fake news detection system using a multilayer perceptron (MLP) model, which leverages linguistic and psychological features to determine the truthfulness of a news article. The model uses different features from the article’s text content to detect fake news. In the experiment, we utilize a public dataset from the FakeNewsNet repository consisting of real and fake news articles collected from PolitiFact and BuzzFeed. We perform a meta-analysis to compare our model’s performance with existing classification models using the same feature sets and evaluate the performance using the metrics such as prediction accuracy and F1 score. Overall, our classification model produces better results than existing baseline models, by achieving an accuracy and F1 score above 90 % and performs 3% better than the best performing baseline method. The inclusion of linguistic and psychological features with a deep neural network allows our model to consistently and accurately classify fake news with ever-changing forms of news events.
随着在线社交网络的兴起,全球受众更容易获取新闻。然而,与此同时,个人越来越难以区分真假新闻。为了减少假新闻的传播,研究人员开发了不同的分类模型来识别假新闻。在本文中,我们提出了一种使用多层感知器(MLP)模型的假新闻检测系统,该模型利用语言和心理特征来判断新闻文章的真实性。该模型利用文章文本内容的不同特征来检测假新闻。在实验中,我们使用了来自 FakeNewsNet 数据库的公共数据集,该数据集由 PolitiFact 和 BuzzFeed 收集的真实和虚假新闻文章组成。我们进行了荟萃分析,比较了我们的模型与使用相同特征集的现有分类模型的性能,并使用预测准确率和 F1 分数等指标对性能进行了评估。总体而言,我们的分类模型比现有的基线模型取得了更好的结果,准确率和 F1 分数都超过了 90%,比表现最好的基线方法高出 3%。将语言和心理特征与深度神经网络相结合,使我们的模型能够持续、准确地对形式不断变化的新闻事件中的假新闻进行分类。
{"title":"A deep neural network approach for fake news detection using linguistic and psychological features","authors":"Keshopan Arunthavachelvan, Shaina Raza, Chen Ding","doi":"10.1007/s11257-024-09413-1","DOIUrl":"https://doi.org/10.1007/s11257-024-09413-1","url":null,"abstract":"<p>With the prominence of online social networks, news has become more accessible to a global audience. However, in the meantime, it has become increasingly difficult for individuals to differentiate between real and fake news. To reduce the spread of fake news, researchers have developed different classification models to identify fake news. In this paper, we propose a fake news detection system using a multilayer perceptron (MLP) model, which leverages linguistic and psychological features to determine the truthfulness of a news article. The model uses different features from the article’s text content to detect fake news. In the experiment, we utilize a public dataset from the FakeNewsNet repository consisting of real and fake news articles collected from PolitiFact and BuzzFeed. We perform a meta-analysis to compare our model’s performance with existing classification models using the same feature sets and evaluate the performance using the metrics such as prediction accuracy and <i>F</i>1 score. Overall, our classification model produces better results than existing baseline models, by achieving an accuracy and <i>F</i>1 score above 90 % and performs 3% better than the best performing baseline method. The inclusion of linguistic and psychological features with a deep neural network allows our model to consistently and accurately classify fake news with ever-changing forms of news events.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"32 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141771024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-04DOI: 10.1007/s11257-024-09407-z
Ine Coppens, Toon De Pessemier, Luc Martens
Physical inactivity is a public health issue. Mobile health interventions to promote physical activity often still experience dropout, resulting in people not adhering to the interventions. This paper aims to further improve mobile health apps with innovatively applied techniques from recommender system algorithms to increase personalization for physical activities and practical tips to reduce sedentary behavior. Personalization in our mobile health recommender is achieved with a seven-step algorithm: filtering on user profile (1), current weather and daylight (2), pre-filtering with a micro-profile on current mood and motivation (3), content-based recommendations using our own two datasets extended with 24 attributes (4), post-filtering on estimated current situation (5), adapting and gradually increasing duration and intensity (6), and generating just-in-time adaptive interventions (7). To analyze the effectiveness of steps 3, 4, and 5, a double-blind randomized controlled trial is conducted in which only the experimental group receives the three additional personalization steps, while the control group replaces these steps with a random selection. As such, the control group’s recommendations are still partly personalized with the other steps. Participants install the app on their Android smartphone and use the app for eight weeks, with a pretest and posttest questionnaire, and a follow-up after six months. The experimental group assigned significantly higher star ratings to the recommendations, and significantly higher momentary motivation for physical activities, tips, and manual user refreshes, compared to the control group. Additionally, there was less dropout and a significantly stronger increase in duration and intensity of the performed physical activities in the experimental group. Because the experimental group received the three additional personalization steps with micro-profiling, content-based recommender, and post-filtering on estimated situation, our results suggest that these three steps resulted in more personalized recommendations that motivate users more. Future research should aim to further improve personalization to increase the effectiveness of mobile health interventions and effectively motivate people to move more.
{"title":"Exploring the added effect of three recommender system techniques in mobile health interventions for physical activity: a longitudinal randomized controlled trial","authors":"Ine Coppens, Toon De Pessemier, Luc Martens","doi":"10.1007/s11257-024-09407-z","DOIUrl":"https://doi.org/10.1007/s11257-024-09407-z","url":null,"abstract":"<p>Physical inactivity is a public health issue. Mobile health interventions to promote physical activity often still experience dropout, resulting in people not adhering to the interventions. This paper aims to further improve mobile health apps with innovatively applied techniques from recommender system algorithms to increase personalization for physical activities and practical tips to reduce sedentary behavior. Personalization in our mobile health recommender is achieved with a seven-step algorithm: filtering on user profile (1), current weather and daylight (2), pre-filtering with a micro-profile on current mood and motivation (3), content-based recommendations using our own two datasets extended with 24 attributes (4), post-filtering on estimated current situation (5), adapting and gradually increasing duration and intensity (6), and generating just-in-time adaptive interventions (7). To analyze the effectiveness of steps 3, 4, and 5, a double-blind randomized controlled trial is conducted in which only the experimental group receives the three additional personalization steps, while the control group replaces these steps with a random selection. As such, the control group’s recommendations are still partly personalized with the other steps. Participants install the app on their Android smartphone and use the app for eight weeks, with a pretest and posttest questionnaire, and a follow-up after six months. The experimental group assigned significantly higher star ratings to the recommendations, and significantly higher momentary motivation for physical activities, tips, and manual user refreshes, compared to the control group. Additionally, there was less dropout and a significantly stronger increase in duration and intensity of the performed physical activities in the experimental group. Because the experimental group received the three additional personalization steps with micro-profiling, content-based recommender, and post-filtering on estimated situation, our results suggest that these three steps resulted in more personalized recommendations that motivate users more. Future research should aim to further improve personalization to increase the effectiveness of mobile health interventions and effectively motivate people to move more.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"32 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-01DOI: 10.1007/s11257-024-09406-0
Anastasiia Klimashevskaia, Dietmar Jannach, Mehdi Elahi, Christoph Trattner
Recommender systems help people find relevant content in a personalized way. One main promise of such systems is that they are able to increase the visibility of items in the long tail, i.e., the lesser-known items in a catalogue. Existing research, however, suggests that in many situations today’s recommendation algorithms instead exhibit a popularity bias, meaning that they often focus on rather popular items in their recommendations. Such a bias may not only lead to the limited value of the recommendations for consumers and providers in the short run, but it may also cause undesired reinforcement effects over time. In this paper, we discuss the potential reasons for popularity bias and review existing approaches to detect, quantify and mitigate popularity bias in recommender systems. Our survey, therefore, includes both an overview of the computational metrics used in the literature as well as a review of the main technical approaches to reduce the bias. Furthermore, we critically discuss today’s literature, where we observe that the research is almost entirely based on computational experiments and on certain assumptions regarding the practical effects of including long-tail items in the recommendations.
{"title":"A survey on popularity bias in recommender systems","authors":"Anastasiia Klimashevskaia, Dietmar Jannach, Mehdi Elahi, Christoph Trattner","doi":"10.1007/s11257-024-09406-0","DOIUrl":"https://doi.org/10.1007/s11257-024-09406-0","url":null,"abstract":"<p>Recommender systems help people find relevant content in a personalized way. One main promise of such systems is that they are able to increase the visibility of items in the <i>long tail</i>, i.e., the lesser-known items in a catalogue. Existing research, however, suggests that in many situations today’s recommendation algorithms instead exhibit a <i>popularity bias</i>, meaning that they often focus on rather popular items in their recommendations. Such a bias may not only lead to the limited value of the recommendations for consumers and providers in the short run, but it may also cause undesired reinforcement effects over time. In this paper, we discuss the potential reasons for popularity bias and review existing approaches to detect, quantify and mitigate popularity bias in recommender systems. Our survey, therefore, includes both an overview of the computational metrics used in the literature as well as a review of the main technical approaches to reduce the bias. Furthermore, we critically discuss today’s literature, where we observe that the research is almost entirely based on computational experiments and on certain assumptions regarding the practical effects of including long-tail items in the recommendations.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"127 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141516351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-01DOI: 10.1007/s11257-024-09404-2
Mark Abdelshiheed, Robert Moulder, John Wesley Hostetter, Tiffany Barnes, Min Chi
Factual knowledge and procedural knowledge are knowing ‘That’ and ‘How,’ respectively, whereas conditional knowledge is the metacognitive knowledge of ‘When’ and ‘Why.’ As prior work has found that students with conditional knowledge spontaneously transferred such knowledge across intelligent tutoring systems, this work assesses the impact of metacognitive interventions on the knowledge transfer of factual and procedural students. Specifically, we used a between-subject, pre-/posttest design with factual and procedural students, each randomly assigned to either the example, nudge, practice, or control condition. The interventions taught how and when to use a backward-chaining (BC) strategy on a logic tutor that supports a default forward-chaining strategy. Meanwhile, conditional students received no interventions. Six weeks later, we trained all students on a probability tutor that only supports BC without interventions. Our results suggest that nudges for factual students and practice for their procedural peers are the key factors for catching up with conditional students on both tutors and for facilitating knowledge transfer from the logic to probability tutor. We discuss two potential complementary theories for our findings: a choice-based theory (from interventions to knowledge) and a metacognitive load-based theory (from knowledge to interventions). The choice-based theory maps the amount of choice in the interventions to knowledge types, while the metacognitive load-based theory associates knowledge types with the metacognitive load each intervention offers. Implications for practice are discussed.
{"title":"Example, nudge, or practice? Assessing metacognitive knowledge transfer of factual and procedural learners","authors":"Mark Abdelshiheed, Robert Moulder, John Wesley Hostetter, Tiffany Barnes, Min Chi","doi":"10.1007/s11257-024-09404-2","DOIUrl":"https://doi.org/10.1007/s11257-024-09404-2","url":null,"abstract":"<p>Factual knowledge and procedural knowledge are knowing ‘That’ and ‘How,’ respectively, whereas conditional knowledge is the metacognitive knowledge of ‘When’ and ‘Why.’ As prior work has found that students with conditional knowledge spontaneously transferred such knowledge across intelligent tutoring systems, this work assesses the impact of metacognitive interventions on the knowledge transfer of factual and procedural students. Specifically, we used a between-subject, pre-/posttest design with factual and procedural students, each randomly assigned to either the <i>example</i>, <i>nudge</i>, <i>practice</i>, or <i>control</i> condition. The interventions taught <i>how</i> and <i>when</i> to use a backward-chaining (BC) strategy on a logic tutor that supports a default forward-chaining strategy. Meanwhile, conditional students received no interventions. Six weeks later, we trained all students on a probability tutor that only supports BC without interventions. Our results suggest that nudges for factual students and practice for their procedural peers are the key factors for catching up with conditional students on both tutors and for facilitating knowledge transfer from the logic to probability tutor. We discuss two potential complementary theories for our findings: a choice-based theory (from interventions to knowledge) and a metacognitive load-based theory (from knowledge to interventions). The choice-based theory maps the amount of choice in the interventions to knowledge types, while the metacognitive load-based theory associates knowledge types with the metacognitive load each intervention offers. Implications for practice are discussed.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"55 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-25DOI: 10.1007/s11257-024-09405-1
Zhixin Pu, Michael A. Beam
Cold start and data sparsity are problems hindering the function of news recommender systems. Optimally serving first-time users through relevant news article recommendations is an application of these problems that have attracted scholars’ attention. Users’ goal commitment might be another solution that raise efficiency of information searching while it is understudied in previous research. Drawing from the results of 669 Amazon MTurk workers’ questionnaires, this experimental study explored solutions. We manipulated the relevance of news recommendations (high relevance vs. low relevance) and information behavior within a news portal, either scanning (via a list of news articles) or seeking (via a search query). We also measured an individual difference variable, goal commitment. Results indicated that higher relevance of recommendations and higher goal commitment lead to lower information overload, higher user satisfaction, and lower information anxiety. We also found interaction effects of goal commitment and content relevance on article selection, such that users will be likely to select more irrelevant articles in the low relevance condition rather than the high relevance condition even though they have a goal commitment and perceive higher information overload and information anxiety indirectly via selecting more irrelevant articles. Furthermore, people with high goal commitment were less anxious when they read fewer irrelevant articles in the news recommender systems. The study addressed the importance of considering the user-recommender interaction and the potential merits of considering users goal commitment in the news recommender system design. The research indicates integrating personal traits into state-of-the-art news recommender systems has the potential to significantly improve user experience. While this research suggests personal traits can mitigate the limitations of imperfect recommender systems, users can also curate or train these systems based on their goals to further enhance efficiency.
{"title":"The impacts of relevance of recommendations and goal commitment on user experience in news recommender design","authors":"Zhixin Pu, Michael A. Beam","doi":"10.1007/s11257-024-09405-1","DOIUrl":"https://doi.org/10.1007/s11257-024-09405-1","url":null,"abstract":"<p>Cold start and data sparsity are problems hindering the function of news recommender systems. Optimally serving first-time users through relevant news article recommendations is an application of these problems that have attracted scholars’ attention. Users’ goal commitment might be another solution that raise efficiency of information searching while it is understudied in previous research. Drawing from the results of 669 Amazon MTurk workers’ questionnaires, this experimental study explored solutions. We manipulated the relevance of news recommendations (high relevance vs. low relevance) and information behavior within a news portal, either scanning (via a list of news articles) or seeking (via a search query). We also measured an individual difference variable, goal commitment. Results indicated that higher relevance of recommendations and higher goal commitment lead to lower information overload, higher user satisfaction, and lower information anxiety. We also found interaction effects of goal commitment and content relevance on article selection, such that users will be likely to select more irrelevant articles in the low relevance condition rather than the high relevance condition even though they have a goal commitment and perceive higher information overload and information anxiety indirectly via selecting more irrelevant articles. Furthermore, people with high goal commitment were less anxious when they read fewer irrelevant articles in the news recommender systems. The study addressed the importance of considering the user-recommender interaction and the potential merits of considering users goal commitment in the news recommender system design. The research indicates integrating personal traits into state-of-the-art news recommender systems has the potential to significantly improve user experience. While this research suggests personal traits can mitigate the limitations of imperfect recommender systems, users can also curate or train these systems based on their goals to further enhance efficiency.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"94 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-24DOI: 10.1007/s11257-024-09402-4
Mohammad Mustaneer Rahman, Robert Ollington, Soonja Yeom, Nadia Ollington
Learning can generally be categorised into three domains, which include cognitive (thinking), affective (emotions or feeling) and psychomotor (physical or kinesthetic). In the learner model, acknowledging the affective aspects of learning is important for a range of learner outcomes, including motivation, persistence, and engagement. Learners’ affective states can be detected using physical (e.g. cameras) and physiological sensors (e.g., EEG) in online learning. Although these detectors demonstrate high accuracy, they raise privacy concerns for learners and present challenges in deploying them on a large scale to larger groups of students or in classroom settings. Consequently, researchers have designed an alternative method that can recognise students’ affective states at any point during online learning from their interaction with a computer-based learning platform (i.e. intelligent tutoring systems) without using any sensors. Existing sensor-free affect detectors however, are less accurate and not directly generalisable to other domains and systems. This research focuses on developing generalisable sensor-free affect detectors to identify students’ frustration during online learning using machine learning classifiers. The detectors were built by identifying minimal optimal features associated with frustration from the high-dimensional feature space through a series of experiments on a real-world students’ affective dataset, which are generalisable across various learning platforms and domains. To evaluate their accuracy and generalisability, the detectors’ performance was validated on two independent datasets collected from different educational institutions. The experimental results show that cost-sensitive Bayesian classifiers can achieve higher affect detection accuracies with a small number of generalisable features compared to other classifiers.
{"title":"Generalisable sensor-free frustration detection in online learning environments using machine learning","authors":"Mohammad Mustaneer Rahman, Robert Ollington, Soonja Yeom, Nadia Ollington","doi":"10.1007/s11257-024-09402-4","DOIUrl":"https://doi.org/10.1007/s11257-024-09402-4","url":null,"abstract":"<p>Learning can generally be categorised into three domains, which include cognitive (thinking), affective (emotions or feeling) and psychomotor (physical or kinesthetic). In the learner model, acknowledging the affective aspects of learning is important for a range of learner outcomes, including motivation, persistence, and engagement. Learners’ affective states can be detected using physical (e.g. cameras) and physiological sensors (e.g., EEG) in online learning. Although these detectors demonstrate high accuracy, they raise privacy concerns for learners and present challenges in deploying them on a large scale to larger groups of students or in classroom settings. Consequently, researchers have designed an alternative method that can recognise students’ affective states at any point during online learning from their interaction with a computer-based learning platform (i.e. intelligent tutoring systems) without using any sensors. Existing sensor-free affect detectors however, are less accurate and not directly generalisable to other domains and systems. This research focuses on developing generalisable sensor-free affect detectors to identify students’ frustration during online learning using machine learning classifiers. The detectors were built by identifying minimal optimal features associated with frustration from the high-dimensional feature space through a series of experiments on a real-world students’ affective dataset, which are generalisable across various learning platforms and domains. To evaluate their accuracy and generalisability, the detectors’ performance was validated on two independent datasets collected from different educational institutions. The experimental results show that cost-sensitive Bayesian classifiers can achieve higher affect detection accuracies with a small number of generalisable features compared to other classifiers.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"28 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}