In recent years, recommender systems have emerged as a key component for personalization in health applications. Central in the development of recommender systems is rating-based preference elicitation, based both on single-criterion and multi-criteria rating. Though its use has already been studied in various domains of recommender systems, far too little attention has been paid to preference elicitation in health recommender systems~(HRS). The purpose of this paper is to develop a better understanding of this preference elicitation by studying the criteria that users consider when they rate a health promotion recommendation from HRS, and accordingly, to offer a design solution as a functional feedback model for mobile health applications. This paper investigates the user-perceived importance of various criteria, as well as latent factors for eliciting user feedback on the recommendations. It also reports the relationship of explanation and trust to the overall rating. By aggregating a list of all possible criteria, we further discover that not all criteria are equally important to users, and that the effectiveness of a recommendation plays a dominant role.
{"title":"Rating-based Preference Elicitation for Recommendation of Stress Intervention","authors":"Helma Torkamaan, J. Ziegler","doi":"10.1145/3320435.3324990","DOIUrl":"https://doi.org/10.1145/3320435.3324990","url":null,"abstract":"In recent years, recommender systems have emerged as a key component for personalization in health applications. Central in the development of recommender systems is rating-based preference elicitation, based both on single-criterion and multi-criteria rating. Though its use has already been studied in various domains of recommender systems, far too little attention has been paid to preference elicitation in health recommender systems~(HRS). The purpose of this paper is to develop a better understanding of this preference elicitation by studying the criteria that users consider when they rate a health promotion recommendation from HRS, and accordingly, to offer a design solution as a functional feedback model for mobile health applications. This paper investigates the user-perceived importance of various criteria, as well as latent factors for eliciting user feedback on the recommendations. It also reports the relationship of explanation and trust to the overall rating. By aggregating a list of all possible criteria, we further discover that not all criteria are equally important to users, and that the effectiveness of a recommendation plays a dominant role.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122080922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pinar Barlas, S. Kleanthous, K. Kyriakou, Jahna Otterbacher
Image analysis algorithms have been a boon to personalization in digital systems and are now widely available via easy-to-use APIs. However, it is important to ensure that they behave fairly in applications that involve processing images of people, such as dating apps. We conduct an experiment to shed light on the factors influencing the perception of "fairness." Participants are shown a photo along with two descriptions (human- and algorithm-generated). They are then asked to indicate which is "more fair" in the context of a dating site, and explain their reasoning. We vary a number of factors, including the gender, race and attractiveness of the person in the photo. While participants generally found human-generated tags to be more fair, API tags were judged as being more fair in one setting - where the image depicted an "attractive," white individual. In their explanations, participants often mention accuracy, as well as the objectivity/subjectivity of the tags in the description. We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm.
{"title":"What Makes an Image Tagger Fair?","authors":"Pinar Barlas, S. Kleanthous, K. Kyriakou, Jahna Otterbacher","doi":"10.1145/3320435.3320442","DOIUrl":"https://doi.org/10.1145/3320435.3320442","url":null,"abstract":"Image analysis algorithms have been a boon to personalization in digital systems and are now widely available via easy-to-use APIs. However, it is important to ensure that they behave fairly in applications that involve processing images of people, such as dating apps. We conduct an experiment to shed light on the factors influencing the perception of \"fairness.\" Participants are shown a photo along with two descriptions (human- and algorithm-generated). They are then asked to indicate which is \"more fair\" in the context of a dating site, and explain their reasoning. We vary a number of factors, including the gender, race and attractiveness of the person in the photo. While participants generally found human-generated tags to be more fair, API tags were judged as being more fair in one setting - where the image depicted an \"attractive,\" white individual. In their explanations, participants often mention accuracy, as well as the objectivity/subjectivity of the tags in the description. We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125935197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Muesluem Atas, Ralph Samer, A. Felfernig, Thi Ngoc Trang Tran, Seda Polat Erdeniz, Martin Stettinger
Constraint-based group recommender systems support the identification of items that best match the individual preferences of all group members. In cases where the requirements of the group members are inconsistent with the underlying constraint set, the group needs to be supported such that an appropriate solution can be found. In this paper, we present a guided approach that determines socially-aware diagnoses based on different aggregation functions. We analyzed the prediction quality of different aggregation functions by using data collected in a user study. The results indicate that those diagnoses guided by the Least Misery aggregation function achieve a higher prediction quality compared to the Average Voting, Most Pleasure, and Majority Voting. Moreover, another major outcome of our work reveals that diagnoses based on aggregation functions outperform basic approaches such as Breadth First Search and Direct Diagnosis.
{"title":"Socially-Aware Diagnosis for Constraint-Based Recommendation","authors":"Muesluem Atas, Ralph Samer, A. Felfernig, Thi Ngoc Trang Tran, Seda Polat Erdeniz, Martin Stettinger","doi":"10.1145/3320435.3320436","DOIUrl":"https://doi.org/10.1145/3320435.3320436","url":null,"abstract":"Constraint-based group recommender systems support the identification of items that best match the individual preferences of all group members. In cases where the requirements of the group members are inconsistent with the underlying constraint set, the group needs to be supported such that an appropriate solution can be found. In this paper, we present a guided approach that determines socially-aware diagnoses based on different aggregation functions. We analyzed the prediction quality of different aggregation functions by using data collected in a user study. The results indicate that those diagnoses guided by the Least Misery aggregation function achieve a higher prediction quality compared to the Average Voting, Most Pleasure, and Majority Voting. Moreover, another major outcome of our work reveals that diagnoses based on aggregation functions outperform basic approaches such as Breadth First Search and Direct Diagnosis.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128845583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Social-based recommenders seek to exploit the mechanisms of homophily and influence observed in social networks in order to provide more accurate recommendations. The way they achieve this is by enforcing similar preferences among users that are socially connected. It is thus reasonable to question whether such approaches lead to the formation of echo chambers, i.e., social groups with a narrow set of preferences and which receive recommendations with low diversity and novelty. This work studies this research question and quantifies the diversity and novelty of existing methods. An important finding is that it is possible to increase accuracy without sacrificing diversity and novelty.
{"title":"Diversity and Novelty in Social-Based Collaborative Filtering","authors":"Dimitris Sacharidis","doi":"10.1145/3320435.3320479","DOIUrl":"https://doi.org/10.1145/3320435.3320479","url":null,"abstract":"Social-based recommenders seek to exploit the mechanisms of homophily and influence observed in social networks in order to provide more accurate recommendations. The way they achieve this is by enforcing similar preferences among users that are socially connected. It is thus reasonable to question whether such approaches lead to the formation of echo chambers, i.e., social groups with a narrow set of preferences and which receive recommendations with low diversity and novelty. This work studies this research question and quantifies the diversity and novelty of existing methods. An important finding is that it is possible to increase accuracy without sacrificing diversity and novelty.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115253565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jaehun Kim, Andrew M. Demetriou, Sandy Manolios, Cynthia C. S. Liem
Prior research from the field of music psychology has suggested that there are factors common to music preference beyond individual genres. Specifically, research has shown that self-reported ratings of preference for individual musical genres can be reduced to 4 or 5 dimensions, which in turn have been shown to correlate to relevant psychological constructs, such as personality. However, the number of dimensions emerging from multiple studies has varied despite the care taken in conducting such research. Data-driven approaches offer opportunities to further this line of research with actual listening data, at a scale and scope surpassing that of traditional psychological studies. Although listening data can be considered more direct and comprehensive evidence of listening preference, transforming this data into meaningful measurements is non-trivial. In the current paper, we report on investigations seeking to find interpretable underlying dimensions of music taste, using implicit large-scale listening data. Offering a critical reflection on potential researchers' degrees of freedom, we adopt an explicit systematic approach, investigating the impact of varying different parameters, analysis, and normalization techniques. More precisely, we consider various ways to extract listening preference information from two large, openly available datasets of music listening behavior, making use of principal component analysis and variational autoencoders to extract potential underlying dimensions. Results and implications are discussed in light of prior psychological theory, and the potential of user listening data to further research on music preference.
{"title":"Beyond Explicit Reports: Comparing Data-Driven Approaches to Studying Underlying Dimensions of Music Preference","authors":"Jaehun Kim, Andrew M. Demetriou, Sandy Manolios, Cynthia C. S. Liem","doi":"10.1145/3320435.3320462","DOIUrl":"https://doi.org/10.1145/3320435.3320462","url":null,"abstract":"Prior research from the field of music psychology has suggested that there are factors common to music preference beyond individual genres. Specifically, research has shown that self-reported ratings of preference for individual musical genres can be reduced to 4 or 5 dimensions, which in turn have been shown to correlate to relevant psychological constructs, such as personality. However, the number of dimensions emerging from multiple studies has varied despite the care taken in conducting such research. Data-driven approaches offer opportunities to further this line of research with actual listening data, at a scale and scope surpassing that of traditional psychological studies. Although listening data can be considered more direct and comprehensive evidence of listening preference, transforming this data into meaningful measurements is non-trivial. In the current paper, we report on investigations seeking to find interpretable underlying dimensions of music taste, using implicit large-scale listening data. Offering a critical reflection on potential researchers' degrees of freedom, we adopt an explicit systematic approach, investigating the impact of varying different parameters, analysis, and normalization techniques. More precisely, we consider various ways to extract listening preference information from two large, openly available datasets of music listening behavior, making use of principal component analysis and variational autoencoders to extract potential underlying dimensions. Results and implications are discussed in light of prior psychological theory, and the potential of user listening data to further research on music preference.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124970167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Music preferences are likely to depend on contextual characteristics such as location and activity. However, most recommender systems do not allow users to adapt recommendations to their current context. We therefore built ContextPlay, a context-aware music recommender that enables user control for both contextual characteristics and music preferences. By conducting a mixed-design study (N=114) with four typical scenarios of music listening, we investigate the effect of controlling contextual characteristics in a music recommender system on four aspects: perceived quality, diversity, effectiveness, and cognitive load. Compared to our baseline which only allows to specify music preferences, having additional control for context leads to higher perceived quality and does not increase cognitive load. We also find that the contexts of mood, weather, and location tend to influence user perception of the system. Moreover, we found that users are more likely to modify contexts and their profile during relaxing activities.
{"title":"ContextPlay: Evaluating User Control for Context-Aware Music Recommendation","authors":"Yucheng Jin, N. Htun, N. Tintarev, K. Verbert","doi":"10.1145/3320435.3320445","DOIUrl":"https://doi.org/10.1145/3320435.3320445","url":null,"abstract":"Music preferences are likely to depend on contextual characteristics such as location and activity. However, most recommender systems do not allow users to adapt recommendations to their current context. We therefore built ContextPlay, a context-aware music recommender that enables user control for both contextual characteristics and music preferences. By conducting a mixed-design study (N=114) with four typical scenarios of music listening, we investigate the effect of controlling contextual characteristics in a music recommender system on four aspects: perceived quality, diversity, effectiveness, and cognitive load. Compared to our baseline which only allows to specify music preferences, having additional control for context leads to higher perceived quality and does not increase cognitive load. We also find that the contexts of mood, weather, and location tend to influence user perception of the system. Moreover, we found that users are more likely to modify contexts and their profile during relaxing activities.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125539717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Session details: ACM UMAP 2019 Main Track","authors":"D. Jannach, O. Santos","doi":"10.1145/3340228","DOIUrl":"https://doi.org/10.1145/3340228","url":null,"abstract":"","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"1986 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127644354","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Most recommender systems generate recommendations to match the user's current preference. However, users sometimes might have the goal to develop new preferences away from their current preference and use the recommender to guide them towards it. In this paper, we asked users to select a new genre to explore and studied what kind of recommendations would be more helpful for users to start exploring this new music taste. Three different recommendation methods are tested: one non-personalized which recommends the most representative tracks of the genre, one personalized method which considers songs from the new genre that best matches users' current preferences, and one mixed method which makes a trade-off between the two approaches. A comparative design was used in a user experiment in which participants were asked to evaluate the differences between the personalized method/mixed method and the non-personalized baseline. The mixed method results in recommendations that are more accurate and representative for the new genre than the personalized method. Users' perceived helpfulness for exploring the new genre is positively related to both perceived accuracy and perceived representativeness of the recommended items. Besides, recommendations from the mixed method are perceived more helpful for users high on Musical Sophistication Index for Active Engagement (MSAE). To our knowledge, this is one of the first studies using a recommender system to support users' preference development, and provides insights in how recommender systems can help users attain new goals and tastes.
{"title":"Personalized Recommendations for Music Genre Exploration","authors":"Yu Liang, M. Willemsen","doi":"10.1145/3320435.3320455","DOIUrl":"https://doi.org/10.1145/3320435.3320455","url":null,"abstract":"Most recommender systems generate recommendations to match the user's current preference. However, users sometimes might have the goal to develop new preferences away from their current preference and use the recommender to guide them towards it. In this paper, we asked users to select a new genre to explore and studied what kind of recommendations would be more helpful for users to start exploring this new music taste. Three different recommendation methods are tested: one non-personalized which recommends the most representative tracks of the genre, one personalized method which considers songs from the new genre that best matches users' current preferences, and one mixed method which makes a trade-off between the two approaches. A comparative design was used in a user experiment in which participants were asked to evaluate the differences between the personalized method/mixed method and the non-personalized baseline. The mixed method results in recommendations that are more accurate and representative for the new genre than the personalized method. Users' perceived helpfulness for exploring the new genre is positively related to both perceived accuracy and perceived representativeness of the recommended items. Besides, recommendations from the mixed method are perceived more helpful for users high on Musical Sophistication Index for Active Engagement (MSAE). To our knowledge, this is one of the first studies using a recommender system to support users' preference development, and provides insights in how recommender systems can help users attain new goals and tastes.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"171 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124155105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
G. A. Papadopoulos, G. Samaras, Stephan Weibelzahl
{"title":"Session details: Keynote & Invited Talks","authors":"G. A. Papadopoulos, G. Samaras, Stephan Weibelzahl","doi":"10.1145/3340227","DOIUrl":"https://doi.org/10.1145/3340227","url":null,"abstract":"","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126608213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aadhavan M. Nambhi, Bhanu Prakash Reddy Guda, Aarsh Prakash Agarwal, Gaurav Verma, Harvineet Singh, I. Burhanuddin
Data analytics software applications have become an integral part of the decision-making process of analysts. Users of such a software face challenges due to insufficient product and domain knowledge, and find themselves in need of help. To alleviate this, we propose a task-aware command recommendation system, to guide the user on what commands could be executed next. We rely on topic modeling techniques to incorporate information about user's task into our models. We also present a help prediction model to detect if a user is in need of help, in which case the system proactively provides the aforementioned command recommendations. We leverage the log data of a web-based analytics software to quantify the superior performance of our neural models, in comparison to competitive baselines.
{"title":"Stuck? No worries!: Task-aware Command Recommendation and Proactive Help for Analysts","authors":"Aadhavan M. Nambhi, Bhanu Prakash Reddy Guda, Aarsh Prakash Agarwal, Gaurav Verma, Harvineet Singh, I. Burhanuddin","doi":"10.1145/3320435.3320477","DOIUrl":"https://doi.org/10.1145/3320435.3320477","url":null,"abstract":"Data analytics software applications have become an integral part of the decision-making process of analysts. Users of such a software face challenges due to insufficient product and domain knowledge, and find themselves in need of help. To alleviate this, we propose a task-aware command recommendation system, to guide the user on what commands could be executed next. We rely on topic modeling techniques to incorporate information about user's task into our models. We also present a help prediction model to detect if a user is in need of help, in which case the system proactively provides the aforementioned command recommendations. We leverage the log data of a web-based analytics software to quantify the superior performance of our neural models, in comparison to competitive baselines.","PeriodicalId":254537,"journal":{"name":"Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129341913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}