Customizability in Conversational Agents and Their Impact on Health Engagement (Stage 2)

Abstract

Conversational agents (CAs) are effective tools for health behavior change, yet little research investigates the mechanisms through which they work. Following the Computer as Social Actors (CASA) paradigm, we suggest that agents are perceived as human-like actors and hence influence behavior much as human coaches might. As such, agents should be designed to resemble ideal interaction patterns, for example, by resembling their users. In this registered report, we evaluated this paradigm by testing the impact of customization on similarity and reciprocity, which in turn were hypothesized to improve perceptions of the agent and compliance with the agent’s recommendations to complete a cognitive training exercise. In an online study, 2437 participants were randomly assigned to one of two surface-level CA customization conditions (present/absent) and to one of two deep-level CA customization conditions (present/absent) in a between-subject experimental design. As part of a conversation flow with a CA, participants assigned to the present surface- and/or deep-level customization conditions were able to choose their preferred CA based on the four personality summaries and/or choose their CA’s gender (male/female/agender robotic), avatar (choice between seven avatars corresponding to the chosen gender), and name. While the ability to customize increased similarity to the user and the perceptions of customizability, our findings show that customization did not impact experience or compliance. However, the perceived customizability of the agent was linked to increases in the likeability and usefulness of the agent. We conclude that our work finds no negative effects of customization; yet, its impact on the relationship between the agent and its user is complex and can benefit from more research as merited by its applicability to public health. As aging and ill populations increase the burden on health systems worldwide, CAs have the potential to transform the landscape of accessible care.