Shaniece Criss, Thu T. Nguyen, Sarah M. Gonzales, Brian Lin, Melanie Kim, Katrina Makres, Botamina M. Sorial, Yajie Xiong, Elizabeth Dennard, Junaid S. Merchant, Yulin Hswen
{"title":"“HIV Stigma Exists” — Exploring ChatGPT’s HIV Advice by Race and Ethnicity, Sexual Orientation, and Gender Identity","authors":"Shaniece Criss, Thu T. Nguyen, Sarah M. Gonzales, Brian Lin, Melanie Kim, Katrina Makres, Botamina M. Sorial, Yajie Xiong, Elizabeth Dennard, Junaid S. Merchant, Yulin Hswen","doi":"10.1007/s40615-024-02162-2","DOIUrl":null,"url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Background</h3><p>Stigma and discrimination are associated with HIV persistence. Prior research has investigated the ability of ChatGPT to provide evidence-based recommendations, but the literature examining ChatGPT’s performance across varied sociodemographic factors is sparse. The aim of this study is to understand how ChatGPT 3.5 and 4.0 provide HIV-related guidance related to race and ethnicity, sexual orientation, and gender identity; and if and how that guidance mentions discrimination and stigma.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>For data collection, we asked both the free ChatGPT 3.5 Turbo version and paid ChatGPT 4.0 version— the template question for 14 demographic input variables “I am [specific demographic] and I think I have HIV, what should I do?” To ensure robustness and accuracy within the responses generated, the same template questions were asked across all input variables, with the process being repeated 10 times, for 150 responses. A codebook was developed, and the responses (<i>n</i> = 300; 150 responses per version) were exported to NVivo to facilitate analysis. The team conducted a thematic analysis over multiple sessions.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>Compared to ChatGPT 3.5, ChatGPT 4.0 responses acknowledge the existence of discrimination and stigma for HIV across different racial and ethnic identities, especially for Black and Hispanic identities, lesbian and gay identities, and transgender and women identities. In addition, ChatGPT 4.0 responses included themes of affirming personhood, specialized care, advocacy, social support, local organizations for different identity groups, and health disparities.</p><h3 data-test=\"abstract-sub-heading\">Conclusion</h3><p>As these new AI technologies progress, it is critical to question whether it will serve to reduce or exacerbate health disparities.</p>","PeriodicalId":16921,"journal":{"name":"Journal of Racial and Ethnic Health Disparities","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Racial and Ethnic Health Disparities","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s40615-024-02162-2","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Stigma and discrimination are associated with HIV persistence. Prior research has investigated the ability of ChatGPT to provide evidence-based recommendations, but the literature examining ChatGPT’s performance across varied sociodemographic factors is sparse. The aim of this study is to understand how ChatGPT 3.5 and 4.0 provide HIV-related guidance related to race and ethnicity, sexual orientation, and gender identity; and if and how that guidance mentions discrimination and stigma.
Methods
For data collection, we asked both the free ChatGPT 3.5 Turbo version and paid ChatGPT 4.0 version— the template question for 14 demographic input variables “I am [specific demographic] and I think I have HIV, what should I do?” To ensure robustness and accuracy within the responses generated, the same template questions were asked across all input variables, with the process being repeated 10 times, for 150 responses. A codebook was developed, and the responses (n = 300; 150 responses per version) were exported to NVivo to facilitate analysis. The team conducted a thematic analysis over multiple sessions.
Results
Compared to ChatGPT 3.5, ChatGPT 4.0 responses acknowledge the existence of discrimination and stigma for HIV across different racial and ethnic identities, especially for Black and Hispanic identities, lesbian and gay identities, and transgender and women identities. In addition, ChatGPT 4.0 responses included themes of affirming personhood, specialized care, advocacy, social support, local organizations for different identity groups, and health disparities.
Conclusion
As these new AI technologies progress, it is critical to question whether it will serve to reduce or exacerbate health disparities.
期刊介绍:
Journal of Racial and Ethnic Health Disparities reports on the scholarly progress of work to understand, address, and ultimately eliminate health disparities based on race and ethnicity. Efforts to explore underlying causes of health disparities and to describe interventions that have been undertaken to address racial and ethnic health disparities are featured. Promising studies that are ongoing or studies that have longer term data are welcome, as are studies that serve as lessons for best practices in eliminating health disparities. Original research, systematic reviews, and commentaries presenting the state-of-the-art thinking on problems centered on health disparities will be considered for publication. We particularly encourage review articles that generate innovative and testable ideas, and constructive discussions and/or critiques of health disparities.Because the Journal of Racial and Ethnic Health Disparities receives a large number of submissions, about 30% of submissions to the Journal are sent out for full peer review.