Debate: How the business model of social media fuels the need for greater moderation

Abstract

The current business model of social media companies is to keep users engaged and on screen, so that data can be obtained from them, and targeted advertisements sold. To maintain user engagement, recommender systems (algorithms) promote content, which can be extreme, and includes mental health content. Extreme mental health content, such as self-harm images, can be pushed to any user and then more and more extreme content can be pushed to them. The normalisation, amplification or glamorisation of harmful content can have negative impacts upon the user, who may struggle to express what is happening online to anyone. In contrast with the views of Zhang et al. (Child and Adolescent Mental Health, 2024, 29, 104), without greater, timely moderation of harmful content, the promotion of self-harm, suicide and eating disorders will continue on social media, with potentially devastating consequences.