Machine learning judged neutral facial expressions as key factors for a “good therapist” within the first five minutes: An experiment to simulate online video counselling

Abstract

Objective

Machine learning models were employed to discern patients' impressions from the therapists' facial expressions during a virtual online video counselling session.

Methods

Eight therapists simulated an online video counselling session for the same patient. The facial emotions of the therapists were extracted from the session videos; we then utilized a random forest model to determine the therapist's impression as perceived by the patients.

Results

The therapists' neutral facial expressions were important controlling factors for patients' impressions. A predictive model with three neutral facial features achieved an accuracy of 83% in identifying patients' impressions.

Conclusions

Neutral facial expressions may contribute to patient impressions in an online video counselling environment with spatiotemporal disconnection.

Innovation

Expression recognition techniques were applied innovatively to an online counselling setting where therapists' expressions are limited. Our findings have the potential to enhance psychiatric clinical practice using Information and Communication Technology.