Tingets 2.0: Computer Vision-Powered Interactive Social and Emotional Learning Tool

Young children between the ages of 3 and 6 often struggle with identifying, expressing, and managing their emotions, especially when it comes to negative emotions. Research indicates that children with higher emotional skills tend to experience greater long-term mental health and well-being benefits. Building on our previous work, we introduce Tingets 2.0, an interactive storytelling app powered by computer vision to facilitate social and emotional learning (SEL) through tangible and digital play. We propose the TinkeRERR framework: Reflect, Express, Regulate, and Repeat, and utilize computer vision technology to combine tangible and digital play seamlessly. Tingets 2.0 aims to help children understand their own and others’ emotions, express emotions constructively, manage negative emotions and cultivate positive emotions. Early results indicate that our novel approach has effectively increased the depth and length of conversations around emotions among children and their parents.