{"title":"基于面部情绪和生理传感器的多模态压力分类方法","authors":"M. S. Abirami, Umang Shringi, Aditya Mishra","doi":"10.1109/ICNWC57852.2023.10127519","DOIUrl":null,"url":null,"abstract":"The focus is on understanding emotional stress by itself may enhance artificial intelligence agents involved in emotion detection and human computer interaction. These emotional responses are reflected into emotions and facial expressions. This research work proposes a study of Stress Classification using both facial expression and Physiological Sensors. For getting facial data, transfer learning is used with fine-tuning to extract features from facial images. In transfer learning different Deep Learning architectures like VGG-19[13], ResNet are used. From the sensors data on four features are collected that is age, gender, body temperature and heartbeat and accordingly choose the architecture for doing stress classification. Finally, both these models are integrated for getting better results.","PeriodicalId":197525,"journal":{"name":"2023 International Conference on Networking and Communications (ICNWC)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multimodal Approach for Classifying Stress using Facial Emotion and Physiological Sensors\",\"authors\":\"M. S. Abirami, Umang Shringi, Aditya Mishra\",\"doi\":\"10.1109/ICNWC57852.2023.10127519\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The focus is on understanding emotional stress by itself may enhance artificial intelligence agents involved in emotion detection and human computer interaction. These emotional responses are reflected into emotions and facial expressions. This research work proposes a study of Stress Classification using both facial expression and Physiological Sensors. For getting facial data, transfer learning is used with fine-tuning to extract features from facial images. In transfer learning different Deep Learning architectures like VGG-19[13], ResNet are used. From the sensors data on four features are collected that is age, gender, body temperature and heartbeat and accordingly choose the architecture for doing stress classification. Finally, both these models are integrated for getting better results.\",\"PeriodicalId\":197525,\"journal\":{\"name\":\"2023 International Conference on Networking and Communications (ICNWC)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Networking and Communications (ICNWC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICNWC57852.2023.10127519\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Networking and Communications (ICNWC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNWC57852.2023.10127519","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Multimodal Approach for Classifying Stress using Facial Emotion and Physiological Sensors
The focus is on understanding emotional stress by itself may enhance artificial intelligence agents involved in emotion detection and human computer interaction. These emotional responses are reflected into emotions and facial expressions. This research work proposes a study of Stress Classification using both facial expression and Physiological Sensors. For getting facial data, transfer learning is used with fine-tuning to extract features from facial images. In transfer learning different Deep Learning architectures like VGG-19[13], ResNet are used. From the sensors data on four features are collected that is age, gender, body temperature and heartbeat and accordingly choose the architecture for doing stress classification. Finally, both these models are integrated for getting better results.