首页 > 最新文献

2022 8th International Conference on Systems and Informatics (ICSAI)最新文献

英文 中文
Chinese Biomedical Entity Relation Extraction Based On Directed Graph Convolutional Network 基于有向图卷积网络的中文生物医学实体关系提取
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005391
Baosheng Yin, Wei Zhao
In the field of biomedical text mining, biomedical entity relation extraction is the core task to assist researchers in completing the text mining. However, the special characteristics of medical literature, such as long and complex syntax of medical text and a large number of overlapping relations, pose a challenge for biomedical entity relation extraction. In this paper, we propose and apply a Directed Graph Convolutional Network (D-GCN) to encode syntactic information based on the existing neural model as a backbone, thus enhancing the representational ability of the input sequence. Experiments on the evaluation data set showed that the framework could effectively enhance the baseline models based on LSTM, Transformer and pre-trained model BERT at three different levels. Compared with the baseline model PRGC, our model improved F1-score by 1.4% on average.
在生物医学文本挖掘领域,生物医学实体关系提取是辅助研究人员完成文本挖掘的核心任务。然而,医学文献的特殊特点,如医学文本冗长复杂的语法和大量的重叠关系,给生物医学实体关系的提取带来了挑战。本文提出并应用了一种基于已有神经模型为主干的有向图卷积网络(D-GCN)对句法信息进行编码,从而增强了输入序列的表示能力。在评估数据集上的实验表明,该框架可以在三个不同的层次上有效地增强基于LSTM、Transformer和预训练模型BERT的基线模型。与基线模型PRGC相比,我们的模型平均将f1评分提高了1.4%。
{"title":"Chinese Biomedical Entity Relation Extraction Based On Directed Graph Convolutional Network","authors":"Baosheng Yin, Wei Zhao","doi":"10.1109/ICSAI57119.2022.10005391","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005391","url":null,"abstract":"In the field of biomedical text mining, biomedical entity relation extraction is the core task to assist researchers in completing the text mining. However, the special characteristics of medical literature, such as long and complex syntax of medical text and a large number of overlapping relations, pose a challenge for biomedical entity relation extraction. In this paper, we propose and apply a Directed Graph Convolutional Network (D-GCN) to encode syntactic information based on the existing neural model as a backbone, thus enhancing the representational ability of the input sequence. Experiments on the evaluation data set showed that the framework could effectively enhance the baseline models based on LSTM, Transformer and pre-trained model BERT at three different levels. Compared with the baseline model PRGC, our model improved F1-score by 1.4% on average.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131385947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Customer Portrait for Metrology Institutions Based on the Machine Learning Clustering Algorithm and the RFM Model 基于机器学习聚类算法和RFM模型的计量机构客户画像
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005470
Xiaojing Zhang, Dongshuo Zhao, Yaran Li, Yudong Liu, Gang Hu
With the increasing intensity of competition in the current metrology testing market, building customer portrait is an effective way for metrology institutions to improve service levels to customers. This paper is based on the basic business data of a certain metrology institution. First, recency, frequency, monetary value model (RFM model), which is widely applied in customer relationship management, is improved. Further, it is combined with the business features of the metrology institution and used to build data feature engineering, which is closely related to the business data of the metrology institution and can reflect the data situation. Then, the data are analyzed through correlation test, standardized by Z-score, and clustered with three clustering algorithms, namely K-Means, DBSCAN, and AGNES, which are in SKLEARN database based on Python. After that, the clustering results are compared. In the clustering process, the elbow method and method for traversing the silhouette coefficient are used to determine the optimal value of the clustering algorithm. Finally, with the analysis of clustering results, the customers’ features of the metrology institution are signed and the customer portrait is built, which provides data analysis methods, tools and decision basis for the metrology institution to offer better services.
在当前计量检测市场竞争日益激烈的情况下,建立客户画像是计量机构提高对客户服务水平的有效途径。本文以某计量机构的基本业务数据为基础。首先,对客户关系管理中广泛应用的RFM模型进行改进。进一步结合计量机构的业务特点,构建与计量机构业务数据密切相关、能反映数据情况的数据特征工程。然后,通过相关检验对数据进行分析,采用Z-score进行标准化,并使用基于Python的SKLEARN数据库中的K-Means、DBSCAN、AGNES三种聚类算法进行聚类。然后,对聚类结果进行比较。在聚类过程中,采用弯头法和遍历轮廓系数法确定聚类算法的最优值。最后,通过对聚类结果的分析,签名计量机构的客户特征,构建客户画像,为计量机构更好地提供服务提供数据分析方法、工具和决策依据。
{"title":"Customer Portrait for Metrology Institutions Based on the Machine Learning Clustering Algorithm and the RFM Model","authors":"Xiaojing Zhang, Dongshuo Zhao, Yaran Li, Yudong Liu, Gang Hu","doi":"10.1109/ICSAI57119.2022.10005470","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005470","url":null,"abstract":"With the increasing intensity of competition in the current metrology testing market, building customer portrait is an effective way for metrology institutions to improve service levels to customers. This paper is based on the basic business data of a certain metrology institution. First, recency, frequency, monetary value model (RFM model), which is widely applied in customer relationship management, is improved. Further, it is combined with the business features of the metrology institution and used to build data feature engineering, which is closely related to the business data of the metrology institution and can reflect the data situation. Then, the data are analyzed through correlation test, standardized by Z-score, and clustered with three clustering algorithms, namely K-Means, DBSCAN, and AGNES, which are in SKLEARN database based on Python. After that, the clustering results are compared. In the clustering process, the elbow method and method for traversing the silhouette coefficient are used to determine the optimal value of the clustering algorithm. Finally, with the analysis of clustering results, the customers’ features of the metrology institution are signed and the customer portrait is built, which provides data analysis methods, tools and decision basis for the metrology institution to offer better services.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114290321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Promoting a Hybrid Cryptosystem System’s Security based on Fresnel lens and RSA Algorithm 基于菲涅耳透镜和RSA算法的混合密码系统安全性提升
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005357
Peng Yang, Weishun Xue, Chenqi Fan, Xiaojian Xue
with the growing concerns of the current network security, development of hybrid cryptosystem based on the combination of optical symmetric cryptography and public key cryptography has aroused considerable research interest. In optical symmetry system, a new method for encrypting optical information using Fresnel lenses is proposed. The symmetry system’s keys include the focal length (f) and propagation wavelength ($lambda$). Then, in public key cryptography, the key ($lambda$,J) is encrypted by the RSA algorithm. Finally, we have implemented and result have been obtained using 12-level digital Fresnel lens by COMSOL Multiphysics to study of how the optical image deciphered the information using encryption keys. In addition, the main challenges and future prospects for the further development of hybrid cryptosystem system are discussed.
随着人们对当前网络安全问题的日益关注,基于光学对称密码和公钥密码相结合的混合密码系统的发展引起了人们极大的研究兴趣。在光学对称系统中,提出了一种利用菲涅耳透镜对光学信息进行加密的新方法。对称系统的关键字包括焦距(f)和传播波长($lambda$)。然后,在公钥加密中,密钥($lambda$,J)由RSA算法加密。最后,我们利用COMSOL Multiphysics软件实现了12级数字菲涅耳透镜,并获得了结果,研究了光学图像如何使用加密密钥解密信息。此外,还讨论了混合密码系统进一步发展面临的主要挑战和未来前景。
{"title":"Promoting a Hybrid Cryptosystem System’s Security based on Fresnel lens and RSA Algorithm","authors":"Peng Yang, Weishun Xue, Chenqi Fan, Xiaojian Xue","doi":"10.1109/ICSAI57119.2022.10005357","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005357","url":null,"abstract":"with the growing concerns of the current network security, development of hybrid cryptosystem based on the combination of optical symmetric cryptography and public key cryptography has aroused considerable research interest. In optical symmetry system, a new method for encrypting optical information using Fresnel lenses is proposed. The symmetry system’s keys include the focal length (f) and propagation wavelength ($lambda$). Then, in public key cryptography, the key ($lambda$,J) is encrypted by the RSA algorithm. Finally, we have implemented and result have been obtained using 12-level digital Fresnel lens by COMSOL Multiphysics to study of how the optical image deciphered the information using encryption keys. In addition, the main challenges and future prospects for the further development of hybrid cryptosystem system are discussed.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114176120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Test and Analysis Of Indoor And Outdoor Barometric Altimetry 室内和室外气压测高的测试与分析
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005521
Shuaichen Li, Jian-Feng Wu
Measuring the height of a site is of great significance for scientific research and daily life. This paper aims to measure the indoor and outdoor air pressure height, compare and analyze the error and fluctuation of indoor and outdoor measured data, and filter the measured value with Kalman filter to reduce the error and fluctuation; The influence of wind speed on measurement error and fluctuation is analyzed; Three methods are used to process the data of the wind measurement group and the results are compared; The predictability of air pressure sensor is tested and analyzed. The experimental results show that: 1) Compared with indoor measurement, the error and fluctuation of outdoor measurement are significantly worse. 2) In indoor and outdoor measurement, Kalman filter has a good effect, which can reduce the average error of measurement data by 31.9% at most and the measurement fluctuation by 37.5%. The effect of Kalman filtering is greatly affected by the measured data. The greater the fluctuation and error of the measured value, the more obvious the effect of Kalman filter. 3) Wind has a great influence on barometric altimetry, and the fluctuation and error of the measurement results increase with the increase of wind speed. Combine theoretical knowledge with the results of comparative experiments It is speculated that the reason for the large outdoor measurement error and fluctuation includes the interference of wind to the sensor. 4) The traditional least squares fitting is the worst, and the least squares fitting based on Kalman filter is the best. 5) In the windy state, the RMS of quadratic fitting is 60% higher than that in the windless state, and the residual error is 63.8% higher.
测量场地高度对于科学研究和日常生活都具有重要意义。本文旨在测量室内外空气压力高度,对室内外实测数据的误差和波动进行比较分析,并用卡尔曼滤波对实测值进行滤波,减小误差和波动;分析了风速对测量误差和波动的影响;采用三种方法对测风组数据进行处理,并对处理结果进行比较;对气压传感器的可预测性进行了测试和分析。实验结果表明:1)与室内测量相比,室外测量的误差和波动明显更大。2)在室内外测量中,卡尔曼滤波效果良好,测量数据的平均误差最多减少31.9%,测量波动最多减少37.5%。实测数据对卡尔曼滤波的效果有很大影响。测量值的波动和误差越大,卡尔曼滤波的效果越明显。3)风对气压测高的影响较大,测量结果的波动和误差随风速的增大而增大。结合理论知识和对比实验结果,推测室外测量误差和波动较大的原因包括风对传感器的干扰。4)传统的最小二乘拟合效果最差,而基于卡尔曼滤波的最小二乘拟合效果最好。5)在有风状态下,二次拟合的均方根比无风状态高60%,残差高63.8%。
{"title":"Test and Analysis Of Indoor And Outdoor Barometric Altimetry","authors":"Shuaichen Li, Jian-Feng Wu","doi":"10.1109/ICSAI57119.2022.10005521","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005521","url":null,"abstract":"Measuring the height of a site is of great significance for scientific research and daily life. This paper aims to measure the indoor and outdoor air pressure height, compare and analyze the error and fluctuation of indoor and outdoor measured data, and filter the measured value with Kalman filter to reduce the error and fluctuation; The influence of wind speed on measurement error and fluctuation is analyzed; Three methods are used to process the data of the wind measurement group and the results are compared; The predictability of air pressure sensor is tested and analyzed. The experimental results show that: 1) Compared with indoor measurement, the error and fluctuation of outdoor measurement are significantly worse. 2) In indoor and outdoor measurement, Kalman filter has a good effect, which can reduce the average error of measurement data by 31.9% at most and the measurement fluctuation by 37.5%. The effect of Kalman filtering is greatly affected by the measured data. The greater the fluctuation and error of the measured value, the more obvious the effect of Kalman filter. 3) Wind has a great influence on barometric altimetry, and the fluctuation and error of the measurement results increase with the increase of wind speed. Combine theoretical knowledge with the results of comparative experiments It is speculated that the reason for the large outdoor measurement error and fluctuation includes the interference of wind to the sensor. 4) The traditional least squares fitting is the worst, and the least squares fitting based on Kalman filter is the best. 5) In the windy state, the RMS of quadratic fitting is 60% higher than that in the windless state, and the residual error is 63.8% higher.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122106834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Ping-pong Task Strategy Based on Model-free Multi-dimensional Q-function Deep Reinforcement Learning 基于无模型多维q函数深度强化学习的乒乓任务策略
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005466
H. Ma, Jianyin Fan, Qiang Wang
Deep reinforcement learning has been widely used in table tennis decision-making tasks, but most methods have their own defects, such as relying on high-precision trajectory prediction work or requiring targeted class training, etc. None of the methods can directly get a complete hitting strategy through the initial state of the ball. In this paper, we train a ping-pong hitting policy controller with model-free reinforcement learning. By extending the multi-dimensional Q-function, the prediction part of the table tennis task and the batting strategy part are integrated, the trajectory prediction work and the batting work are completed by a single network, which simplifies the complex prediction process and does not need to build a complex dynamics model or train a neural network to predict the trajectory of ping-pong balls. In this way, the deep reinforcement learning process and supervised trajectory prediction training process are organized into a single process. The experimental results show that the best convergence effect can be basically achieved in 50,000 rounds of training. 10,000 tests were performed as a test set with a success rate of over 99%.
深度强化学习已被广泛应用于乒乓球决策任务中,但大多数方法都存在自身的缺陷,如依赖高精度的轨迹预测工作或需要有针对性的班级训练等。没有一种方法可以通过球的初始状态直接得到一个完整的击球策略。在本文中,我们使用无模型强化学习训练一个乒乓球击球策略控制器。通过扩展多维q函数,将乒乓球任务的预测部分与击球策略部分相结合,将轨迹预测工作与击球工作由一个网络完成,简化了复杂的预测过程,不需要建立复杂的动力学模型或训练神经网络来预测乒乓球的轨迹。这样,深度强化学习过程和监督式轨迹预测训练过程被组织成一个过程。实验结果表明,在5万轮训练中基本可以达到最佳的收敛效果。作为一个测试集进行了10,000次测试,成功率超过99%。
{"title":"A Novel Ping-pong Task Strategy Based on Model-free Multi-dimensional Q-function Deep Reinforcement Learning","authors":"H. Ma, Jianyin Fan, Qiang Wang","doi":"10.1109/ICSAI57119.2022.10005466","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005466","url":null,"abstract":"Deep reinforcement learning has been widely used in table tennis decision-making tasks, but most methods have their own defects, such as relying on high-precision trajectory prediction work or requiring targeted class training, etc. None of the methods can directly get a complete hitting strategy through the initial state of the ball. In this paper, we train a ping-pong hitting policy controller with model-free reinforcement learning. By extending the multi-dimensional Q-function, the prediction part of the table tennis task and the batting strategy part are integrated, the trajectory prediction work and the batting work are completed by a single network, which simplifies the complex prediction process and does not need to build a complex dynamics model or train a neural network to predict the trajectory of ping-pong balls. In this way, the deep reinforcement learning process and supervised trajectory prediction training process are organized into a single process. The experimental results show that the best convergence effect can be basically achieved in 50,000 rounds of training. 10,000 tests were performed as a test set with a success rate of over 99%.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117084862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design of a Container-based Broadband RF Pulse Signal Analysis Algorithm Integration Scheme 基于容器的宽带射频脉冲信号分析算法集成方案设计
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005340
Wenfeng Tian, Hui Deng, Pengfei Zeng
In order to better support the self-learning and dynamic upgrading of broadband RF pulse signal intelligent detection terminal for interference, partial discharge defective pulse signal features and its extraction algorithm, combined with the multi-sensor fusion, resource limitation and real-time information processing faced by the intelligent detection terminal, this paper is based on the principle of lightweight Docker container technology architecture, the partial discharge algorithm is developed, released, deployed, and The paper also adopts the multi-agent resource scheduling of lightweight containers to realize the intelligent scheduling of resources and continuous iteration of algorithms for broadband RF partial discharge detection system, supporting the development and application of broadband RF pulse signal detection and real-time analysis devices.
为了更好地支持宽带射频脉冲信号智能检测终端对干扰、局部放电缺陷脉冲信号特征及其提取算法的自学习和动态升级,结合智能检测终端所面临的多传感器融合、资源限制和实时信息处理等问题,本文基于轻量级Docker容器技术架构原理,本文还采用轻量级容器的多智能体资源调度,实现宽带射频局部放电检测系统资源的智能调度和算法的连续迭代,支持宽带射频脉冲信号检测和实时分析设备的开发和应用。
{"title":"Design of a Container-based Broadband RF Pulse Signal Analysis Algorithm Integration Scheme","authors":"Wenfeng Tian, Hui Deng, Pengfei Zeng","doi":"10.1109/ICSAI57119.2022.10005340","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005340","url":null,"abstract":"In order to better support the self-learning and dynamic upgrading of broadband RF pulse signal intelligent detection terminal for interference, partial discharge defective pulse signal features and its extraction algorithm, combined with the multi-sensor fusion, resource limitation and real-time information processing faced by the intelligent detection terminal, this paper is based on the principle of lightweight Docker container technology architecture, the partial discharge algorithm is developed, released, deployed, and The paper also adopts the multi-agent resource scheduling of lightweight containers to realize the intelligent scheduling of resources and continuous iteration of algorithms for broadband RF partial discharge detection system, supporting the development and application of broadband RF pulse signal detection and real-time analysis devices.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131037613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning a Bimodal Emotion Recognition System Based on Small Amount of Speech Data 基于少量语音数据的双峰情感识别系统的学习
Pub Date : 2022-12-10 DOI: 10.1109/ICSAI57119.2022.10005454
Junya Furutani, Xin Kang, Keita Kiuchi, Ryota Nishimura, M. Sasayama, Kazuyuki Matsumoto
This paper presents a bimodal emotion recognition system based on the voice and text information using small amount of speech data. Specifically, speech is divided into voice and text to learn emotion classifiers for each modal. The probabilities obtained from these emotion classifiers are weighted based on Mehrabian’s rule and summed up for each emotion to calculate the final score for bimodal emotion recognition. To create a highly accurate system while solving the problem that there are few Japanese speech data with emotion labels, we propose a novel data augmentation method and employ a transfer learning approach based on a pre-trained VGG16 model and a fine-tuned Bidirectional Encoder Representations from Transformers (BERT) model on the tweets. In order to prove the effectiveness of the proposed method, we revealed the recognition results for 7 emotional states, i.e., anger, sadness, joy, fear, surprise, disgust, and neutral. The experiment result suggested that our novel data augmentation method improved the accuracy and that bimodal predictions based on voice and text-based outperformed the single-model predictions.
本文提出了一种基于少量语音数据的基于语音和文本信息的双峰情感识别系统。具体来说,将语音分为语音和文本,学习每个模态的情感分类器。从这些情绪分类器中得到的概率根据Mehrabian规则进行加权,并对每种情绪进行求和,计算双峰情绪识别的最终得分。为了创建一个高精度的系统,同时解决带有情感标签的日语语音数据较少的问题,我们提出了一种新的数据增强方法,并采用基于预训练的VGG16模型和微调的双向编码器表示(BERT)模型的迁移学习方法。为了证明该方法的有效性,我们展示了7种情绪状态的识别结果,即愤怒、悲伤、喜悦、恐惧、惊讶、厌恶和中性。实验结果表明,我们的新数据增强方法提高了准确性,基于语音和基于文本的双峰预测优于单模型预测。
{"title":"Learning a Bimodal Emotion Recognition System Based on Small Amount of Speech Data","authors":"Junya Furutani, Xin Kang, Keita Kiuchi, Ryota Nishimura, M. Sasayama, Kazuyuki Matsumoto","doi":"10.1109/ICSAI57119.2022.10005454","DOIUrl":"https://doi.org/10.1109/ICSAI57119.2022.10005454","url":null,"abstract":"This paper presents a bimodal emotion recognition system based on the voice and text information using small amount of speech data. Specifically, speech is divided into voice and text to learn emotion classifiers for each modal. The probabilities obtained from these emotion classifiers are weighted based on Mehrabian’s rule and summed up for each emotion to calculate the final score for bimodal emotion recognition. To create a highly accurate system while solving the problem that there are few Japanese speech data with emotion labels, we propose a novel data augmentation method and employ a transfer learning approach based on a pre-trained VGG16 model and a fine-tuned Bidirectional Encoder Representations from Transformers (BERT) model on the tweets. In order to prove the effectiveness of the proposed method, we revealed the recognition results for 7 emotional states, i.e., anger, sadness, joy, fear, surprise, disgust, and neutral. The experiment result suggested that our novel data augmentation method improved the accuracy and that bimodal predictions based on voice and text-based outperformed the single-model predictions.","PeriodicalId":339547,"journal":{"name":"2022 8th International Conference on Systems and Informatics (ICSAI)","volume":"105 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125541241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 8th International Conference on Systems and Informatics (ICSAI)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1