Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana
{"title":"基于LSTM(长短期记忆)算法的情感总结学习评价","authors":"Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana","doi":"10.4108/eai.27-11-2021.2315533","DOIUrl":null,"url":null,"abstract":"Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.","PeriodicalId":246168,"journal":{"name":"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sentiment Summarization Learning Evaluation Using LSTM (Long Short Term Memory) Algorithm\",\"authors\":\"Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana\",\"doi\":\"10.4108/eai.27-11-2021.2315533\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.\",\"PeriodicalId\":246168,\"journal\":{\"name\":\"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"1900-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4108/eai.27-11-2021.2315533\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4108/eai.27-11-2021.2315533","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Sentiment Summarization Learning Evaluation Using LSTM (Long Short Term Memory) Algorithm
Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.