{"title":"基于语义相似度的链接语法自由文本答案自动评价方法","authors":"U. K. Chakraborty, Rashmi Gurung, Samir Roy","doi":"10.1109/T4E.2014.57","DOIUrl":null,"url":null,"abstract":"Most approaches towards automatic evaluation of free text answers are keyword centric. Though keywords essentially reflect and represent the primary concept coverage of an answer, they are incomplete without the associated texts. The words occurring before and after the keywords bring out the true meaning. The work presented in this paper proposes a semantic similarity based approach for evaluation of free text answers where both keywords and the associated text contribute to the score. A link grammar based approach is used to extract the keywords from the answer and through the process of identifying and extracting the relational expressions for a keyword the model automatically evaluates a learners' free text response SA to a given question Q with respect to a model answer MA. The score of the automated system have a high co-relation with human evaluator score as can be found from the reported results.","PeriodicalId":151911,"journal":{"name":"2014 IEEE Sixth International Conference on Technology for Education","volume":"119 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Semantic Similarity Based Approach for Automatic Evaluation of Free Text Answers Using Link Grammar\",\"authors\":\"U. K. Chakraborty, Rashmi Gurung, Samir Roy\",\"doi\":\"10.1109/T4E.2014.57\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Most approaches towards automatic evaluation of free text answers are keyword centric. Though keywords essentially reflect and represent the primary concept coverage of an answer, they are incomplete without the associated texts. The words occurring before and after the keywords bring out the true meaning. The work presented in this paper proposes a semantic similarity based approach for evaluation of free text answers where both keywords and the associated text contribute to the score. A link grammar based approach is used to extract the keywords from the answer and through the process of identifying and extracting the relational expressions for a keyword the model automatically evaluates a learners' free text response SA to a given question Q with respect to a model answer MA. The score of the automated system have a high co-relation with human evaluator score as can be found from the reported results.\",\"PeriodicalId\":151911,\"journal\":{\"name\":\"2014 IEEE Sixth International Conference on Technology for Education\",\"volume\":\"119 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2014 IEEE Sixth International Conference on Technology for Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/T4E.2014.57\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 IEEE Sixth International Conference on Technology for Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/T4E.2014.57","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Semantic Similarity Based Approach for Automatic Evaluation of Free Text Answers Using Link Grammar
Most approaches towards automatic evaluation of free text answers are keyword centric. Though keywords essentially reflect and represent the primary concept coverage of an answer, they are incomplete without the associated texts. The words occurring before and after the keywords bring out the true meaning. The work presented in this paper proposes a semantic similarity based approach for evaluation of free text answers where both keywords and the associated text contribute to the score. A link grammar based approach is used to extract the keywords from the answer and through the process of identifying and extracting the relational expressions for a keyword the model automatically evaluates a learners' free text response SA to a given question Q with respect to a model answer MA. The score of the automated system have a high co-relation with human evaluator score as can be found from the reported results.