A. Abdillah, Mohammad Zaenuddin Hamidi, Ratih Nur Esti Anggraeni, R. Sarno
{"title":"研究方案文件分类中单任务与多任务学习的比较研究","authors":"A. Abdillah, Mohammad Zaenuddin Hamidi, Ratih Nur Esti Anggraeni, R. Sarno","doi":"10.1109/ICTS52701.2021.9608043","DOIUrl":null,"url":null,"abstract":"Research protocol is an important document to be scrutinized by the ethical committee. As the research proposal is growing, the necessity for quick and concise protocol review is rising. This study undergoes a comparative study of multi-task learning (MTL) and single-task learning (STL) to classify research protocol documents. We try to carry out the classification process from the summary of health research. We represent research documents as multi-label classification problems and develop a deep learning model based on MTL and STL strategies. In our evaluation, multi-task learning achieved a better result with 0.125 loss and 0.785 Jaccard score than 0.182 and 0.720 in single-task learning. In consequence, MTL has a 27% slower computation time than STL.","PeriodicalId":6738,"journal":{"name":"2021 13th International Conference on Information & Communication Technology and System (ICTS)","volume":"298 1","pages":"213-217"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Comparative Study of Single-task and Multi-task Learning on Research Protocol Document Classification\",\"authors\":\"A. Abdillah, Mohammad Zaenuddin Hamidi, Ratih Nur Esti Anggraeni, R. Sarno\",\"doi\":\"10.1109/ICTS52701.2021.9608043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Research protocol is an important document to be scrutinized by the ethical committee. As the research proposal is growing, the necessity for quick and concise protocol review is rising. This study undergoes a comparative study of multi-task learning (MTL) and single-task learning (STL) to classify research protocol documents. We try to carry out the classification process from the summary of health research. We represent research documents as multi-label classification problems and develop a deep learning model based on MTL and STL strategies. In our evaluation, multi-task learning achieved a better result with 0.125 loss and 0.785 Jaccard score than 0.182 and 0.720 in single-task learning. In consequence, MTL has a 27% slower computation time than STL.\",\"PeriodicalId\":6738,\"journal\":{\"name\":\"2021 13th International Conference on Information & Communication Technology and System (ICTS)\",\"volume\":\"298 1\",\"pages\":\"213-217\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 13th International Conference on Information & Communication Technology and System (ICTS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICTS52701.2021.9608043\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 13th International Conference on Information & Communication Technology and System (ICTS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTS52701.2021.9608043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Comparative Study of Single-task and Multi-task Learning on Research Protocol Document Classification
Research protocol is an important document to be scrutinized by the ethical committee. As the research proposal is growing, the necessity for quick and concise protocol review is rising. This study undergoes a comparative study of multi-task learning (MTL) and single-task learning (STL) to classify research protocol documents. We try to carry out the classification process from the summary of health research. We represent research documents as multi-label classification problems and develop a deep learning model based on MTL and STL strategies. In our evaluation, multi-task learning achieved a better result with 0.125 loss and 0.785 Jaccard score than 0.182 and 0.720 in single-task learning. In consequence, MTL has a 27% slower computation time than STL.