A. Abdillah, Mohammad Zaenuddin Hamidi, Ratih Nur Esti Anggraeni, R. Sarno
{"title":"Comparative Study of Single-task and Multi-task Learning on Research Protocol Document Classification","authors":"A. Abdillah, Mohammad Zaenuddin Hamidi, Ratih Nur Esti Anggraeni, R. Sarno","doi":"10.1109/ICTS52701.2021.9608043","DOIUrl":null,"url":null,"abstract":"Research protocol is an important document to be scrutinized by the ethical committee. As the research proposal is growing, the necessity for quick and concise protocol review is rising. This study undergoes a comparative study of multi-task learning (MTL) and single-task learning (STL) to classify research protocol documents. We try to carry out the classification process from the summary of health research. We represent research documents as multi-label classification problems and develop a deep learning model based on MTL and STL strategies. In our evaluation, multi-task learning achieved a better result with 0.125 loss and 0.785 Jaccard score than 0.182 and 0.720 in single-task learning. In consequence, MTL has a 27% slower computation time than STL.","PeriodicalId":6738,"journal":{"name":"2021 13th International Conference on Information & Communication Technology and System (ICTS)","volume":"298 1","pages":"213-217"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 13th International Conference on Information & Communication Technology and System (ICTS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTS52701.2021.9608043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Research protocol is an important document to be scrutinized by the ethical committee. As the research proposal is growing, the necessity for quick and concise protocol review is rising. This study undergoes a comparative study of multi-task learning (MTL) and single-task learning (STL) to classify research protocol documents. We try to carry out the classification process from the summary of health research. We represent research documents as multi-label classification problems and develop a deep learning model based on MTL and STL strategies. In our evaluation, multi-task learning achieved a better result with 0.125 loss and 0.785 Jaccard score than 0.182 and 0.720 in single-task learning. In consequence, MTL has a 27% slower computation time than STL.