Haotian Hu, Alex Jie Yang, Sanhong Deng, Dongbo Wang, Min Song, Si Shen
{"title":"A Generative <scp>Drug–Drug</scp> Interaction Triplets Extraction Framework Based on Large Language Models","authors":"Haotian Hu, Alex Jie Yang, Sanhong Deng, Dongbo Wang, Min Song, Si Shen","doi":"10.1002/pra2.918","DOIUrl":null,"url":null,"abstract":"ABSTRACT Drug–Drug Interaction (DDI) may affect the activity and efficacy of drugs, potentially leading to diminished therapeutic effect or even serious side effects. Therefore, automatic recognition of drug entities and relations involved in DDI is of great significance for pharmaceutical and medical care. In this paper, we propose a generative DDI triplets extraction framework based on Large Language Models (LLMs). We comprehensively apply various training methods, such as In‐context learning, Instruction‐tuning, and Task‐tuning, to investigate the biomedical information extraction capabilities of GPT‐3, OPT, and LLaMA. We also introduce Low‐Rank Adaptation (LoRA) technology to significantly reduce trainable parameters. The proposed method achieves satisfactory results in DDI triplet extraction, and demonstrates strong generalization ability on similar corpus.","PeriodicalId":37833,"journal":{"name":"Proceedings of the Association for Information Science and Technology","volume":"185 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Association for Information Science and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/pra2.918","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 0
Abstract
ABSTRACT Drug–Drug Interaction (DDI) may affect the activity and efficacy of drugs, potentially leading to diminished therapeutic effect or even serious side effects. Therefore, automatic recognition of drug entities and relations involved in DDI is of great significance for pharmaceutical and medical care. In this paper, we propose a generative DDI triplets extraction framework based on Large Language Models (LLMs). We comprehensively apply various training methods, such as In‐context learning, Instruction‐tuning, and Task‐tuning, to investigate the biomedical information extraction capabilities of GPT‐3, OPT, and LLaMA. We also introduce Low‐Rank Adaptation (LoRA) technology to significantly reduce trainable parameters. The proposed method achieves satisfactory results in DDI triplet extraction, and demonstrates strong generalization ability on similar corpus.