Development and Validation of a META-Algorithm to Identify the Indications of Use of Biological Drugs Approved for the Treatment of Immune-Mediated Inflammatory Diseases from Claims Databases: Insights from the VALORE Project
Andrea Spini, Luca L'Abbate, Ylenia Ingrasciotta, Giorgia Pellegrini, Massimo Carollo, Valentina Ientile, Olivia Leoni, Martina Zanforlini, Domenica Ancona, Paolo Stella, Anna Cavazzana, Angela Scapin, Sara Lopes, Valeria Belleudi, Gianluca Trifirò
{"title":"Development and Validation of a META-Algorithm to Identify the Indications of Use of Biological Drugs Approved for the Treatment of Immune-Mediated Inflammatory Diseases from Claims Databases: Insights from the VALORE Project","authors":"Andrea Spini, Luca L'Abbate, Ylenia Ingrasciotta, Giorgia Pellegrini, Massimo Carollo, Valentina Ientile, Olivia Leoni, Martina Zanforlini, Domenica Ancona, Paolo Stella, Anna Cavazzana, Angela Scapin, Sara Lopes, Valeria Belleudi, Gianluca Trifirò","doi":"10.2147/clep.s445120","DOIUrl":null,"url":null,"abstract":"<strong>Purpose:</strong> This research aimed to develop and validate a META-algorithm combining individual immune-mediated inflammatory disease (IMID)-specific algorithms to identify the exact IMID indications for incident biological drug users from claims data within the context of the Italian VALORE project.<br/><strong>Methods and Patients:</strong> All subjects with at least one dispensing of TNF-alpha inhibitors, anti-interleukin agents, and selective immunosuppressants approved for IMIDs were identified from claims databases of Latium region in Italy (observation period: 2010– 2020). Validated coding algorithms for identifying individual IMIDs from claims databases were found from published literature and combined into a META-algorithm. Positive predictive value (PPV), sensitivity (Se), negative predictive value (NPV), specificity (Sp), and accuracy (Acc) were estimated for each indication against the electronic therapeutic plans (ETPs) of the Latium region as the reference standard. Lastly, the frequency of the indication of use across individual biologic drugs was compared with that reported in three other Italian regions (Lombardy, Apulia, and the Veneto region).<br/><strong>Results:</strong> In total, 9755 incident biological drug users with a single IMID indication were identified. Using the newly developed META-algorithm, an indication of use was detected in 95% (n=9255) of the total cohort. The estimated Acc, Se, Sp, PPV, and NPV, against the reference standard were as follows: 0.96, 0.86, 0.97, 0.82, and 0.98 for Crohn’s disease, 0.96, 0.80, 0.98, 0.85, and 0.97 for ulcerative colitis, 0.93, 0.76, 0.99, 0.95, and 0.92 for rheumatoid arthritis, 0.97, 0.75, 0.99, 0.85, and 0.98 for spondylarthritis, and 0.91, 0.92, 0.91, 0.88, and 0.94 for psoriatic arthritis/psoriasis, respectively. Additionally, no substantial difference was observed in the frequency of indication of use by active ingredient among Latium and the other three Italian regions included in the study.<br/><strong>Conclusion:</strong> The newly developed META-algorithm demonstrated high validity estimates in the Italian claims data and was capable of discriminating with good performance among the most frequent IMID indications.<br/><br/><strong>Plain Language Summary:</strong> In the claims database, the lack of information on the indication of use represents a well-known limitation for the conduct of observational studies. This study was conducted to develop and validate a META-algorithm that accurately identifies the exact indication for the use of biological drugs in treating various immune-mediated inflammatory diseases. Using claims databases from the Latium region, we developed and validated a META-algorithm. The META-algorithm combines disease-specific algorithms for different immune-mediated inflammatory diseases (ie, Crohn’s disease, ulcerative colitis, rheumatoid arthritis, spondyloarthritis, psoriasis, and psoriatic arthritis) and was tested against a reference standard (electronic therapeutic plans of the Lazio region). The META-algorithm reported high validity estimates and was able to distinguish with a good performance among the most frequent IMIDs as indications for use. Applying this META-algorithm may facilitate post-marketing surveillance of biological drugs such as TNF-alpha inhibitors, anti-interleukin, and selective immunosuppressants in specific therapeutic areas in an Italian setting.<br/><br/><strong>Keywords:</strong> immune-mediated inflammatory diseases, biological drugs, validation, claims data, META-algorithm, indication for use<br/>","PeriodicalId":10362,"journal":{"name":"Clinical Epidemiology","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/clep.s445120","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: This research aimed to develop and validate a META-algorithm combining individual immune-mediated inflammatory disease (IMID)-specific algorithms to identify the exact IMID indications for incident biological drug users from claims data within the context of the Italian VALORE project. Methods and Patients: All subjects with at least one dispensing of TNF-alpha inhibitors, anti-interleukin agents, and selective immunosuppressants approved for IMIDs were identified from claims databases of Latium region in Italy (observation period: 2010– 2020). Validated coding algorithms for identifying individual IMIDs from claims databases were found from published literature and combined into a META-algorithm. Positive predictive value (PPV), sensitivity (Se), negative predictive value (NPV), specificity (Sp), and accuracy (Acc) were estimated for each indication against the electronic therapeutic plans (ETPs) of the Latium region as the reference standard. Lastly, the frequency of the indication of use across individual biologic drugs was compared with that reported in three other Italian regions (Lombardy, Apulia, and the Veneto region). Results: In total, 9755 incident biological drug users with a single IMID indication were identified. Using the newly developed META-algorithm, an indication of use was detected in 95% (n=9255) of the total cohort. The estimated Acc, Se, Sp, PPV, and NPV, against the reference standard were as follows: 0.96, 0.86, 0.97, 0.82, and 0.98 for Crohn’s disease, 0.96, 0.80, 0.98, 0.85, and 0.97 for ulcerative colitis, 0.93, 0.76, 0.99, 0.95, and 0.92 for rheumatoid arthritis, 0.97, 0.75, 0.99, 0.85, and 0.98 for spondylarthritis, and 0.91, 0.92, 0.91, 0.88, and 0.94 for psoriatic arthritis/psoriasis, respectively. Additionally, no substantial difference was observed in the frequency of indication of use by active ingredient among Latium and the other three Italian regions included in the study. Conclusion: The newly developed META-algorithm demonstrated high validity estimates in the Italian claims data and was capable of discriminating with good performance among the most frequent IMID indications.
Plain Language Summary: In the claims database, the lack of information on the indication of use represents a well-known limitation for the conduct of observational studies. This study was conducted to develop and validate a META-algorithm that accurately identifies the exact indication for the use of biological drugs in treating various immune-mediated inflammatory diseases. Using claims databases from the Latium region, we developed and validated a META-algorithm. The META-algorithm combines disease-specific algorithms for different immune-mediated inflammatory diseases (ie, Crohn’s disease, ulcerative colitis, rheumatoid arthritis, spondyloarthritis, psoriasis, and psoriatic arthritis) and was tested against a reference standard (electronic therapeutic plans of the Lazio region). The META-algorithm reported high validity estimates and was able to distinguish with a good performance among the most frequent IMIDs as indications for use. Applying this META-algorithm may facilitate post-marketing surveillance of biological drugs such as TNF-alpha inhibitors, anti-interleukin, and selective immunosuppressants in specific therapeutic areas in an Italian setting.
Keywords: immune-mediated inflammatory diseases, biological drugs, validation, claims data, META-algorithm, indication for use
期刊介绍:
Clinical Epidemiology is an international, peer reviewed, open access journal. Clinical Epidemiology focuses on the application of epidemiological principles and questions relating to patients and clinical care in terms of prevention, diagnosis, prognosis, and treatment.
Clinical Epidemiology welcomes papers covering these topics in form of original research and systematic reviews.
Clinical Epidemiology has a special interest in international electronic medical patient records and other routine health care data, especially as applied to safety of medical interventions, clinical utility of diagnostic procedures, understanding short- and long-term clinical course of diseases, clinical epidemiological and biostatistical methods, and systematic reviews.
When considering submission of a paper utilizing publicly-available data, authors should ensure that such studies add significantly to the body of knowledge and that they use appropriate validated methods for identifying health outcomes.
The journal has launched special series describing existing data sources for clinical epidemiology, international health care systems and validation studies of algorithms based on databases and registries.