Pub Date : 2023-02-07DOI: 10.1186/s41512-023-00141-5
Mie Sylow Liljendahl, Nikolai Loft, Alexander Egeberg, Lone Skov, Tri-Long Nguyen
Background: While administrative health records such as national registries may be useful data sources to study the epidemiology of psoriasis, they do not generally contain information on disease severity.
Objectives: To develop a diagnostic model to distinguish psoriasis severity based on administrative register data.
Method: We conducted a retrospective registry-based cohort study using the Danish Skin Cohort linked with the Danish national registries. We developed a diagnostic model using a gradient boosting machine learning technique to predict moderate-to-severe psoriasis. We performed an internal validation of the model by bootstrapping to account for any optimism.
Results: Among 4016 adult psoriasis patients (55.8% women, mean age 59 years) included in this study, 1212 (30.2%) patients were identified as having moderate-to-severe psoriasis. The diagnostic prediction model yielded a bootstrap-corrected discrimination performance: c-statistic equal to 0.73 [95% CI: 0.71-0.74]. The internal validation by bootstrap correction showed no substantial optimism in the results with a c-statistic of 0.72 [95% CI: 0.70-0.74]. A bootstrap-corrected slope of 1.10 [95% CI: 1.07-1.13] indicated a slight under-fitting.
Conclusion: Based on register data, we developed a gradient boosting diagnostic model returning acceptable prediction of patients with moderate-to-severe psoriasis.
{"title":"Development and internal validation of a diagnostic prediction model for psoriasis severity.","authors":"Mie Sylow Liljendahl, Nikolai Loft, Alexander Egeberg, Lone Skov, Tri-Long Nguyen","doi":"10.1186/s41512-023-00141-5","DOIUrl":"https://doi.org/10.1186/s41512-023-00141-5","url":null,"abstract":"<p><strong>Background: </strong>While administrative health records such as national registries may be useful data sources to study the epidemiology of psoriasis, they do not generally contain information on disease severity.</p><p><strong>Objectives: </strong>To develop a diagnostic model to distinguish psoriasis severity based on administrative register data.</p><p><strong>Method: </strong>We conducted a retrospective registry-based cohort study using the Danish Skin Cohort linked with the Danish national registries. We developed a diagnostic model using a gradient boosting machine learning technique to predict moderate-to-severe psoriasis. We performed an internal validation of the model by bootstrapping to account for any optimism.</p><p><strong>Results: </strong>Among 4016 adult psoriasis patients (55.8% women, mean age 59 years) included in this study, 1212 (30.2%) patients were identified as having moderate-to-severe psoriasis. The diagnostic prediction model yielded a bootstrap-corrected discrimination performance: c-statistic equal to 0.73 [95% CI: 0.71-0.74]. The internal validation by bootstrap correction showed no substantial optimism in the results with a c-statistic of 0.72 [95% CI: 0.70-0.74]. A bootstrap-corrected slope of 1.10 [95% CI: 1.07-1.13] indicated a slight under-fitting.</p><p><strong>Conclusion: </strong>Based on register data, we developed a gradient boosting diagnostic model returning acceptable prediction of patients with moderate-to-severe psoriasis.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"7 1","pages":"2"},"PeriodicalIF":0.0,"publicationDate":"2023-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9903561/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10674399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-31DOI: 10.1186/s41512-023-00142-4
Frank Ssedyabane, Nixon Niyonzima, Joseph Ngonzi, Deusdedit Tusubira, Moses Ocan, Dickens Akena, Eve Namisango, Robert Apunyo, Alison Annet Kinengyere, Ekwaro A Obuku
Background: Cervical cancer remains a public health problem worldwide, especially in sub-Saharan Africa. There are challenges in timely screening and diagnosis for early detection and intervention. Therefore, studies on cervical cancer and cervical intraepithelial neoplasia suggest the need for new diagnostic approaches including microRNA technology. Plasma/serum levels of microRNAs are elevated or reduced compared to the normal state and their diagnostic accuracy for detection of cervical neoplasms has not been rigorously assessed more so in low-resource settings such as Uganda. The aim of this systematic review was therefore to assess the diagnostic accuracy of serum microRNAs in detecting cervical cancer.
Methods: We will perform a systematic review following the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) statement. We will search for all articles in MEDLINE/PubMed, Web of Science, Embase, and CINAHL, as well as grey literature from 2012 to 2022. Our outcomes will be sensitivity, specificity, negative predictive values, positive predictive values or area under the curve (Nagamitsu et al, Mol Clin Oncol 5:189-94, 2016) for each microRNA or microRNA panel. We will use the quality assessment of diagnostic accuracy studies (Whiting et al, Ann Intern Med 155:529-36, 2011) tool to assess the risk of bias of included studies. Our results will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Diagnostic Test Accuracy studies (PRISMA-DTA). We will summarise studies in a flow chart and then describe them using a structured narrative synthesis. If possible, we shall use the Lehmann model bivariate approach for the meta analysis USE OF THE REVIEW RESULTS: This systematic review will provide information on the relevance of microRNAs in cervical cancer. This information will help policy makers, planners and researchers in determining which particular microRNAs could be employed to screen or diagnose cancer of the cervix.
Systematic review registration: This protocol has been registered in PROSPERO under registration number CRD42022313275.
背景:子宫颈癌仍然是世界范围内的一个公共卫生问题,特别是在撒哈拉以南非洲。在及时筛查和诊断以早期发现和干预方面存在挑战。因此,对宫颈癌和宫颈上皮内瘤变的研究提示需要新的诊断方法,包括microRNA技术。与正常状态相比,血浆/血清microrna水平升高或降低,并且在诸如乌干达等资源匮乏的环境中,其检测宫颈肿瘤的诊断准确性尚未得到严格评估。因此,本系统综述的目的是评估血清microrna检测宫颈癌的诊断准确性。方法:我们将按照系统评价和荟萃分析方案的首选报告项目(PRISMA-P)声明进行系统评价。我们将检索MEDLINE/PubMed、Web of Science、Embase和CINAHL中的所有文章,以及2012年至2022年的灰色文献。我们的结果将是每个microRNA或microRNA面板的敏感性、特异性、阴性预测值、阳性预测值或曲线下面积(Nagamitsu等人,Mol clinoncol 5:19 9-94, 2016)。我们将使用诊断准确性研究的质量评估(Whiting et al ., Ann Intern Med 155:529- 36,2011)工具来评估纳入研究的偏倚风险。我们的结果将根据诊断测试准确性研究系统评价和荟萃分析的首选报告项目(PRISMA-DTA)进行报告。我们将在流程图中总结研究,然后使用结构化的叙事综合来描述它们。如果可能的话,我们将使用Lehmann模型双变量方法进行meta分析。综述结果:本系统综述将提供microrna在宫颈癌中的相关性信息。这些信息将有助于决策者、计划者和研究人员确定哪些特定的microrna可以用于筛查或诊断宫颈癌。系统评价注册:本方案已在PROSPERO注册,注册号为CRD42022313275。
{"title":"The diagnostic accuracy of serum microRNAs in detection of cervical cancer: a systematic review protocol.","authors":"Frank Ssedyabane, Nixon Niyonzima, Joseph Ngonzi, Deusdedit Tusubira, Moses Ocan, Dickens Akena, Eve Namisango, Robert Apunyo, Alison Annet Kinengyere, Ekwaro A Obuku","doi":"10.1186/s41512-023-00142-4","DOIUrl":"https://doi.org/10.1186/s41512-023-00142-4","url":null,"abstract":"<p><strong>Background: </strong>Cervical cancer remains a public health problem worldwide, especially in sub-Saharan Africa. There are challenges in timely screening and diagnosis for early detection and intervention. Therefore, studies on cervical cancer and cervical intraepithelial neoplasia suggest the need for new diagnostic approaches including microRNA technology. Plasma/serum levels of microRNAs are elevated or reduced compared to the normal state and their diagnostic accuracy for detection of cervical neoplasms has not been rigorously assessed more so in low-resource settings such as Uganda. The aim of this systematic review was therefore to assess the diagnostic accuracy of serum microRNAs in detecting cervical cancer.</p><p><strong>Methods: </strong>We will perform a systematic review following the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) statement. We will search for all articles in MEDLINE/PubMed, Web of Science, Embase, and CINAHL, as well as grey literature from 2012 to 2022. Our outcomes will be sensitivity, specificity, negative predictive values, positive predictive values or area under the curve (Nagamitsu et al, Mol Clin Oncol 5:189-94, 2016) for each microRNA or microRNA panel. We will use the quality assessment of diagnostic accuracy studies (Whiting et al, Ann Intern Med 155:529-36, 2011) tool to assess the risk of bias of included studies. Our results will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Diagnostic Test Accuracy studies (PRISMA-DTA). We will summarise studies in a flow chart and then describe them using a structured narrative synthesis. If possible, we shall use the Lehmann model bivariate approach for the meta analysis USE OF THE REVIEW RESULTS: This systematic review will provide information on the relevance of microRNAs in cervical cancer. This information will help policy makers, planners and researchers in determining which particular microRNAs could be employed to screen or diagnose cancer of the cervix.</p><p><strong>Systematic review registration: </strong>This protocol has been registered in PROSPERO under registration number CRD42022313275.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"7 1","pages":"4"},"PeriodicalIF":0.0,"publicationDate":"2023-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9887905/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9472616","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-10DOI: 10.1186/s41512-022-00138-6
Pradeep S Virdee, Clare Bankhead, Constantinos Koshiaris, Cynthia Wright Drakesmith, Jason Oke, Diana Withrow, Subhashisa Swain, Kiana Collins, Lara Chammas, Andres Tamm, Tingting Zhu, Eva Morris, Tim Holt, Jacqueline Birks, Rafael Perera, F D Richard Hobbs, Brian D Nicholson
Background: Simple blood tests can play an important role in identifying patients for cancer investigation. The current evidence base is limited almost entirely to tests used in isolation. However, recent evidence suggests combining multiple types of blood tests and investigating trends in blood test results over time could be more useful to select patients for further cancer investigation. Such trends could increase cancer yield and reduce unnecessary referrals. We aim to explore whether trends in blood test results are more useful than symptoms or single blood test results in selecting primary care patients for cancer investigation. We aim to develop clinical prediction models that incorporate trends in blood tests to identify the risk of cancer.
Methods: Primary care electronic health record data from the English Clinical Practice Research Datalink Aurum primary care database will be accessed and linked to cancer registrations and secondary care datasets. Using a cohort study design, we will describe patterns in blood testing (aim 1) and explore associations between covariates and trends in blood tests with cancer using mixed-effects, Cox, and dynamic models (aim 2). To build the predictive models for the risk of cancer, we will use dynamic risk modelling (such as multivariate joint modelling) and machine learning, incorporating simultaneous trends in multiple blood tests, together with other covariates (aim 3). Model performance will be assessed using various performance measures, including c-statistic and calibration plots.
Discussion: These models will form decision rules to help general practitioners find patients who need a referral for further investigation of cancer. This could increase cancer yield, reduce unnecessary referrals, and give more patients the opportunity for treatment and improved outcomes.
{"title":"BLOod Test Trend for cancEr Detection (BLOTTED): protocol for an observational and prediction model development study using English primary care electronic health record data.","authors":"Pradeep S Virdee, Clare Bankhead, Constantinos Koshiaris, Cynthia Wright Drakesmith, Jason Oke, Diana Withrow, Subhashisa Swain, Kiana Collins, Lara Chammas, Andres Tamm, Tingting Zhu, Eva Morris, Tim Holt, Jacqueline Birks, Rafael Perera, F D Richard Hobbs, Brian D Nicholson","doi":"10.1186/s41512-022-00138-6","DOIUrl":"https://doi.org/10.1186/s41512-022-00138-6","url":null,"abstract":"<p><strong>Background: </strong>Simple blood tests can play an important role in identifying patients for cancer investigation. The current evidence base is limited almost entirely to tests used in isolation. However, recent evidence suggests combining multiple types of blood tests and investigating trends in blood test results over time could be more useful to select patients for further cancer investigation. Such trends could increase cancer yield and reduce unnecessary referrals. We aim to explore whether trends in blood test results are more useful than symptoms or single blood test results in selecting primary care patients for cancer investigation. We aim to develop clinical prediction models that incorporate trends in blood tests to identify the risk of cancer.</p><p><strong>Methods: </strong>Primary care electronic health record data from the English Clinical Practice Research Datalink Aurum primary care database will be accessed and linked to cancer registrations and secondary care datasets. Using a cohort study design, we will describe patterns in blood testing (aim 1) and explore associations between covariates and trends in blood tests with cancer using mixed-effects, Cox, and dynamic models (aim 2). To build the predictive models for the risk of cancer, we will use dynamic risk modelling (such as multivariate joint modelling) and machine learning, incorporating simultaneous trends in multiple blood tests, together with other covariates (aim 3). Model performance will be assessed using various performance measures, including c-statistic and calibration plots.</p><p><strong>Discussion: </strong>These models will form decision rules to help general practitioners find patients who need a referral for further investigation of cancer. This could increase cancer yield, reduce unnecessary referrals, and give more patients the opportunity for treatment and improved outcomes.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"7 1","pages":"1"},"PeriodicalIF":0.0,"publicationDate":"2023-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9830700/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10624854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-22DOI: 10.1186/s41512-022-00136-8
Matthew Sperrin, Richard D Riley, Gary S Collins, Glen P Martin
Clinical prediction models must be appropriately validated before they can be used. While validation studies are sometimes carefully designed to match an intended population/setting of the model, it is common for validation studies to take place with arbitrary datasets, chosen for convenience rather than relevance. We call estimating how well a model performs within the intended population/setting "targeted validation". Use of this term sharpens the focus on the intended use of a model, which may increase the applicability of developed models, avoid misleading conclusions, and reduce research waste. It also exposes that external validation may not be required when the intended population for the model matches the population used to develop the model; here, a robust internal validation may be sufficient, especially if the development dataset was large.
{"title":"Targeted validation: validating clinical prediction models in their intended population and setting.","authors":"Matthew Sperrin, Richard D Riley, Gary S Collins, Glen P Martin","doi":"10.1186/s41512-022-00136-8","DOIUrl":"10.1186/s41512-022-00136-8","url":null,"abstract":"<p><p>Clinical prediction models must be appropriately validated before they can be used. While validation studies are sometimes carefully designed to match an intended population/setting of the model, it is common for validation studies to take place with arbitrary datasets, chosen for convenience rather than relevance. We call estimating how well a model performs within the intended population/setting \"targeted validation\". Use of this term sharpens the focus on the intended use of a model, which may increase the applicability of developed models, avoid misleading conclusions, and reduce research waste. It also exposes that external validation may not be required when the intended population for the model matches the population used to develop the model; here, a robust internal validation may be sufficient, especially if the development dataset was large.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"6 1","pages":"24"},"PeriodicalIF":0.0,"publicationDate":"2022-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9773429/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10415716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-12-19DOI: 10.1186/s41512-022-00137-7
Steven Wambua, Francesca Crowe, Shakila Thangaratinam, Dermot O'Reilly, Colin McCowan, Sinead Brophy, Christopher Yau, Krishnarajah Nirantharakumar, Richard Riley
Background: Cardiovascular disease (CVD) is a leading cause of death among women. CVD is associated with reduced quality of life, significant treatment and management costs, and lost productivity. Estimating the risk of CVD would help patients at a higher risk of CVD to initiate preventive measures to reduce risk of disease. The Framingham risk score and the QRISK® score are two risk prediction models used to evaluate future CVD risk in the UK. Although the algorithms perform well in the general population, they do not take into account pregnancy complications, which are well known risk factors for CVD in women and have been highlighted in a recent umbrella review. We plan to develop a robust CVD risk prediction model to assess the additional value of pregnancy risk factors in risk prediction of CVD in women postpartum.
Methods: Using candidate predictors from QRISK®-3, the umbrella review identified from literature and from discussions with clinical experts and patient research partners, we will use time-to-event Cox proportional hazards models to develop and validate a 10-year risk prediction model for CVD postpartum using Clinical Practice Research Datalink (CPRD) primary care database for development and internal validation of the algorithm and the Secure Anonymised Information Linkage (SAIL) databank for external validation. We will then assess the value of additional candidate predictors to the QRISK®-3 in our internal and external validations.
Discussion: The developed risk prediction model will incorporate pregnancy-related factors which have been shown to be associated with future risk of CVD but have not been taken into account in current risk prediction models. Our study will therefore highlight the importance of incorporating pregnancy-related risk factors into risk prediction modeling for CVD postpartum.
{"title":"Protocol for development and validation of postpartum cardiovascular disease (CVD) risk prediction model incorporating reproductive and pregnancy-related candidate predictors.","authors":"Steven Wambua, Francesca Crowe, Shakila Thangaratinam, Dermot O'Reilly, Colin McCowan, Sinead Brophy, Christopher Yau, Krishnarajah Nirantharakumar, Richard Riley","doi":"10.1186/s41512-022-00137-7","DOIUrl":"10.1186/s41512-022-00137-7","url":null,"abstract":"<p><strong>Background: </strong>Cardiovascular disease (CVD) is a leading cause of death among women. CVD is associated with reduced quality of life, significant treatment and management costs, and lost productivity. Estimating the risk of CVD would help patients at a higher risk of CVD to initiate preventive measures to reduce risk of disease. The Framingham risk score and the QRISK® score are two risk prediction models used to evaluate future CVD risk in the UK. Although the algorithms perform well in the general population, they do not take into account pregnancy complications, which are well known risk factors for CVD in women and have been highlighted in a recent umbrella review. We plan to develop a robust CVD risk prediction model to assess the additional value of pregnancy risk factors in risk prediction of CVD in women postpartum.</p><p><strong>Methods: </strong>Using candidate predictors from QRISK®-3, the umbrella review identified from literature and from discussions with clinical experts and patient research partners, we will use time-to-event Cox proportional hazards models to develop and validate a 10-year risk prediction model for CVD postpartum using Clinical Practice Research Datalink (CPRD) primary care database for development and internal validation of the algorithm and the Secure Anonymised Information Linkage (SAIL) databank for external validation. We will then assess the value of additional candidate predictors to the QRISK®-3 in our internal and external validations.</p><p><strong>Discussion: </strong>The developed risk prediction model will incorporate pregnancy-related factors which have been shown to be associated with future risk of CVD but have not been taken into account in current risk prediction models. Our study will therefore highlight the importance of incorporating pregnancy-related risk factors into risk prediction modeling for CVD postpartum.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"6 1","pages":"23"},"PeriodicalIF":0.0,"publicationDate":"2022-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9761974/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9107521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-17DOI: 10.1186/s41512-022-00135-9
Manja Deforth, Caroline E Gebhard, Susan Bengs, Philipp K Buehler, Reto A Schuepbach, Annelies S Zinkernagel, Silvio D Brugger, Claudio T Acevedo, Dimitri Patriki, Benedikt Wiggli, Raphael Twerenbold, Gabriela M Kuster, Hans Pargger, Joerg C Schefold, Thibaud Spinetti, Pedro D Wendel-Garcia, Daniel A Hofmaenner, Bianca Gysi, Martin Siegemund, Georg Heinze, Vera Regitz-Zagrosek, Catherine Gebhard, Ulrike Held
Background: The coronavirus disease 2019 (COVID-19) pandemic demands reliable prognostic models for estimating the risk of long COVID. We developed and validated a prediction model to estimate the probability of known common long COVID symptoms at least 60 days after acute COVID-19.
Methods: The prognostic model was built based on data from a multicentre prospective Swiss cohort study. Included were adult patients diagnosed with COVID-19 between February and December 2020 and treated as outpatients, at ward or intensive/intermediate care unit. Perceived long-term health impairments, including reduced exercise tolerance/reduced resilience, shortness of breath and/or tiredness (REST), were assessed after a follow-up time between 60 and 425 days. The data set was split into a derivation and a geographical validation cohort. Predictors were selected out of twelve candidate predictors based on three methods, namely the augmented backward elimination (ABE) method, the adaptive best-subset selection (ABESS) method and model-based recursive partitioning (MBRP) approach. Model performance was assessed with the scaled Brier score, concordance c statistic and calibration plot. The final prognostic model was determined based on best model performance.
Results: In total, 2799 patients were included in the analysis, of which 1588 patients were in the derivation cohort and 1211 patients in the validation cohort. The REST prevalence was similar between the cohorts with 21.6% (n = 343) in the derivation cohort and 22.1% (n = 268) in the validation cohort. The same predictors were selected with the ABE and ABESS approach. The final prognostic model was based on the ABE and ABESS selected predictors. The corresponding scaled Brier score in the validation cohort was 18.74%, model discrimination was 0.78 (95% CI: 0.75 to 0.81), calibration slope was 0.92 (95% CI: 0.78 to 1.06) and calibration intercept was -0.06 (95% CI: -0.22 to 0.09).
Conclusion: The proposed model was validated to identify COVID-19-infected patients at high risk for REST symptoms. Before implementing the prognostic model in daily clinical practice, the conduct of an impact study is recommended.
{"title":"Development and validation of a prognostic model for the early identification of COVID-19 patients at risk of developing common long COVID symptoms.","authors":"Manja Deforth, Caroline E Gebhard, Susan Bengs, Philipp K Buehler, Reto A Schuepbach, Annelies S Zinkernagel, Silvio D Brugger, Claudio T Acevedo, Dimitri Patriki, Benedikt Wiggli, Raphael Twerenbold, Gabriela M Kuster, Hans Pargger, Joerg C Schefold, Thibaud Spinetti, Pedro D Wendel-Garcia, Daniel A Hofmaenner, Bianca Gysi, Martin Siegemund, Georg Heinze, Vera Regitz-Zagrosek, Catherine Gebhard, Ulrike Held","doi":"10.1186/s41512-022-00135-9","DOIUrl":"https://doi.org/10.1186/s41512-022-00135-9","url":null,"abstract":"<p><strong>Background: </strong>The coronavirus disease 2019 (COVID-19) pandemic demands reliable prognostic models for estimating the risk of long COVID. We developed and validated a prediction model to estimate the probability of known common long COVID symptoms at least 60 days after acute COVID-19.</p><p><strong>Methods: </strong>The prognostic model was built based on data from a multicentre prospective Swiss cohort study. Included were adult patients diagnosed with COVID-19 between February and December 2020 and treated as outpatients, at ward or intensive/intermediate care unit. Perceived long-term health impairments, including reduced exercise tolerance/reduced resilience, shortness of breath and/or tiredness (REST), were assessed after a follow-up time between 60 and 425 days. The data set was split into a derivation and a geographical validation cohort. Predictors were selected out of twelve candidate predictors based on three methods, namely the augmented backward elimination (ABE) method, the adaptive best-subset selection (ABESS) method and model-based recursive partitioning (MBRP) approach. Model performance was assessed with the scaled Brier score, concordance c statistic and calibration plot. The final prognostic model was determined based on best model performance.</p><p><strong>Results: </strong>In total, 2799 patients were included in the analysis, of which 1588 patients were in the derivation cohort and 1211 patients in the validation cohort. The REST prevalence was similar between the cohorts with 21.6% (n = 343) in the derivation cohort and 22.1% (n = 268) in the validation cohort. The same predictors were selected with the ABE and ABESS approach. The final prognostic model was based on the ABE and ABESS selected predictors. The corresponding scaled Brier score in the validation cohort was 18.74%, model discrimination was 0.78 (95% CI: 0.75 to 0.81), calibration slope was 0.92 (95% CI: 0.78 to 1.06) and calibration intercept was -0.06 (95% CI: -0.22 to 0.09).</p><p><strong>Conclusion: </strong>The proposed model was validated to identify COVID-19-infected patients at high risk for REST symptoms. Before implementing the prognostic model in daily clinical practice, the conduct of an impact study is recommended.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":" ","pages":"22"},"PeriodicalIF":0.0,"publicationDate":"2022-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9668400/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40478436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: Schizophrenia is a severe mental illness characterized by recurrent psychoses that typically waxes and wanes through its prodromal, acute, and chronic phases. A large amount of research on individual prognostic factors for relapse in people with schizophrenia has been published, and a few logistic models exist to predict psychotic prognosis for people in the prodromal phase or after the first episode of psychosis. However, research on prediction models for people with schizophrenia, including those in the chronic phase and after multiple recurrences, is scarce. We aim to develop and validate a prediction model for this population.
Methods: This is a retrospective cohort study to be undertaken in Japan. We will include participants aged 18 years or above, diagnosed with schizophrenia or related disorders, and discharged between January 2014 and December 2018 from one of the acute inpatient care wards of three geographically distinct psychiatric hospitals. We will collect pre-specified nine predictors at the time of recruitment, follow up the participants for 12 months after discharge, and observe whether our primary outcome of a relapse occurs. Relapse will be considered to have occurred in one of the following circumstances: (1) hospitalization; (2) psychiatrist's judgment that the person needs hospitalization; (3) increasing doses of antipsychotics; or (4) suicidal or homicidal ideation or behavior resulting from such ideation. We will develop a Cox regression model and avoid overfitting by penalizing coefficients using the elastic net. The model will be validated both internally and externally by bootstrapping and "leave-one-hospital-out" cross-validation, respectively. We will evaluate the model's performance in terms of discrimination and calibration. Decision curve analysis will be presented to aid decision-making. We will present a web application to visualize the model for ease of use in daily practice.
Discussion: This will be the first prediction modeling study of relapse after discharge among people with both first and multiple episodes of schizophrenia using routinely collected data.
Trial registration: This study was registered in the UMIN-CTR (UMIN000043345) on February 20, 2021.
{"title":"Psychotic relapse in people with schizophrenia within 12 months of discharge from acute inpatient care: protocol for development and validation of a prediction model based on a retrospective cohort study in three psychiatric hospitals in Japan.","authors":"Akira Sato, Norio Watanabe, Kazushi Maruo, Toshihiro Moriyama, Toshi A Furukawa","doi":"10.1186/s41512-022-00134-w","DOIUrl":"10.1186/s41512-022-00134-w","url":null,"abstract":"<p><strong>Background: </strong>Schizophrenia is a severe mental illness characterized by recurrent psychoses that typically waxes and wanes through its prodromal, acute, and chronic phases. A large amount of research on individual prognostic factors for relapse in people with schizophrenia has been published, and a few logistic models exist to predict psychotic prognosis for people in the prodromal phase or after the first episode of psychosis. However, research on prediction models for people with schizophrenia, including those in the chronic phase and after multiple recurrences, is scarce. We aim to develop and validate a prediction model for this population.</p><p><strong>Methods: </strong>This is a retrospective cohort study to be undertaken in Japan. We will include participants aged 18 years or above, diagnosed with schizophrenia or related disorders, and discharged between January 2014 and December 2018 from one of the acute inpatient care wards of three geographically distinct psychiatric hospitals. We will collect pre-specified nine predictors at the time of recruitment, follow up the participants for 12 months after discharge, and observe whether our primary outcome of a relapse occurs. Relapse will be considered to have occurred in one of the following circumstances: (1) hospitalization; (2) psychiatrist's judgment that the person needs hospitalization; (3) increasing doses of antipsychotics; or (4) suicidal or homicidal ideation or behavior resulting from such ideation. We will develop a Cox regression model and avoid overfitting by penalizing coefficients using the elastic net. The model will be validated both internally and externally by bootstrapping and \"leave-one-hospital-out\" cross-validation, respectively. We will evaluate the model's performance in terms of discrimination and calibration. Decision curve analysis will be presented to aid decision-making. We will present a web application to visualize the model for ease of use in daily practice.</p><p><strong>Discussion: </strong>This will be the first prediction modeling study of relapse after discharge among people with both first and multiple episodes of schizophrenia using routinely collected data.</p><p><strong>Trial registration: </strong>This study was registered in the UMIN-CTR (UMIN000043345) on February 20, 2021.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":" ","pages":"20"},"PeriodicalIF":0.0,"publicationDate":"2022-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9629881/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40661561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-10-20DOI: 10.1186/s41512-022-00133-x
Weiqi Liao, Peter Jepsen, Carol Coupland, Hamish Innes, Philippa C Matthews, Cori Campbell, Eleanor Barnes, Julia Hippisley-Cox
Background and research aim: The incidence and mortality of liver cancer have been increasing in the UK in recent years. However, liver cancer is still under-studied. The Early Detection of Hepatocellular Liver Cancer (DeLIVER-QResearch) project aims to address the research gap and generate new knowledge to improve early detection and diagnosis of primary liver cancer from general practice and at the population level. There are three research objectives: (1) to understand the current epidemiology of primary liver cancer in England, (2) to identify and quantify the symptoms and comorbidities associated with liver cancer, and (3) to develop and validate prediction models for early detection of liver cancer suitable for implementation in clinical settings.
Methods: This population-based study uses the QResearch® database (version 46) and includes adult patients aged 25-84 years old and without a diagnosis of liver cancer at the cohort entry (study period: 1 January 2008-30 June 2021). The team conducted a literature review (with additional clinical input) to inform the inclusion of variables for data extraction from the QResearch database. A wide range of statistical techniques will be used for the three research objectives, including descriptive statistics, multiple imputation for missing data, conditional logistic regression to investigate the association between the clinical features (symptoms and comorbidities) and the outcome, fractional polynomial terms to explore the non-linear relationship between continuous variables and the outcome, and Cox/competing risk regression for the prediction model. We have a specific focus on the 1-year, 5-year, and 10-year absolute risks of developing liver cancer, as risks at different time points have different clinical implications. The internal-external cross-validation approach will be used, and the discrimination and calibration of the prediction model will be evaluated.
Discussion: The DeLIVER-QResearch project uses large-scale representative population-based data to address the most relevant research questions for early detection and diagnosis of primary liver cancer in England. This project has great potential to inform the national cancer strategic plan and yield substantial public and societal benefits.
{"title":"Development and validation of personalised risk prediction models for early detection and diagnosis of primary liver cancer among the English primary care population using the QResearch® database: research protocol and statistical analysis plan.","authors":"Weiqi Liao, Peter Jepsen, Carol Coupland, Hamish Innes, Philippa C Matthews, Cori Campbell, Eleanor Barnes, Julia Hippisley-Cox","doi":"10.1186/s41512-022-00133-x","DOIUrl":"10.1186/s41512-022-00133-x","url":null,"abstract":"<p><strong>Background and research aim: </strong>The incidence and mortality of liver cancer have been increasing in the UK in recent years. However, liver cancer is still under-studied. The Early Detection of Hepatocellular Liver Cancer (DeLIVER-QResearch) project aims to address the research gap and generate new knowledge to improve early detection and diagnosis of primary liver cancer from general practice and at the population level. There are three research objectives: (1) to understand the current epidemiology of primary liver cancer in England, (2) to identify and quantify the symptoms and comorbidities associated with liver cancer, and (3) to develop and validate prediction models for early detection of liver cancer suitable for implementation in clinical settings.</p><p><strong>Methods: </strong>This population-based study uses the QResearch® database (version 46) and includes adult patients aged 25-84 years old and without a diagnosis of liver cancer at the cohort entry (study period: 1 January 2008-30 June 2021). The team conducted a literature review (with additional clinical input) to inform the inclusion of variables for data extraction from the QResearch database. A wide range of statistical techniques will be used for the three research objectives, including descriptive statistics, multiple imputation for missing data, conditional logistic regression to investigate the association between the clinical features (symptoms and comorbidities) and the outcome, fractional polynomial terms to explore the non-linear relationship between continuous variables and the outcome, and Cox/competing risk regression for the prediction model. We have a specific focus on the 1-year, 5-year, and 10-year absolute risks of developing liver cancer, as risks at different time points have different clinical implications. The internal-external cross-validation approach will be used, and the discrimination and calibration of the prediction model will be evaluated.</p><p><strong>Discussion: </strong>The DeLIVER-QResearch project uses large-scale representative population-based data to address the most relevant research questions for early detection and diagnosis of primary liver cancer in England. This project has great potential to inform the national cancer strategic plan and yield substantial public and societal benefits.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"6 1","pages":"21"},"PeriodicalIF":0.0,"publicationDate":"2022-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9583476/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9477450","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-10-06DOI: 10.1186/s41512-022-00132-y
Margarita Karageorgou, David M Hughes, Arthur Sun Myint, D Mark Pritchard, Laura J Bonnett
Background: Rectal cancer has a high prevalence. The standard of care for management of localised disease involves major surgery and/or chemoradiotherapy, but these modalities are sometimes associated with mortality and morbidity. The notion of 'watch and wait' has therefore emerged and offers an organ-sparing approach to patients after administering a less invasive initial treatment, such as X-ray brachytherapy (Papillon technique). It is thus important to evaluate how likely patients are to respond to such therapies, to develop patient-tailored treatment pathways. We propose a systematic review to identify published clinical prediction models of the response of rectal cancer to treatment that includes radiotherapy and here present our protocol.
Methods: Included studies will develop multivariable clinical prediction models which assess response to treatment and overall survival of adult patients who have been diagnosed with any stage of rectal cancer and have received radiotherapy treatment with curative intent. Cohort studies and randomised controlled trials will be included. The primary outcome will be the occurrence of salvage surgery at 1 year after treatment. Secondary outcomes include salavage surgery at at any reported time point, the predictive accuracy of models, the quality of the developed models and the feasibility of using the model in clinical practice. Ovid MEDLINE, PubMed, Cochrane Library, EMBASE and CINAHL will be searched from inception to 24 February 2022. Keywords and phrases related to rectal cancer, radiotherapy and prediction models will be used. Studies will be selected once the deduplication, title, abstract and full-text screening process have been completed by two independent reviewers. The PRISMA-P checklist will be followed. A third reviewer will resolve any disagreement. The data extraction form will be pilot-tested using a representative 5% sample of the studies reviewed. The CHARMS checklist will be implemented. Risk of bias in each study will be assessed using the PROBAST tool. A narrative synthesis will be performed and if sufficient data are identified, meta-analysis will be undertaken as described in Debray et al. DISCUSSION: This systematic review will identify factors that predict response to the treatment protocol. Any gaps for potential development of new clinical prediction models will be highlighted.
{"title":"Clinical prediction models assessing response to radiotherapy for rectal cancer: protocol for a systematic review.","authors":"Margarita Karageorgou, David M Hughes, Arthur Sun Myint, D Mark Pritchard, Laura J Bonnett","doi":"10.1186/s41512-022-00132-y","DOIUrl":"https://doi.org/10.1186/s41512-022-00132-y","url":null,"abstract":"<p><strong>Background: </strong>Rectal cancer has a high prevalence. The standard of care for management of localised disease involves major surgery and/or chemoradiotherapy, but these modalities are sometimes associated with mortality and morbidity. The notion of 'watch and wait' has therefore emerged and offers an organ-sparing approach to patients after administering a less invasive initial treatment, such as X-ray brachytherapy (Papillon technique). It is thus important to evaluate how likely patients are to respond to such therapies, to develop patient-tailored treatment pathways. We propose a systematic review to identify published clinical prediction models of the response of rectal cancer to treatment that includes radiotherapy and here present our protocol.</p><p><strong>Methods: </strong>Included studies will develop multivariable clinical prediction models which assess response to treatment and overall survival of adult patients who have been diagnosed with any stage of rectal cancer and have received radiotherapy treatment with curative intent. Cohort studies and randomised controlled trials will be included. The primary outcome will be the occurrence of salvage surgery at 1 year after treatment. Secondary outcomes include salavage surgery at at any reported time point, the predictive accuracy of models, the quality of the developed models and the feasibility of using the model in clinical practice. Ovid MEDLINE, PubMed, Cochrane Library, EMBASE and CINAHL will be searched from inception to 24 February 2022. Keywords and phrases related to rectal cancer, radiotherapy and prediction models will be used. Studies will be selected once the deduplication, title, abstract and full-text screening process have been completed by two independent reviewers. The PRISMA-P checklist will be followed. A third reviewer will resolve any disagreement. The data extraction form will be pilot-tested using a representative 5% sample of the studies reviewed. The CHARMS checklist will be implemented. Risk of bias in each study will be assessed using the PROBAST tool. A narrative synthesis will be performed and if sufficient data are identified, meta-analysis will be undertaken as described in Debray et al. DISCUSSION: This systematic review will identify factors that predict response to the treatment protocol. Any gaps for potential development of new clinical prediction models will be highlighted.</p><p><strong>Trial registration: </strong>CRD42022277704.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":" ","pages":"19"},"PeriodicalIF":0.0,"publicationDate":"2022-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9535989/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"33490074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-22DOI: 10.1186/s41512-022-00131-z
Sue Mallett, Jacqueline Dinnes, Yemisi Takwoingi, Lavinia Ferrante de Ruffano
The Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy (DTA) provides guidance on important aspects of conducting a test accuracy systematic review. In this paper we present TOMAS-R (Template of Multiplicity and Analysis in Systematic Reviews), a structured template to use in conjunction with current Cochrane DTA guidance, to help identify complexities in the review question and to assist planning of data extraction and analysis when clinically important variation and multiplicity is present. Examples of clinically important variation and multiplicity could include differences in participants, index tests and test methods, target conditions and reference standards used to define them, study design and methodological quality. Our TOMAS-R template goes beyond the broad topic headings in current guidance that are sources of potential variation and multiplicity, by providing prompts for common sources of heterogeneity encountered from our experience of authoring over 100 reviews. We provide examples from two reviews to assist users. The TOMAS-R template adds value by supplementing available guidance for DTA reviews by providing a tool to facilitate discussions between methodologists, clinicians, statisticians and patient/public team members to identify the full breadth of review question complexities early in the process. The use of a structured set of prompting questions at the important stage of writing the protocol ensures clinical relevance as a main focus of the review, while allowing identification of key clinical components for data extraction and later analysis thereby facilitating a more efficient review process.
{"title":"TOMAS-R: A template to identify and plan analysis for clinically important variation and multiplicity in diagnostic test accuracy systematic reviews.","authors":"Sue Mallett, Jacqueline Dinnes, Yemisi Takwoingi, Lavinia Ferrante de Ruffano","doi":"10.1186/s41512-022-00131-z","DOIUrl":"10.1186/s41512-022-00131-z","url":null,"abstract":"<p><p>The Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy (DTA) provides guidance on important aspects of conducting a test accuracy systematic review. In this paper we present TOMAS-R (Template of Multiplicity and Analysis in Systematic Reviews), a structured template to use in conjunction with current Cochrane DTA guidance, to help identify complexities in the review question and to assist planning of data extraction and analysis when clinically important variation and multiplicity is present. Examples of clinically important variation and multiplicity could include differences in participants, index tests and test methods, target conditions and reference standards used to define them, study design and methodological quality. Our TOMAS-R template goes beyond the broad topic headings in current guidance that are sources of potential variation and multiplicity, by providing prompts for common sources of heterogeneity encountered from our experience of authoring over 100 reviews. We provide examples from two reviews to assist users. The TOMAS-R template adds value by supplementing available guidance for DTA reviews by providing a tool to facilitate discussions between methodologists, clinicians, statisticians and patient/public team members to identify the full breadth of review question complexities early in the process. The use of a structured set of prompting questions at the important stage of writing the protocol ensures clinical relevance as a main focus of the review, while allowing identification of key clinical components for data extraction and later analysis thereby facilitating a more efficient review process.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":" ","pages":"18"},"PeriodicalIF":0.0,"publicationDate":"2022-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9494799/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40374695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}