Alexander J. Savage , Christopher G. Shafik , Simon A. Savage , Jackson D. Catalano , Jin W. Tee , Hamed Akhlaghi , Rana S. Dhillon , Tom J. O’Donohoe
{"title":"使用工具评估主要神经外科期刊上主要研究的方法质量:评论综述。","authors":"Alexander J. Savage , Christopher G. Shafik , Simon A. Savage , Jackson D. Catalano , Jin W. Tee , Hamed Akhlaghi , Rana S. Dhillon , Tom J. O’Donohoe","doi":"10.1016/j.jocn.2024.110916","DOIUrl":null,"url":null,"abstract":"<div><div>Systematic reviews (SRs) and <em>meta</em>-analyses (MAs) require a comprehensive and reproducible strategy to assess the methodological quality of the included studies. This research-on-research study evaluated the methods used to assess research quality by SRs and MAs published in leading neurosurgical journals, and identified factors associated with the publication of a comprehensive and reproducible assessment. We systematically surveyed SRs published in the 10 leading neurosurgical journals between 01/11/2019 and 31/12/2021. PubMed was used to search the MEDLINE database, which was supplemented by individual journal searches. Included SRs were assessed using a standardised data extraction tool. Descriptive statistics were utilised to identify factors associated with methodological and reporting quality of the tool-based quality assessment. A total of 564 SRs were included in the analysis. 326 (57.80%) included MAs, 165 (29.26%) included at least one Randomized Controlled Trial (RCT) and 29 (5.14%) included only RCTs. Scales were the most commonly used tool for methodological quality assessment (32.45%), followed by domain-based tools (24.82%) and checklists (9.93%). The number of included studies was inversely associated with multiple methodological quality assessment metrics. A positive association was observed between the number of included patients and multiple methodological quality assessment metrics. We established that the methodological and reporting quality of tool-based quality assessment requires improvement. This issue is particularly pertinent for SRs limited to non-randomised studies, which account for the vast majority of neurosurgical SRs. We recommend the use of domain-based tools for methodological quality assessment as these provide a more nuanced assessment of methodological quality.</div></div>","PeriodicalId":15487,"journal":{"name":"Journal of Clinical Neuroscience","volume":"130 ","pages":"Article 110916"},"PeriodicalIF":1.9000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Use of tools for assessing the methodological quality of primary research in leading neurosurgical journals: A review of reviews\",\"authors\":\"Alexander J. Savage , Christopher G. Shafik , Simon A. Savage , Jackson D. Catalano , Jin W. Tee , Hamed Akhlaghi , Rana S. Dhillon , Tom J. O’Donohoe\",\"doi\":\"10.1016/j.jocn.2024.110916\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Systematic reviews (SRs) and <em>meta</em>-analyses (MAs) require a comprehensive and reproducible strategy to assess the methodological quality of the included studies. This research-on-research study evaluated the methods used to assess research quality by SRs and MAs published in leading neurosurgical journals, and identified factors associated with the publication of a comprehensive and reproducible assessment. We systematically surveyed SRs published in the 10 leading neurosurgical journals between 01/11/2019 and 31/12/2021. PubMed was used to search the MEDLINE database, which was supplemented by individual journal searches. Included SRs were assessed using a standardised data extraction tool. Descriptive statistics were utilised to identify factors associated with methodological and reporting quality of the tool-based quality assessment. A total of 564 SRs were included in the analysis. 326 (57.80%) included MAs, 165 (29.26%) included at least one Randomized Controlled Trial (RCT) and 29 (5.14%) included only RCTs. Scales were the most commonly used tool for methodological quality assessment (32.45%), followed by domain-based tools (24.82%) and checklists (9.93%). The number of included studies was inversely associated with multiple methodological quality assessment metrics. A positive association was observed between the number of included patients and multiple methodological quality assessment metrics. We established that the methodological and reporting quality of tool-based quality assessment requires improvement. This issue is particularly pertinent for SRs limited to non-randomised studies, which account for the vast majority of neurosurgical SRs. We recommend the use of domain-based tools for methodological quality assessment as these provide a more nuanced assessment of methodological quality.</div></div>\",\"PeriodicalId\":15487,\"journal\":{\"name\":\"Journal of Clinical Neuroscience\",\"volume\":\"130 \",\"pages\":\"Article 110916\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Clinical Neuroscience\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0967586824004557\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0967586824004557","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Use of tools for assessing the methodological quality of primary research in leading neurosurgical journals: A review of reviews
Systematic reviews (SRs) and meta-analyses (MAs) require a comprehensive and reproducible strategy to assess the methodological quality of the included studies. This research-on-research study evaluated the methods used to assess research quality by SRs and MAs published in leading neurosurgical journals, and identified factors associated with the publication of a comprehensive and reproducible assessment. We systematically surveyed SRs published in the 10 leading neurosurgical journals between 01/11/2019 and 31/12/2021. PubMed was used to search the MEDLINE database, which was supplemented by individual journal searches. Included SRs were assessed using a standardised data extraction tool. Descriptive statistics were utilised to identify factors associated with methodological and reporting quality of the tool-based quality assessment. A total of 564 SRs were included in the analysis. 326 (57.80%) included MAs, 165 (29.26%) included at least one Randomized Controlled Trial (RCT) and 29 (5.14%) included only RCTs. Scales were the most commonly used tool for methodological quality assessment (32.45%), followed by domain-based tools (24.82%) and checklists (9.93%). The number of included studies was inversely associated with multiple methodological quality assessment metrics. A positive association was observed between the number of included patients and multiple methodological quality assessment metrics. We established that the methodological and reporting quality of tool-based quality assessment requires improvement. This issue is particularly pertinent for SRs limited to non-randomised studies, which account for the vast majority of neurosurgical SRs. We recommend the use of domain-based tools for methodological quality assessment as these provide a more nuanced assessment of methodological quality.
期刊介绍:
This International journal, Journal of Clinical Neuroscience, publishes articles on clinical neurosurgery and neurology and the related neurosciences such as neuro-pathology, neuro-radiology, neuro-ophthalmology and neuro-physiology.
The journal has a broad International perspective, and emphasises the advances occurring in Asia, the Pacific Rim region, Europe and North America. The Journal acts as a focus for publication of major clinical and laboratory research, as well as publishing solicited manuscripts on specific subjects from experts, case reports and other information of interest to clinicians working in the clinical neurosciences.