首页 > 最新文献

Journal of evaluation in clinical practice最新文献

英文 中文
Quality problems in clinical practice guidelines and guideline appraisal studies: Should we tolerate or eradicate? 临床实践指南和指南评估研究中的质量问题:我们应该容忍还是根除?
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-30 DOI: 10.1111/jep.14227
Guo-Xun Yang, Shu-Qian Dou, Xiao-Bo Liu, Ting Que, Yong Tang, Xin Wang, Long-Zong Yan, Li-Na Zhou, Cheng-Bo Jin, Yuan Wang, Qi Wang, Kong-Jia Wu, Wen-Jun Liu

Background: Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument have been widely used by scholars around the world to assess the methodological quality of clinical practice guidelines (CPGs). We sought to identify items or domains that are commonly scored low in the assessment, and to systematically review the issues that emerged when evaluators used the AGREE II tool for guideline quality assessment.

Methods: A systematic search was conducted to identify articles published in medically relevant databases from 2022 to 2023 regarding the use of the AGREE II tool for the assessment of CPGs. We extracted six quality domains and overall quality assessment data of CPGs included in the literature, and processed the data using descriptive statistical analysis, difference analysis, regression analysis, and correlation analysis. A seven-point Likert scale was used to assess the reporting quality of the included articles.

Results: 151 relevant publications were identified, including 2081 guidelines published between 1990 and 2022. The results of the regression analysis showed a statistically significant impact of all domains on overall guideline quality (p < 0.001; R2 = 0.777). Domain 1, 2, 3, 4, and 6 scores differed significantly over time (p < 0.001) and were increasing. The score was good for Domain 4 (median 78.00 [IQR: 62.75-89.00]; mean 74.34 [SD 18.85]) and Domain 1 (median 78.00 [IQR: 61.00-90.00]; mean 73.57 [SD 21.12]). Scores were generic for Domain 6 (median 58.33 [IQR: 25.00-83.33]; mean 53.98 [SD 34.13]), Domain 2 (median 53.00 [IQR: 33.30-72.10]; mean 53.30 [SD 24.52]) and Domain 3 (median 51.00 [IQR: 26.02-73.00]; mean 50.44 [SD 27.19]). The score was poor for Domain 5 (median 36.20 [IQR: 20.20-58.32]; mean 40.21 [SD 24.90]). In addition, the quality evaluation results of the included articles showed that 33.1% were evaluated as low and 11.9% as very low.

Conclusions: AGREE II tools have facilitated the development of methodological quality for CPGs. Although the quality of CPGs has improved over time, some general low-quality problems still exist, and solving these problems will be an effective way for developers to upgrade the quality of guidelines. In addition, addressing critical issues in the evaluation of guidelines to present high-quality study reports would be another way to guide guideline development.

背景:研究与评价指南评估(AGREE)II工具已被世界各地的学者广泛用于评估临床实践指南(CPG)的方法学质量。我们试图找出在评估中普遍得分较低的项目或领域,并系统回顾评估者在使用 AGREE II 工具进行指南质量评估时出现的问题:我们进行了系统性检索,以确定 2022 年至 2023 年期间在医学相关数据库中发表的有关使用 AGREE II 工具评估 CPGs 的文章。我们提取了文献中收录的 CPGs 的六个质量域和总体质量评估数据,并使用描述性统计分析、差异分析、回归分析和相关分析对数据进行了处理。采用七点李克特量表评估收录文章的报告质量:结果:共发现 151 篇相关文献,包括 1990 年至 2022 年间发表的 2081 份指南。回归分析结果显示,所有领域对指南总体质量的影响均具有统计学意义(P 2 = 0.777)。领域 1、2、3、4 和 6 的得分随时间推移有显著差异(p 结论:领域 1、2、3、4 和 6 的得分随时间推移有显著差异:AGREE II 工具促进了 CPGs 方法质量的发展。虽然随着时间的推移,CPGs 的质量有所提高,但仍存在一些普遍的低质量问题,解决这些问题将是制定者提高指南质量的有效途径。此外,解决指南评估中的关键问题,提出高质量的研究报告,也是指导指南制定的另一种方式。
{"title":"Quality problems in clinical practice guidelines and guideline appraisal studies: Should we tolerate or eradicate?","authors":"Guo-Xun Yang, Shu-Qian Dou, Xiao-Bo Liu, Ting Que, Yong Tang, Xin Wang, Long-Zong Yan, Li-Na Zhou, Cheng-Bo Jin, Yuan Wang, Qi Wang, Kong-Jia Wu, Wen-Jun Liu","doi":"10.1111/jep.14227","DOIUrl":"https://doi.org/10.1111/jep.14227","url":null,"abstract":"<p><strong>Background: </strong>Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument have been widely used by scholars around the world to assess the methodological quality of clinical practice guidelines (CPGs). We sought to identify items or domains that are commonly scored low in the assessment, and to systematically review the issues that emerged when evaluators used the AGREE II tool for guideline quality assessment.</p><p><strong>Methods: </strong>A systematic search was conducted to identify articles published in medically relevant databases from 2022 to 2023 regarding the use of the AGREE II tool for the assessment of CPGs. We extracted six quality domains and overall quality assessment data of CPGs included in the literature, and processed the data using descriptive statistical analysis, difference analysis, regression analysis, and correlation analysis. A seven-point Likert scale was used to assess the reporting quality of the included articles.</p><p><strong>Results: </strong>151 relevant publications were identified, including 2081 guidelines published between 1990 and 2022. The results of the regression analysis showed a statistically significant impact of all domains on overall guideline quality (p < 0.001; R<sup>2</sup> = 0.777). Domain 1, 2, 3, 4, and 6 scores differed significantly over time (p < 0.001) and were increasing. The score was good for Domain 4 (median 78.00 [IQR: 62.75-89.00]; mean 74.34 [SD 18.85]) and Domain 1 (median 78.00 [IQR: 61.00-90.00]; mean 73.57 [SD 21.12]). Scores were generic for Domain 6 (median 58.33 [IQR: 25.00-83.33]; mean 53.98 [SD 34.13]), Domain 2 (median 53.00 [IQR: 33.30-72.10]; mean 53.30 [SD 24.52]) and Domain 3 (median 51.00 [IQR: 26.02-73.00]; mean 50.44 [SD 27.19]). The score was poor for Domain 5 (median 36.20 [IQR: 20.20-58.32]; mean 40.21 [SD 24.90]). In addition, the quality evaluation results of the included articles showed that 33.1% were evaluated as low and 11.9% as very low.</p><p><strong>Conclusions: </strong>AGREE II tools have facilitated the development of methodological quality for CPGs. Although the quality of CPGs has improved over time, some general low-quality problems still exist, and solving these problems will be an effective way for developers to upgrade the quality of guidelines. In addition, addressing critical issues in the evaluation of guidelines to present high-quality study reports would be another way to guide guideline development.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impact of COVID-19 on health-related quality of life in patients with cardiovascular disease: A cross-sectional study. COVID-19 对心血管疾病患者健康相关生活质量的影响:一项横断面研究
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-30 DOI: 10.1111/jep.14233
Dinara Nurmukanova, Kuralbay Kurakbayev, Madamin Karataev, Venera Baisugurova, Gulzhakhan Kashafutdinova

Background: The COVID-19 pandemic disrupted healthcare access for cardiovascular patients, potentially worsening their health outcomes and quality of life through both medical and psychological impacts.

Aims: This cross-sectional study was conducted to assess the quality of life of patients with cardiovascular disease before and after the COVID-19 pandemic.

Materials and methods: The work was conducted from January 9 to April 28, 2023, in Almaty city and the Almaty region. 3026 outpatients with cardiovascular pathology participated in the survey using a standardised European Quality of Life Questionnaire. The study utilized cluster, frequency analysis, and discrete statistics to analyze the impact of COVID-19 on quality of life parameters, revealing significant changes in anxiety and depression among cardiovascular patients, resulting in reduced quality of life (from 0.3% to 5.5% and 0.4; to 7.5% in the categories of extremely severe and severe manifestations, respectively).

Results: An analysis of the nosological structure of cardiovascular diseases in the study group was performed and revealed that coronary heart disease occurred in 51.6% of cases, arterial hypertension in 88%, and diabetes mellitus in 34.6%. The availability of both outpatient and inpatient medical services in Almaty region and Almaty city was also assessed, and their comparative analysis was conducted, during which it was found that the need for these services in the district settlements is 10% and 12% higher, respectively, than in the city, which is particularly important for understanding the effectiveness of the public health system in the context of the COVID-19 pandemic, both at the regional and republican levels.

Conclusion: This study is of practical importance for health care workers, as it allows assessing the impact of the COVID-19 pandemic on the quality of life of patients with cardiovascular diseases, which provides an opportunity to develop effective rehabilitation protocols and psychological support for this vulnerable category.

背景:目的:本横断面研究旨在评估 COVID-19 大流行前后心血管疾病患者的生活质量:这项工作于 2023 年 1 月 9 日至 4 月 28 日在阿拉木图市和阿拉木图州进行。3026 名心血管病门诊患者参加了调查,调查使用的是标准化的欧洲生活质量问卷。研究利用聚类分析、频数分析和离散统计分析了 COVID-19 对生活质量参数的影响,结果显示,心血管病患者的焦虑和抑郁情绪发生了显著变化,导致生活质量下降(极重度和重度表现类别分别从 0.3% 上升至 5.5% 和 0.4; 上升至 7.5%):对研究组心血管疾病的病名结构进行分析后发现,51.6%的病例患有冠心病,88%的病例患有动脉高血压,34.6%的病例患有糖尿病。此外,还对阿拉木图地区和阿拉木图市的门诊和住院医疗服务的可用性进行了评估,并对其进行了比较分析,结果发现,地区居民点对这些服务的需求分别比城市高出 10%和 12%,这对于了解 COVID-19 大流行情况下地区和共和国两级公共卫生系统的有效性尤为重要:这项研究对医护人员具有重要的现实意义,因为它可以评估 COVID-19 大流行对心血管疾病患者生活质量的影响,从而为这一弱势群体制定有效的康复方案和心理支持提供机会。
{"title":"Impact of COVID-19 on health-related quality of life in patients with cardiovascular disease: A cross-sectional study.","authors":"Dinara Nurmukanova, Kuralbay Kurakbayev, Madamin Karataev, Venera Baisugurova, Gulzhakhan Kashafutdinova","doi":"10.1111/jep.14233","DOIUrl":"https://doi.org/10.1111/jep.14233","url":null,"abstract":"<p><strong>Background: </strong>The COVID-19 pandemic disrupted healthcare access for cardiovascular patients, potentially worsening their health outcomes and quality of life through both medical and psychological impacts.</p><p><strong>Aims: </strong>This cross-sectional study was conducted to assess the quality of life of patients with cardiovascular disease before and after the COVID-19 pandemic.</p><p><strong>Materials and methods: </strong>The work was conducted from January 9 to April 28, 2023, in Almaty city and the Almaty region. 3026 outpatients with cardiovascular pathology participated in the survey using a standardised European Quality of Life Questionnaire. The study utilized cluster, frequency analysis, and discrete statistics to analyze the impact of COVID-19 on quality of life parameters, revealing significant changes in anxiety and depression among cardiovascular patients, resulting in reduced quality of life (from 0.3% to 5.5% and 0.4; to 7.5% in the categories of extremely severe and severe manifestations, respectively).</p><p><strong>Results: </strong>An analysis of the nosological structure of cardiovascular diseases in the study group was performed and revealed that coronary heart disease occurred in 51.6% of cases, arterial hypertension in 88%, and diabetes mellitus in 34.6%. The availability of both outpatient and inpatient medical services in Almaty region and Almaty city was also assessed, and their comparative analysis was conducted, during which it was found that the need for these services in the district settlements is 10% and 12% higher, respectively, than in the city, which is particularly important for understanding the effectiveness of the public health system in the context of the COVID-19 pandemic, both at the regional and republican levels.</p><p><strong>Conclusion: </strong>This study is of practical importance for health care workers, as it allows assessing the impact of the COVID-19 pandemic on the quality of life of patients with cardiovascular diseases, which provides an opportunity to develop effective rehabilitation protocols and psychological support for this vulnerable category.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of bedside handover that includes patients or carers in hospital settings: A systematic review. 在医院环境中实施包括患者或护理人员在内的床边交接班:系统综述。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-30 DOI: 10.1111/jep.14223
Amy Maher, Henry Hsu, Mohamed Eftal Bin Mohamed Ebrahim, Matthew Vukasovic, Andrew Coggins

Objective: Increasing complexity in healthcare systems necessitates effective handover. While a universal structure is often recommended, many frameworks do not include the patient. A systematic review was completed examining outcomes following handover that included patients or carers using a realist-orientated paradigm.

Methods: The research group used Covidence™ software and followed PRISMA guidelines. A librarian-led search of Embase, Medline, PsycINFO and SCOPUS yielded 5,790 relevant studies for screening. Included studies reported on peer-reviewed studies that assessed qualitative or quantitative outcomes resulting from patient-centred handover. To assess quality, we used the McMaster Mixed Methods Appraisal Tool (MMAT). Patient-orientated and quantitative outcomes are reported descriptively. For qualitative outcomes, we employed a deductive analytical approach. Braun and Clarke's steps were followed to develop themes with group work used to clarify and discuss the various codes. Heterogenous reporting precluded meta-analysis.

Results: Thirty studies were eligible (10 mixed methods; 11 quantitative; 9 qualitative) with variable quality and scope. Most studies related to nursing-led bedside handover and originated in Anglophone countries. Positive effects were reported for patient satisfaction, engagement, autonomy and effective information exchange. Providers reported a positive experience but also barriers to implementation, cognitive load and reducing compliance over time. There were contradicting findings for patient-orientated outcomes including falls risk. Publication bias may have led to under reporting of negative trials. There was limited reporting on physician-led handovers that included patients.

Conclusions: Patient-centred handover was associated with self-reported benefits for patients and providers but potential advantages over conventional handover could be undermined by barriers such as time, implementation challenges and a perceived increase in staff workload.

目的:医疗保健系统日益复杂,需要有效的交接。虽然人们经常推荐一种通用的结构,但许多框架并不包括患者。研究小组采用现实主义导向范式,对包括患者或护理人员在内的交接结果进行了系统性审查:研究小组使用 Covidence™ 软件并遵循 PRISMA 指南。在图书馆员的指导下,对 Embase、Medline、PsycINFO 和 SCOPUS 进行了检索,共筛选出 5,790 项相关研究。所纳入的研究报告均经过同行评审,评估了以患者为中心的交接工作所产生的定性或定量结果。为了评估研究质量,我们使用了麦克马斯特混合方法评估工具(MMAT)。以患者为中心的定性和定量结果均为描述性报告。对于定性结果,我们采用了演绎分析法。我们按照布劳恩和克拉克的步骤制定主题,并通过小组工作来澄清和讨论各种代码。由于报告内容不同,因此无法进行荟萃分析:符合条件的研究有 30 项(10 项混合方法研究;11 项定量研究;9 项定性研究),其质量和范围各不相同。大多数研究都与护理人员主导的床边交接有关,并且都来自英语国家。据报道,在患者满意度、参与度、自主性和有效信息交流方面取得了积极效果。医疗服务提供者报告了积极的体验,但也提到了实施障碍、认知负荷和随着时间推移依从性降低等问题。在以患者为导向的结果(包括跌倒风险)方面,研究结果相互矛盾。出版偏差可能导致负面试验的报告不足。关于由医生主导、包括患者在内的交接班的报道有限:结论:以患者为中心的交接班与患者和医疗服务提供者自我报告的益处有关,但与传统交接班相比,其潜在优势可能会因时间、实施挑战和员工工作量增加等障碍而受到削弱。
{"title":"Implementation of bedside handover that includes patients or carers in hospital settings: A systematic review.","authors":"Amy Maher, Henry Hsu, Mohamed Eftal Bin Mohamed Ebrahim, Matthew Vukasovic, Andrew Coggins","doi":"10.1111/jep.14223","DOIUrl":"https://doi.org/10.1111/jep.14223","url":null,"abstract":"<p><strong>Objective: </strong>Increasing complexity in healthcare systems necessitates effective handover. While a universal structure is often recommended, many frameworks do not include the patient. A systematic review was completed examining outcomes following handover that included patients or carers using a realist-orientated paradigm.</p><p><strong>Methods: </strong>The research group used Covidence™ software and followed PRISMA guidelines. A librarian-led search of Embase, Medline, PsycINFO and SCOPUS yielded 5,790 relevant studies for screening. Included studies reported on peer-reviewed studies that assessed qualitative or quantitative outcomes resulting from patient-centred handover. To assess quality, we used the McMaster Mixed Methods Appraisal Tool (MMAT). Patient-orientated and quantitative outcomes are reported descriptively. For qualitative outcomes, we employed a deductive analytical approach. Braun and Clarke's steps were followed to develop themes with group work used to clarify and discuss the various codes. Heterogenous reporting precluded meta-analysis.</p><p><strong>Results: </strong>Thirty studies were eligible (10 mixed methods; 11 quantitative; 9 qualitative) with variable quality and scope. Most studies related to nursing-led bedside handover and originated in Anglophone countries. Positive effects were reported for patient satisfaction, engagement, autonomy and effective information exchange. Providers reported a positive experience but also barriers to implementation, cognitive load and reducing compliance over time. There were contradicting findings for patient-orientated outcomes including falls risk. Publication bias may have led to under reporting of negative trials. There was limited reporting on physician-led handovers that included patients.</p><p><strong>Conclusions: </strong>Patient-centred handover was associated with self-reported benefits for patients and providers but potential advantages over conventional handover could be undermined by barriers such as time, implementation challenges and a perceived increase in staff workload.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring guideline adherence in physiotherapy: A scoping review of methodological approaches. 衡量物理治疗指南的遵守情况:方法学方法的范围综述。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-27 DOI: 10.1111/jep.14218
Carolin Bahns, Bettina Scheffler, Alexander Bremer, Christian Kopkow

Rationale: Clinical practice guidelines summarise the existing evidence on specific health conditions and aim to optimise quality of care by providing evidence-based recommendations. Studies have reported a gap between research findings and clinical practice in physiotherapy. Guideline adherence is often used as a measure of agreement between therapeutic care and guideline recommendations. However, there is currently no standardised methodological approach for measuring guideline adherence.

Aims and objective: The objective of this scoping review was to summarise the methods and results of studies that assessed guideline adherence in physiotherapy.

Methods: MEDLINE, EMBASE, PEDro and CENTRAL databases were searched for relevant literature up to December 2022. Published reports of observational studies and controlled clinical trials that provided information on the assessment of guideline adherence in physiotherapists were included. The selection process was performed independently by two reviewers. The methodological quality of the identified reports was not assessed. Results were summarised narratively.

Results: From a total of 2560 potentially relevant records, 53 reports were included in the analysis. Physiotherapists' adherence to guidelines was primarily assessed in the context of musculoskeletal conditions, such as low back pain (n = 25, 47.2%) and osteoarthritis (n = 8, 15.1%). A wide range of measurement approaches were used with the majority of reports using web-based surveys (n = 21, 39.6%), followed by chart reviews (n = 17, 32.1%). Most reports (n = 21, 39.6%) provided information on the level of adherence in terms of frequency dichotomising (self-reported) clinical practice as adherent or non-adherent. Adherence rates varied widely between included reports.

Conclusions: Although the large number of included reports indicates a high level of interest in the topic of guideline adherence, there is considerable heterogeneity between studies regarding the methodological approaches used to assess guideline adherence in physiotherapists. This reduces the comparability of the study results.

Trial registration: INPLASY (registration no. 202250081). Registered on 12th May 2022.

依据:临床实践指南总结了有关特定健康状况的现有证据,旨在通过提供以证据为基础的建议来优化护理质量。有研究报告称,物理治疗的研究成果与临床实践之间存在差距。指南的依从性通常被用来衡量治疗护理与指南建议之间的一致性。然而,目前还没有衡量指南依从性的标准化方法:本范围综述旨在总结评估物理治疗指南依从性的研究方法和结果:方法:检索了 MEDLINE、EMBASE、PEDro 和 CENTRAL 数据库中截至 2022 年 12 月的相关文献。纳入了已发表的观察性研究和对照临床试验报告,这些报告提供了物理治疗师对指南依从性的评估信息。筛选过程由两名审稿人独立完成。未对已确定报告的方法学质量进行评估。对结果进行了叙述性总结:在总共 2560 份潜在相关记录中,有 53 份报告被纳入分析。物理治疗师对指南的遵守情况主要针对肌肉骨骼疾病进行评估,如腰背痛(n = 25,47.2%)和骨关节炎(n = 8,15.1%)。使用的测量方法多种多样,大多数报告使用了网络调查(21 份,占 39.6%),其次是病历审查(17 份,占 32.1%)。大多数报告(21 份,占 39.6%)都提供了临床实践中坚持或不坚持的频率信息。不同报告的依从率差异很大:尽管纳入的报告数量众多,表明人们对指南依从性这一主题的关注度很高,但不同研究在评估物理治疗师的指南依从性时所采用的方法存在很大差异。这降低了研究结果的可比性:INPLASY(注册号:202250081)。注册日期:2022 年 5 月 12 日。
{"title":"Measuring guideline adherence in physiotherapy: A scoping review of methodological approaches.","authors":"Carolin Bahns, Bettina Scheffler, Alexander Bremer, Christian Kopkow","doi":"10.1111/jep.14218","DOIUrl":"https://doi.org/10.1111/jep.14218","url":null,"abstract":"<p><strong>Rationale: </strong>Clinical practice guidelines summarise the existing evidence on specific health conditions and aim to optimise quality of care by providing evidence-based recommendations. Studies have reported a gap between research findings and clinical practice in physiotherapy. Guideline adherence is often used as a measure of agreement between therapeutic care and guideline recommendations. However, there is currently no standardised methodological approach for measuring guideline adherence.</p><p><strong>Aims and objective: </strong>The objective of this scoping review was to summarise the methods and results of studies that assessed guideline adherence in physiotherapy.</p><p><strong>Methods: </strong>MEDLINE, EMBASE, PEDro and CENTRAL databases were searched for relevant literature up to December 2022. Published reports of observational studies and controlled clinical trials that provided information on the assessment of guideline adherence in physiotherapists were included. The selection process was performed independently by two reviewers. The methodological quality of the identified reports was not assessed. Results were summarised narratively.</p><p><strong>Results: </strong>From a total of 2560 potentially relevant records, 53 reports were included in the analysis. Physiotherapists' adherence to guidelines was primarily assessed in the context of musculoskeletal conditions, such as low back pain (n = 25, 47.2%) and osteoarthritis (n = 8, 15.1%). A wide range of measurement approaches were used with the majority of reports using web-based surveys (n = 21, 39.6%), followed by chart reviews (n = 17, 32.1%). Most reports (n = 21, 39.6%) provided information on the level of adherence in terms of frequency dichotomising (self-reported) clinical practice as adherent or non-adherent. Adherence rates varied widely between included reports.</p><p><strong>Conclusions: </strong>Although the large number of included reports indicates a high level of interest in the topic of guideline adherence, there is considerable heterogeneity between studies regarding the methodological approaches used to assess guideline adherence in physiotherapists. This reduces the comparability of the study results.</p><p><strong>Trial registration: </strong>INPLASY (registration no. 202250081). Registered on 12th May 2022.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Turkish validity and reliability of the universal mental health literacy scale for adolescents (10-14 years): A methodological study. 针对青少年(10-14 岁)的通用心理健康知识量表在土耳其的有效性和可靠性:方法研究。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-27 DOI: 10.1111/jep.14171
Gülzade Uysal, Remziye Semerci, Rukiye Şengün, Duygu Sönmez Düzkaya

Rationale: Mental health literacy enables adolescents to acquire information that will accompany them in their future lives and to define their attitudes and behaviors.

Aims and objectives: This study evaluated the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents (10-14 years).

Methods: This is a methodological, correlational, cross-sectional, and descriptive study. The study was conducted with 223 adolescents. Data were collected by 'Information Form' and 'Universal Mental Health Literacy Scale for Adolescents.' Exploratory Factor Analysis, Confirmatory Factor Analysis, and Pearson Correlation analysis were used to assess the validity and reliability of the UMHL-A.

Results: Item Content Validity Index (I-CVI) scores ranged from 0.94 to 0.96, while the Scale Content Validity Index (S-CVI) was 0.95. For 'Help-seeking and Stigma dimensions' χ2/df = 3.347, NFI = 0.804, IFI = 0.854, TLI = 0.778, CFI = 0.849, RMSEA = 0.103. For 'Knowledge of Mental Health and Knowledge of Mental Illnesses dimensions' χ2/df = 1.959, NFI = 0.731, IFI = 0.847, TLI = 0.774, CFI = 0.837, RMSEA = 0.066. The internal consistency and time stability were affirmed by a Hotelling T-square value of 15.241 and an F-test result of 27.793.

Conclusions: This study reveals that the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents is a valid and reliable tool for assessing mental health literacy among adolescents. The UMHL-A scale is a valid tool to evaluate critical aspects of mental health literacy in adolescent populations and can be used in both research and clinical practice in mental health education and intervention. It is recommended that the Turkish version of the Universal Mental Health Literacy Scale should be used to determine resilience in adolescents.

理由心理健康素养使青少年能够获得伴随他们未来生活的信息,并确定他们的态度和行为:本研究评估了土耳其青少年(10-14 岁)通用心理健康素养量表的有效性和可靠性:这是一项方法学、相关性、横断面和描述性研究。研究对象为 223 名青少年。数据通过 "信息表 "和 "青少年通用心理健康素养量表 "收集。采用探索性因子分析、确认性因子分析和皮尔逊相关分析来评估 UMHL-A 的有效性和可靠性:项目内容效度指数(I-CVI)为 0.94 至 0.96,量表内容效度指数(S-CVI)为 0.95。求助和成见维度" χ2/df = 3.347,NFI = 0.804,IFI = 0.854,TLI = 0.778,CFI = 0.849,RMSEA = 0.103。对于 "心理健康知识和心理疾病知识维度",χ2/df = 1.959,NFI = 0.731,IFI = 0.847,TLI = 0.774,CFI = 0.837,RMSEA = 0.066。霍特林 T 方值为 15.241,F 检验结果为 27.793,证实了内部一致性和时间稳定性:本研究揭示了土耳其青少年心理健康素养通用量表的有效性和可靠性,它是评估青少年心理健康素养的有效、可靠的工具。UMHL-A 量表是评估青少年心理健康素养关键方面的有效工具,可用于心理健康教育和干预的研究和临床实践。建议使用土耳其版的通用心理健康素养量表来确定青少年的复原力。
{"title":"Turkish validity and reliability of the universal mental health literacy scale for adolescents (10-14 years): A methodological study.","authors":"Gülzade Uysal, Remziye Semerci, Rukiye Şengün, Duygu Sönmez Düzkaya","doi":"10.1111/jep.14171","DOIUrl":"https://doi.org/10.1111/jep.14171","url":null,"abstract":"<p><strong>Rationale: </strong>Mental health literacy enables adolescents to acquire information that will accompany them in their future lives and to define their attitudes and behaviors.</p><p><strong>Aims and objectives: </strong>This study evaluated the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents (10-14 years).</p><p><strong>Methods: </strong>This is a methodological, correlational, cross-sectional, and descriptive study. The study was conducted with 223 adolescents. Data were collected by 'Information Form' and 'Universal Mental Health Literacy Scale for Adolescents.' Exploratory Factor Analysis, Confirmatory Factor Analysis, and Pearson Correlation analysis were used to assess the validity and reliability of the UMHL-A.</p><p><strong>Results: </strong>Item Content Validity Index (I-CVI) scores ranged from 0.94 to 0.96, while the Scale Content Validity Index (S-CVI) was 0.95. For 'Help-seeking and Stigma dimensions' χ<sup>2</sup>/df = 3.347, NFI = 0.804, IFI = 0.854, TLI = 0.778, CFI = 0.849, RMSEA = 0.103. For 'Knowledge of Mental Health and Knowledge of Mental Illnesses dimensions' χ<sup>2</sup>/df = 1.959, NFI = 0.731, IFI = 0.847, TLI = 0.774, CFI = 0.837, RMSEA = 0.066. The internal consistency and time stability were affirmed by a Hotelling T-square value of 15.241 and an F-test result of 27.793.</p><p><strong>Conclusions: </strong>This study reveals that the Turkish validity and reliability of the Universal Mental Health Literacy Scale for Adolescents is a valid and reliable tool for assessing mental health literacy among adolescents. The UMHL-A scale is a valid tool to evaluate critical aspects of mental health literacy in adolescent populations and can be used in both research and clinical practice in mental health education and intervention. It is recommended that the Turkish version of the Universal Mental Health Literacy Scale should be used to determine resilience in adolescents.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of Kinesio-taping and rigid-taping on vertical jump in individuals with pes planus: A randomised crossover comparison. 运动绑带和硬质绑带对扁平足患者垂直跳跃的影响:随机交叉比较
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-27 DOI: 10.1111/jep.14228
Melissa Ünsalan, Mehmet Miçooğulları, Salih Angın

Introduction: The effects of Kinesio-taping (KT) and rigid-taping (RT) on vertical jump performance have been investigated; however, remain unclear. The study was designed to compare the effects of KT and RT on vertical jump in individuals with pes planus.

Methods: A total of 74 participants were diagnosed with pes planus. The foot posture index (FPI) was used to determine pes planus. Participants were randomly divided into two groups. Before taping, the vertical jump height and power were measured using a VertiMetric device as baseline data. Jump measurement was repeated after Kinesio-taping (KT) and rigid taping (RT) application to group 1 and group 2 respectively in the first period and after crossing in the second period following a 1-week washout. Crossover and equivalence analyses were used for data analysis.

Results: KT and RT showed a statistically significant increase in jump height and power. However, the effect of the RT was higher compared to KT (p < 0.05).

Conclusions: While both taping techniques increased jump height and power, RT was more effective than KT in improving jumping performance in individuals with pes planus, possibly because of its direct supporting function on the MLA. RT may also improve performance in various sports or clinical settings to accelerate recovery after injury or lower the risk of injury caused by poor foot posture.

介绍:有学者研究了肌腱绑扎术(KT)和硬性绑扎术(RT)对垂直跳跃成绩的影响,但目前仍不明确。本研究旨在比较 KT 和 RT 对扁平足患者垂直跳跃的影响:方法:共有 74 名参与者被诊断为扁平足。足部姿势指数(FPI)用于确定趾扁平足。参与者被随机分为两组。绑带前,使用 VertiMetric 设备测量垂直跳跃高度和力量作为基线数据。在第一阶段,分别对第一组和第二组进行肌动绑带(KT)和硬绑带(RT)绑扎后,在第二阶段进行跳跃测量。数据分析采用了交叉分析和等效分析:KT和RT对跳跃高度和力量的提高有显著的统计学意义。然而,与 KT 相比,RT 的效果更高(p 结论:KT 和 RT 都能增加跳高和力量:虽然两种绑带技术都能增加跳跃高度和力量,但在提高扁平足患者的跳跃成绩方面,RT 比 KT 更有效,这可能是因为 RT 对 MLA 有直接的支撑作用。RT 还可以改善各种运动或临床环境中的表现,加快伤后恢复或降低因足部姿势不良而受伤的风险。
{"title":"Effects of Kinesio-taping and rigid-taping on vertical jump in individuals with pes planus: A randomised crossover comparison.","authors":"Melissa Ünsalan, Mehmet Miçooğulları, Salih Angın","doi":"10.1111/jep.14228","DOIUrl":"https://doi.org/10.1111/jep.14228","url":null,"abstract":"<p><strong>Introduction: </strong>The effects of Kinesio-taping (KT) and rigid-taping (RT) on vertical jump performance have been investigated; however, remain unclear. The study was designed to compare the effects of KT and RT on vertical jump in individuals with pes planus.</p><p><strong>Methods: </strong>A total of 74 participants were diagnosed with pes planus. The foot posture index (FPI) was used to determine pes planus. Participants were randomly divided into two groups. Before taping, the vertical jump height and power were measured using a VertiMetric device as baseline data. Jump measurement was repeated after Kinesio-taping (KT) and rigid taping (RT) application to group 1 and group 2 respectively in the first period and after crossing in the second period following a 1-week washout. Crossover and equivalence analyses were used for data analysis.</p><p><strong>Results: </strong>KT and RT showed a statistically significant increase in jump height and power. However, the effect of the RT was higher compared to KT (p < 0.05).</p><p><strong>Conclusions: </strong>While both taping techniques increased jump height and power, RT was more effective than KT in improving jumping performance in individuals with pes planus, possibly because of its direct supporting function on the MLA. RT may also improve performance in various sports or clinical settings to accelerate recovery after injury or lower the risk of injury caused by poor foot posture.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Chest x-ray images: transfer learning model in COVID-19 detection 胸部 X 光图像:COVID-19 检测中的迁移学习模型。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-27 DOI: 10.1111/jep.14215
Siqi Mao PhD, Saltanat Kulbayeva PhD, Mikhail Osadchuk MD

Rationale, Aims and Objectives

This research aims to develop an effective algorithm for diagnosing COVID-19 in chest X-rays using the transfer learning method and support vector machines.

Method

In total, data was collected from 10 clinics, including both large city hospitals and smaller medical institutions. This ensured a diverse range of geographical and demographic information in the sample. An extensive data set was collected, including 10,000 chest X-ray images. 5000 images represent normal cases, 3993 images represent pneumonia cases, and 1007 images represent COVID-19 cases. Machine learning methods were applied to develop a classification model, and the results were compared with seven state-of-the-art models and a lightweight CNN architecture.

Results

The results showed that the proposed method achieves high accuracy values (Accuracy): 0.95 for COVID-19, 0.89 for pneumonia, and 0.92 for normal images (p < 0.05). Comparison with other models demonstrates statistically significant superiority of our method in accuracy across all three classes. The EfficientNet-B0 model surpasses our method only in accuracy for normal images with p < 0.01, confirming the advantages of our method. Our method demonstrates high sensitivity values (Sensitivity): 0.96 for COVID-19, 0.88 for pneumonia, and 0.93 for normal images (p < 0.05), outperforming most of the compared models. Correlation analysis showed Pearson coefficients of 0.92, 0.89, and 0.94 for COVID-19, pneumonia, and normal images, respectively, confirming a high degree of consistency between predicted and true class labels. In addition, the model was validated on external datasets to assess its generalizability. This validation confirmed its high level of effectiveness in a variety of clinical settings.

Conclusion

This study confirms the importance of applying machine learning methods in medical applications and opens new perspectives for early diagnosis of infectious diseases. The practical application of the obtained results can enhance the efficiency of diagnosis and control the spread of COVID-19, as well as contribute to the development of innovative methods in medical practice.

依据、目的和目标:本研究旨在利用迁移学习法和支持向量机开发一种有效的算法,用于诊断胸部 X 光片中的 COVID-19:方法:总共从 10 家诊所收集数据,包括大型城市医院和小型医疗机构。这就确保了样本中地域和人口信息的多样性。收集了大量数据集,包括 10,000 张胸部 X 光图像。其中 5000 张图像代表正常病例,3993 张图像代表肺炎病例,1007 张图像代表 COVID-19 病例。应用机器学习方法开发了分类模型,并将结果与七个最先进的模型和一个轻量级 CNN 架构进行了比较:结果表明,所提出的方法达到了较高的准确率(准确率):COVID-19、肺炎和正常图像的准确率分别为 0.95、0.89 和 0.92:这项研究证实了在医疗应用中应用机器学习方法的重要性,并为传染病的早期诊断开辟了新的前景。实际应用所获得的结果可以提高诊断效率,控制 COVID-19 的传播,并有助于在医疗实践中开发创新方法。
{"title":"Chest x-ray images: transfer learning model in COVID-19 detection","authors":"Siqi Mao PhD,&nbsp;Saltanat Kulbayeva PhD,&nbsp;Mikhail Osadchuk MD","doi":"10.1111/jep.14215","DOIUrl":"10.1111/jep.14215","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Rationale, Aims and Objectives</h3>\u0000 \u0000 <p>This research aims to develop an effective algorithm for diagnosing COVID-19 in chest X-rays using the transfer learning method and support vector machines.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Method</h3>\u0000 \u0000 <p>In total, data was collected from 10 clinics, including both large city hospitals and smaller medical institutions. This ensured a diverse range of geographical and demographic information in the sample. An extensive data set was collected, including 10,000 chest X-ray images. 5000 images represent normal cases, 3993 images represent pneumonia cases, and 1007 images represent COVID-19 cases. Machine learning methods were applied to develop a classification model, and the results were compared with seven state-of-the-art models and a lightweight CNN architecture.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The results showed that the proposed method achieves high accuracy values (Accuracy): 0.95 for COVID-19, 0.89 for pneumonia, and 0.92 for normal images (<i>p</i> &lt; 0.05). Comparison with other models demonstrates statistically significant superiority of our method in accuracy across all three classes. The EfficientNet-B0 model surpasses our method only in accuracy for normal images with <i>p</i> &lt; 0.01, confirming the advantages of our method. Our method demonstrates high sensitivity values (Sensitivity): 0.96 for COVID-19, 0.88 for pneumonia, and 0.93 for normal images (<i>p</i> &lt; 0.05), outperforming most of the compared models. Correlation analysis showed Pearson coefficients of 0.92, 0.89, and 0.94 for COVID-19, pneumonia, and normal images, respectively, confirming a high degree of consistency between predicted and true class labels. In addition, the model was validated on external datasets to assess its generalizability. This validation confirmed its high level of effectiveness in a variety of clinical settings.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>This study confirms the importance of applying machine learning methods in medical applications and opens new perspectives for early diagnosis of infectious diseases. The practical application of the obtained results can enhance the efficiency of diagnosis and control the spread of COVID-19, as well as contribute to the development of innovative methods in medical practice.</p>\u0000 </section>\u0000 </div>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":"31 1","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Use and impact of clinical pathways across various healthcare settings: A protocol for an umbrella review of global evidence. 临床路径在各种医疗机构中的使用和影响:对全球证据进行总体审查的方案。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-24 DOI: 10.1111/jep.14201
Rishita Chandra, Maria Unwin, Viet Tran, Amanda Neil

Aim: The proposed umbrella review aims to assess the use and impact of clinical pathways on professional practice, patient outcomes, length of hospital stay, hospital costs, patient satisfaction, and hospital staff satisfaction through a synthesis of existing systematic reviews and meta-analyses.

Methods: Following PRIOR guidelines, a systematic search will be conducted in MEDLINE, Epistemonikos, and the Cochrane Library to identify relevant systematic reviews and meta-analyses, from inception till March 2024. Two reviewers will independently screen titles and abstracts, with a third resolving any disagreements. Full-text articles considered potentially relevant will be assessed for eligibility by the same process. The data extraction form will cover information about the review methods, characteristics of the included primary studies, the types of interventions evaluated, and the reported outcomes. This standardized data extraction form will be piloted by the review team on five to ten articles to ensure all relevant information is recorded. The quality of included systematic reviews and meta-analyses will be evaluated using AMSTAR 2. PROSPERO registration number is CRD42024529371.

Results: The study will present a narrative synthesis of the findings, addressing the clinical and methodological heterogeneity and assessing the impact of clinical pathways on various healthcare outcomes.

Conclusion and implications: This umbrella review will provide evidence-based insights into the effectiveness, challenges, and best practices of clinical pathways, guiding healthcare decision-making and identifying areas for future research. Results will be disseminated widely to inform policy and improve healthcare service delivery.

Patient or public contribution: No patient or public contribution, as this paper is a protocol of an umbrella review.

目的:拟议的总体综述旨在通过综合现有的系统综述和荟萃分析,评估临床路径的使用及其对专业实践、患者预后、住院时间、医院成本、患者满意度和医院员工满意度的影响:根据 PRIOR 指南,将在 MEDLINE、Epistemonikos 和 Cochrane 图书馆进行系统检索,以确定从开始到 2024 年 3 月的相关系统综述和荟萃分析。两名审稿人将独立筛选标题和摘要,由第三名审稿人解决任何分歧。认为可能相关的文章全文将通过同样的程序进行资格评估。数据提取表将涵盖有关综述方法、纳入的主要研究的特点、评估的干预类型以及报告的结果等信息。评审小组将在 5 到 10 篇文章中试用这种标准化的数据提取表,以确保记录所有相关信息。纳入的系统综述和荟萃分析的质量将使用 AMSTAR 2 进行评估。PROSPERO 注册号为 CRD42024529371:本研究将对研究结果进行叙述性综合,解决临床和方法异质性问题,并评估临床路径对各种医疗结果的影响:本综述将为临床路径的有效性、挑战和最佳实践提供循证见解,为医疗决策提供指导,并确定未来的研究领域。研究结果将被广泛传播,为制定政策和改善医疗服务提供依据:无患者或公众贡献,因为本文是总综述的协议。
{"title":"Use and impact of clinical pathways across various healthcare settings: A protocol for an umbrella review of global evidence.","authors":"Rishita Chandra, Maria Unwin, Viet Tran, Amanda Neil","doi":"10.1111/jep.14201","DOIUrl":"https://doi.org/10.1111/jep.14201","url":null,"abstract":"<p><strong>Aim: </strong>The proposed umbrella review aims to assess the use and impact of clinical pathways on professional practice, patient outcomes, length of hospital stay, hospital costs, patient satisfaction, and hospital staff satisfaction through a synthesis of existing systematic reviews and meta-analyses.</p><p><strong>Methods: </strong>Following PRIOR guidelines, a systematic search will be conducted in MEDLINE, Epistemonikos, and the Cochrane Library to identify relevant systematic reviews and meta-analyses, from inception till March 2024. Two reviewers will independently screen titles and abstracts, with a third resolving any disagreements. Full-text articles considered potentially relevant will be assessed for eligibility by the same process. The data extraction form will cover information about the review methods, characteristics of the included primary studies, the types of interventions evaluated, and the reported outcomes. This standardized data extraction form will be piloted by the review team on five to ten articles to ensure all relevant information is recorded. The quality of included systematic reviews and meta-analyses will be evaluated using AMSTAR 2. PROSPERO registration number is CRD42024529371.</p><p><strong>Results: </strong>The study will present a narrative synthesis of the findings, addressing the clinical and methodological heterogeneity and assessing the impact of clinical pathways on various healthcare outcomes.</p><p><strong>Conclusion and implications: </strong>This umbrella review will provide evidence-based insights into the effectiveness, challenges, and best practices of clinical pathways, guiding healthcare decision-making and identifying areas for future research. Results will be disseminated widely to inform policy and improve healthcare service delivery.</p><p><strong>Patient or public contribution: </strong>No patient or public contribution, as this paper is a protocol of an umbrella review.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The equivalence of a high-stakes objective structured clinical exam adapted to suit a virtual delivery format 为适应虚拟授课形式而调整的高风险客观结构化临床考试的等效性。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-24 DOI: 10.1111/jep.14167
Karen Coetzee MA, Luxshi Amirthalingam BSc, Tabasom Eftekari BComm, Sandra Monteiro PhD

Introduction

The COVID-19 pandemic necessitated rapid adaptation of clinical competence assessments, including the transition of Objective Structured Clinical Examinations (OSCE) from in-person to virtual formats. This study investigates the construct equivalence of a high-stakes OSCE, originally designed for in-person delivery, when adapted for a virtual format.

Methods

A retrospective analysis was conducted using OSCE scores from the Internationally Educated Nurse Competency Assessment Program (IENCAP®). Data were collected from 15 exam administrations between January 2018 and June 2022, encompassing 2021 examinees (1936 in-person, 85 virtual). The Many-Facet Rasch Measurement (MFRM) model was employed to analyze the invariance of examinee ability, case difficulty, and criteria difficulty across in-person and virtual formats.

Results

Results revealed overall examinee ability estimates remained invariant regardless of the OSCE format, while invariant violations were identified in only three of the 15 cases (N = 20%) adapted to suit the virtual format. The most significant adaptation, namely the use of a verbal physical examination to suit the virtual context achieved equivalence to its hands-on in-person counterpart given evidence of invariance across criteria estimates. Interestingly, criteria scores in invariant violated cases displayed a higher level of stability or consistency across the virtual OSCE formats versus their in-person counterpart highlighting a potential benefit of the virtual versus in-person format and potentially linked to the verbal physical examination.

Conclusion

The study found that while examinee ability and case difficulty estimates exhibited some invariance between in-person and virtual OSCE formats, criteria involving physical assessments faced challenges in maintaining construct equivalence. These findings highlight the need for careful consideration in adapting high-stakes clinical assessments to virtual formats to ensure fairness and reliability.

导言:COVID-19大流行使得临床能力评估需要快速调整,包括将客观结构化临床考试(OSCE)从面对面形式过渡到虚拟形式。本研究调查了高风险 OSCE 的结构等效性,该 OSCE 原本是为面授形式设计的,在改编为虚拟形式后,其结构等效性得到了提高:方法:使用国际教育护士能力评估项目(IENCAP®)的 OSCE 分数进行了回顾性分析。数据收集自2018年1月至2022年6月期间的15次考试,共涉及2021名考生(1936名现场考生,85名虚拟考生)。采用多面拉施测量(MFRM)模型分析了考生能力、案例难度和标准难度在面对面和虚拟形式中的不变性:结果显示,无论采用哪种OSCE形式,考生的总体能力估计值都保持不变,而在15个为适应虚拟形式而调整的案例中,只有3个案例(N = 20%)发现了违反不变性的情况。最重要的改编,即使用口头体格检查来适应虚拟环境,在标准估计值不变的情况下,实现了与亲身实践的等效。有趣的是,在不同的虚拟 OSCE 形式下,不变的违规案例中的标准分数显示出较高的稳定性或一致性,这突出了虚拟 OSCE 形式相对于现场 OSCE 形式的潜在优势,并可能与口头体格检查有关:研究发现,虽然考生能力和病例难度估计在面对面和虚拟 OSCE 形式之间表现出一定的不变性,但涉及身体评估的标准在保持构造等效性方面面临挑战。这些发现突出表明,在将高风险的临床评估调整为虚拟形式时,需要慎重考虑,以确保公平性和可靠性。
{"title":"The equivalence of a high-stakes objective structured clinical exam adapted to suit a virtual delivery format","authors":"Karen Coetzee MA,&nbsp;Luxshi Amirthalingam BSc,&nbsp;Tabasom Eftekari BComm,&nbsp;Sandra Monteiro PhD","doi":"10.1111/jep.14167","DOIUrl":"10.1111/jep.14167","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The COVID-19 pandemic necessitated rapid adaptation of clinical competence assessments, including the transition of Objective Structured Clinical Examinations (OSCE) from in-person to virtual formats. This study investigates the construct equivalence of a high-stakes OSCE, originally designed for in-person delivery, when adapted for a virtual format.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A retrospective analysis was conducted using OSCE scores from the Internationally Educated Nurse Competency Assessment Program (IENCAP®). Data were collected from 15 exam administrations between January 2018 and June 2022, encompassing 2021 examinees (1936 in-person, 85 virtual). The Many-Facet Rasch Measurement (MFRM) model was employed to analyze the invariance of examinee ability, case difficulty, and criteria difficulty across in-person and virtual formats.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Results revealed overall examinee ability estimates remained invariant regardless of the OSCE format, while invariant violations were identified in only three of the 15 cases (<i>N</i> = 20%) adapted to suit the virtual format. The most significant adaptation, namely the use of a verbal physical examination to suit the virtual context achieved equivalence to its hands-on in-person counterpart given evidence of invariance across criteria estimates. Interestingly, criteria scores in invariant violated cases displayed a higher level of stability or consistency across the virtual OSCE formats versus their in-person counterpart highlighting a potential benefit of the virtual versus in-person format and potentially linked to the verbal physical examination.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The study found that while examinee ability and case difficulty estimates exhibited some invariance between in-person and virtual OSCE formats, criteria involving physical assessments faced challenges in maintaining construct equivalence. These findings highlight the need for careful consideration in adapting high-stakes clinical assessments to virtual formats to ensure fairness and reliability.</p>\u0000 </section>\u0000 </div>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":"31 1","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jep.14167","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Misconceptions about randomisation harm validity of randomised controlled trials. 关于随机化的误解损害了随机对照试验的有效性。
IF 2.1 4区 医学 Q3 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-24 DOI: 10.1111/jep.14224
Wolfgang Mastnak

Rationale: The coherence theory of truth, the epistemology of evidence-based medicine, mathematical statistics, and axiomatic mathematics.

Aims and objectives: To explore mathematical misconceptions inhering in randomised controlled trial designs, suggest improvements, encourage meta-methodological discussions and call for further interdisciplinary studies.

Method: Mathematical-statistical analyses and science-philosophical considerations.

Results: Randomisation does not (necessarily) generate equal samples, ergo, outcomes of usual RCTs are not as reliable as they claim. Moreover, ignoring initial sample discrepancies may cause inaccuracies similar to type I and type II errors. Insufficient awareness of these flaws harms final RCT statements about significance and evidence levels, hence their loss of trustworthiness. Statistical parameters such as the standard error of the mean may help to estimate the expected distinction between random samples.

Conclusion: Researchers in EBM should be aware of systemic misconceptions in RCT standards. Pre-measurement can reduce shortcomings, e.g. through calculation how sample differences impact on usual RCT processing, or randomisation is given up in favour of mathematical minimisation of sample differences, i.e. optimising statistical sample equality. Moreover, the promising future of dynamic simulation models is highlighted.

理论依据:真理一致性理论、循证医学认识论、数理统计和公理数学:探讨随机对照试验设计中固有的数学误区,提出改进建议,鼓励元方法论讨论,呼吁进一步开展跨学科研究:方法:数学统计分析和科学哲学思考:随机化并不能(必然)产生平等的样本,因此,通常的 RCT 结果并不像它们声称的那样可靠。此外,忽略初始样本差异可能会导致类似于 I 型和 II 型错误的不准确性。如果对这些缺陷认识不足,就会损害 RCT 关于显著性和证据水平的最终声明,从而使其失去可信度。平均值标准误差等统计参数可能有助于估计随机样本之间的预期差异:EBM研究人员应意识到RCT标准中的系统性误区。预先测量可以减少缺陷,例如通过计算样本差异对 RCT 常规处理的影响,或者放弃随机化,而采用数学方法最小化样本差异,即优化统计样本平等。此外,还强调了动态模拟模型的美好前景。
{"title":"Misconceptions about randomisation harm validity of randomised controlled trials.","authors":"Wolfgang Mastnak","doi":"10.1111/jep.14224","DOIUrl":"https://doi.org/10.1111/jep.14224","url":null,"abstract":"<p><strong>Rationale: </strong>The coherence theory of truth, the epistemology of evidence-based medicine, mathematical statistics, and axiomatic mathematics.</p><p><strong>Aims and objectives: </strong>To explore mathematical misconceptions inhering in randomised controlled trial designs, suggest improvements, encourage meta-methodological discussions and call for further interdisciplinary studies.</p><p><strong>Method: </strong>Mathematical-statistical analyses and science-philosophical considerations.</p><p><strong>Results: </strong>Randomisation does not (necessarily) generate equal samples, ergo, outcomes of usual RCTs are not as reliable as they claim. Moreover, ignoring initial sample discrepancies may cause inaccuracies similar to type I and type II errors. Insufficient awareness of these flaws harms final RCT statements about significance and evidence levels, hence their loss of trustworthiness. Statistical parameters such as the standard error of the mean may help to estimate the expected distinction between random samples.</p><p><strong>Conclusion: </strong>Researchers in EBM should be aware of systemic misconceptions in RCT standards. Pre-measurement can reduce shortcomings, e.g. through calculation how sample differences impact on usual RCT processing, or randomisation is given up in favour of mathematical minimisation of sample differences, i.e. optimising statistical sample equality. Moreover, the promising future of dynamic simulation models is highlighted.</p>","PeriodicalId":15997,"journal":{"name":"Journal of evaluation in clinical practice","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142502017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of evaluation in clinical practice
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1