Pub Date : 2025-11-25DOI: 10.1136/bmjqs-2025-019415
James Galloway, Matthew Jones, Mark Gibson, Kaiyang Song, Katie Bechman, Rajiv Mohanraj, Sam Norton, Mark D Russell
Background: Valproate exposure during pregnancy causes major congenital malformations in 11% and neurodevelopmental disorders in 30-40% of exposed children. Despite regulatory interventions, including the European 2018 Pregnancy Prevention Programme, pregnancy exposures continued. We evaluated the impact of a Medicines and Healthcare products Regulatory Agency National Patient Safety Alert (NPSA), which mandated two-specialist approval for valproate prescribing in patients under 55 years.
Methods: We conducted a population-based interrupted time series analysis using England National Health Service (NHS) prescribing data from January 2022 to April 2025. In total, we analysed 4 879 978 valproate prescriptions-both new and repeat-across ~8000 general practices. The primary outcome was monthly patients prescribed valproate. Secondary analyses examined regional variation, possible prescribing displacement to hospitals and an equivalent time series design with lamotrigine and levetiracetam as control medications to distinguish valproate-specific effects from broader trends.
Results: Following the NPSA alert, there was a significant decrease in people prescribed valproate in primary care in England. Compared with the preintervention trend (prescribing had been increasing by +12.6 people per month), postintervention prescribing declined by -72.6 people per month, yielding a total change in trend of -85.2 people per month (95% CI -122.9 to -47.5, p<0.001). There was no immediate step change. All seven NHS regions demonstrated significant declines. Postintervention decreases were also seen for hospital prescribing. Lamotrigine and levetiracetam showed no intervention effect.
Conclusions: The 2023 NPSA alert achieved valproate prescribing reductions across England through mandatory procedural requirements. The two-specialist approval proved effective where previous educational interventions failed. However, given this restricts access to a highly effective antiepileptic drug, particularly for generalised epilepsies, prospective studies evaluating seizure control outcomes following valproate withdrawal are needed to assess the impact of these regulatory restrictions.
{"title":"Mandatory specialist approval requirements reduce valproate prescribing: population-based evaluation of a National Patient Safety Alert.","authors":"James Galloway, Matthew Jones, Mark Gibson, Kaiyang Song, Katie Bechman, Rajiv Mohanraj, Sam Norton, Mark D Russell","doi":"10.1136/bmjqs-2025-019415","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-019415","url":null,"abstract":"<p><strong>Background: </strong>Valproate exposure during pregnancy causes major congenital malformations in 11% and neurodevelopmental disorders in 30-40% of exposed children. Despite regulatory interventions, including the European 2018 Pregnancy Prevention Programme, pregnancy exposures continued. We evaluated the impact of a Medicines and Healthcare products Regulatory Agency National Patient Safety Alert (NPSA), which mandated two-specialist approval for valproate prescribing in patients under 55 years.</p><p><strong>Methods: </strong>We conducted a population-based interrupted time series analysis using England National Health Service (NHS) prescribing data from January 2022 to April 2025. In total, we analysed 4 879 978 valproate prescriptions-both new and repeat-across ~8000 general practices. The primary outcome was monthly patients prescribed valproate. Secondary analyses examined regional variation, possible prescribing displacement to hospitals and an equivalent time series design with lamotrigine and levetiracetam as control medications to distinguish valproate-specific effects from broader trends.</p><p><strong>Results: </strong>Following the NPSA alert, there was a significant decrease in people prescribed valproate in primary care in England. Compared with the preintervention trend (prescribing had been increasing by +12.6 people per month), postintervention prescribing declined by -72.6 people per month, yielding a total change in trend of -85.2 people per month (95% CI -122.9 to -47.5, p<0.001). There was no immediate step change. All seven NHS regions demonstrated significant declines. Postintervention decreases were also seen for hospital prescribing. Lamotrigine and levetiracetam showed no intervention effect.</p><p><strong>Conclusions: </strong>The 2023 NPSA alert achieved valproate prescribing reductions across England through mandatory procedural requirements. The two-specialist approval proved effective where previous educational interventions failed. However, given this restricts access to a highly effective antiepileptic drug, particularly for generalised epilepsies, prospective studies evaluating seizure control outcomes following valproate withdrawal are needed to assess the impact of these regulatory restrictions.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145602264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-24DOI: 10.1136/bmjqs-2025-019299
Jonathan Wang, Donald A Redelmeier
Background: Artificial intelligence large language models (LLMs) are increasingly used to inform clinical decisions but sometimes exhibit human-like cognitive biases when facing nuanced medical choices.
Methods: We tested whether new chain-of-thought reasoning LLMs might mitigate cognitive biases observed in physicians. We presented medical scenarios (n=10) to models released by DeepSeek, OpenAI and Google. Each scenario was presented in two versions that differed according to a specific bias (eg, surgery framed in survival vs mortality statistics). Responses were categorised and the extent of bias was measured by the absolute discrepancy between responses to different versions of the same scenario. The extent of intransigence (also termed dogma or inflexibility) was measured by Shannon entropy. The extent of deviance in each scenario was measured by comparing the average model response to the average practicing physician response (n=2507).
Results: DeepSeek-R1 mitigated 6 out of 10 cognitive biases observed in practicing physicians by generating intransigent all-or-none responses. The four biases that persisted were post hoc fallacy (34% vs 0%, p<0.001), decoy effects (44% vs 5%, p<0.001), Occam's razor fallacy (100% vs 0%, p<0.001) and hindsight bias (56% vs 0%, p<0.001). In every scenario, the average model response deviated substantially from the average response of practicing physicians (p<0.001 for all). Similar patterns of persistent specific biases, intransigent responses and substantial deviance from practicing physicians were also apparent in OpenAI and Google.
Conclusion: Some biases persist in chain-of-thought reasoning LLMs, and models tend to produce intransigent recommendations. These findings highlight the role of clinicians to think broadly, respect diversity and remain vigilant when interpreting chain-of-thought reasoning artificial intelligence LLMs in nuanced medical decisions for patients.
{"title":"Artificial intelligence chain-of-thought reasoning in nuanced medical scenarios: mitigation of cognitive biases through model intransigence.","authors":"Jonathan Wang, Donald A Redelmeier","doi":"10.1136/bmjqs-2025-019299","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-019299","url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence large language models (LLMs) are increasingly used to inform clinical decisions but sometimes exhibit human-like cognitive biases when facing nuanced medical choices.</p><p><strong>Methods: </strong>We tested whether new chain-of-thought reasoning LLMs might mitigate cognitive biases observed in physicians. We presented medical scenarios (n=10) to models released by DeepSeek, OpenAI and Google. Each scenario was presented in two versions that differed according to a specific bias (eg, surgery framed in survival vs mortality statistics). Responses were categorised and the extent of bias was measured by the absolute discrepancy between responses to different versions of the same scenario. The extent of intransigence (also termed dogma or inflexibility) was measured by Shannon entropy. The extent of deviance in each scenario was measured by comparing the average model response to the average practicing physician response (n=2507).</p><p><strong>Results: </strong>DeepSeek-R1 mitigated 6 out of 10 cognitive biases observed in practicing physicians by generating intransigent all-or-none responses. The four biases that persisted were post hoc fallacy (34% vs 0%, p<0.001), decoy effects (44% vs 5%, p<0.001), Occam's razor fallacy (100% vs 0%, p<0.001) and hindsight bias (56% vs 0%, p<0.001). In every scenario, the average model response deviated substantially from the average response of practicing physicians (p<0.001 for all). Similar patterns of persistent specific biases, intransigent responses and substantial deviance from practicing physicians were also apparent in OpenAI and Google.</p><p><strong>Conclusion: </strong>Some biases persist in chain-of-thought reasoning LLMs, and models tend to produce intransigent recommendations. These findings highlight the role of clinicians to think broadly, respect diversity and remain vigilant when interpreting chain-of-thought reasoning artificial intelligence LLMs in nuanced medical decisions for patients.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145595914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-23DOI: 10.1136/bmjqs-2025-019416
Persijn Honkoop, Marco Krukerink
{"title":"Are we careless about continuity of care?","authors":"Persijn Honkoop, Marco Krukerink","doi":"10.1136/bmjqs-2025-019416","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-019416","url":null,"abstract":"","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145586047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-19DOI: 10.1136/bmjqs-2024-017809
Dafina Petrova, Daniel Redondo-Sánchez, Miguel Rodríguez-Barranco, Rafael Marcos-Gragera, Marcela Guevara, Marià Carulla, Arantza López de Munain, Ana Vizcaíno, Sonia Del Barco, Encarnación González-Flores, Marina Pollán, María-José Sánchez
Introduction and aims: Women residing in lower socioeconomic status (SES) areas have lower breast cancer survival but it is not clear how differences in the quality of care received contribute to these disparities. We compared adherence to clinical practice guidelines (CPG) for the diagnosis and treatment of breast cancer and subsequent breast cancer survival between women residing in lower versus higher SES areas.
Methods: We conducted a multicentre population-based study of all new cases of invasive breast cancer in women diagnosed 2010-2014 in six Spanish provinces with population-based cancer registries (n=3206). Clinical data were extracted in the framework of the European Cancer High Resolution studies and vital status follow-up covered a minimum of 5 years. SES of the patient's residence was measured with the 2011 Spanish Deprivation Index. Adherence to CPG was measured with 16 indicators based on European and Spanish guidelines. Relative survival was modelled using flexible parametric models.
Results: There were no differences in the type of treatment received but women living in the lowest SES areas were less likely to undergo a sentinel lymph node biopsy, reconstruction after mastectomy, surgery within 30 days after pathological diagnosis and adjuvant treatment within 6 weeks after surgery. After accounting for demographic and clinical factors, women residing in lower SES areas had higher risk of death, HR=1.57 (95% CI 1.04, 2.36). Further accounting for adherence to CPG in the model, in particular having undergone a sentinel lymph node biopsy, eliminated the significant effect of SES.
Conclusions: Despite the overall coverage of the Spanish health system, women living in more deprived areas were less likely to receive care in line with CPG and had shorter survival.
简介和目的:生活在低社会经济地位(SES)地区的妇女乳腺癌存活率较低,但目前尚不清楚所接受的护理质量差异如何导致这些差异。我们比较了生活在低社会经济地位地区和高社会经济地位地区的妇女对乳腺癌诊断和治疗的临床实践指南(CPG)的依从性以及随后的乳腺癌生存率。方法:我们开展了一项基于人群的多中心研究,研究对象为2010-2014年在西班牙6个省诊断为浸润性乳腺癌的所有新病例(n=3206)。临床数据在欧洲癌症高分辨率研究框架中提取,生命状态随访至少5年。使用2011年西班牙语剥夺指数测量患者住所的SES。根据欧洲和西班牙的指导方针,用16个指标来衡量CPG的依从性。相对存活率采用柔性参数模型进行建模。结果:接受的治疗类型没有差异,但生活在最低SES地区的女性接受前哨淋巴结活检、乳房切除术后重建、病理诊断后30天内手术和术后6周内辅助治疗的可能性较低。在考虑了人口统计学和临床因素后,居住在社会经济地位较低地区的妇女死亡风险较高,HR=1.57 (95% CI 1.04, 2.36)。在模型中进一步考虑CPG的依从性,特别是经过前哨淋巴结活检,消除了SES的显著影响。结论:尽管西班牙卫生系统的整体覆盖,生活在更贫困地区的妇女不太可能接受符合CPG的护理,生存时间也更短。
{"title":"Socioeconomic inequalities in adherence to clinical practice guidelines and breast cancer survival: a multicentre population-based study in Spain.","authors":"Dafina Petrova, Daniel Redondo-Sánchez, Miguel Rodríguez-Barranco, Rafael Marcos-Gragera, Marcela Guevara, Marià Carulla, Arantza López de Munain, Ana Vizcaíno, Sonia Del Barco, Encarnación González-Flores, Marina Pollán, María-José Sánchez","doi":"10.1136/bmjqs-2024-017809","DOIUrl":"10.1136/bmjqs-2024-017809","url":null,"abstract":"<p><strong>Introduction and aims: </strong>Women residing in lower socioeconomic status (SES) areas have lower breast cancer survival but it is not clear how differences in the quality of care received contribute to these disparities. We compared adherence to clinical practice guidelines (CPG) for the diagnosis and treatment of breast cancer and subsequent breast cancer survival between women residing in lower versus higher SES areas.</p><p><strong>Methods: </strong>We conducted a multicentre population-based study of all new cases of invasive breast cancer in women diagnosed 2010-2014 in six Spanish provinces with population-based cancer registries (n=3206). Clinical data were extracted in the framework of the European Cancer High Resolution studies and vital status follow-up covered a minimum of 5 years. SES of the patient's residence was measured with the 2011 Spanish Deprivation Index. Adherence to CPG was measured with 16 indicators based on European and Spanish guidelines. Relative survival was modelled using flexible parametric models.</p><p><strong>Results: </strong>There were no differences in the type of treatment received but women living in the lowest SES areas were less likely to undergo a sentinel lymph node biopsy, reconstruction after mastectomy, surgery within 30 days after pathological diagnosis and adjuvant treatment within 6 weeks after surgery. After accounting for demographic and clinical factors, women residing in lower SES areas had higher risk of death, HR=1.57 (95% CI 1.04, 2.36). Further accounting for adherence to CPG in the model, in particular having undergone a sentinel lymph node biopsy, eliminated the significant effect of SES.</p><p><strong>Conclusions: </strong>Despite the overall coverage of the Spanish health system, women living in more deprived areas were less likely to receive care in line with CPG and had shorter survival.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":"810-823"},"PeriodicalIF":6.5,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12703246/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142908981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-19DOI: 10.1136/bmjqs-2025-019288
Elena Huang, Jessica Hart, James Won
{"title":"From SMART aims to systems thinking: expanding the scope of quality improvement and patient safety education.","authors":"Elena Huang, Jessica Hart, James Won","doi":"10.1136/bmjqs-2025-019288","DOIUrl":"10.1136/bmjqs-2025-019288","url":null,"abstract":"","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":"781-784"},"PeriodicalIF":6.5,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145367413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-19DOI: 10.1136/bmjqs-2024-017561
Nickola Pallin, John Browne, Roisin Connolly, Josephine Hegarty, Sheena McHugh
Background: Self-management support (SMS) is a recommended component of cancer survivorship care that improves health-related quality of life and reduces healthcare utilisation. However, widespread implementation has been difficult to achieve, with a gap in the literature on system-wide implementation efforts. This study examines contextual factors perceived to influence SMS adoption and sustainment in cancer centres in the Republic of Ireland.
Method: Semistructured interviews were conducted with 47 key informants from 20 cancer organisations across community and hospital settings. Participants were asked to report the level of adoption and sustainment of SMS at their organisation. This information was used to categorise organisations as low, medium or high implementers. We conducted cross-case analysis following the principles of Framework Analysis. Using the Consolidated Framework for Implementation Research as a menu of constructs, we examined factors influencing adoption and sustainment and variation in levels of implementation.
Results: National policy, external accreditation, external financing opportunities and the presence of champions in organisations are influential early in the implementation process driving adoption. Healthcare provider-led programmes and evidence of SMS improving patient outcomes and aligning with an organisation's priorities are necessary to secure buy-in, particularly among senior leadership. An organisational culture of entrepreneurship enables adoption and sustainment, with resources and a culture supporting staff well-being enabling sustainment.
Conclusion: While national policy is a driver, additional factors related to programme attributes and local contextual features such as the presence of champions, organisational readiness and culture influence implementation. The results may be used for future evaluations of SMS implementation in cancer survivorship care and to inform the development of tailored implementation strategies.
{"title":"Contextual factors that influence adoption and sustainment of self-management support in cancer survivorship care: a practical application of theory with qualitative interviews.","authors":"Nickola Pallin, John Browne, Roisin Connolly, Josephine Hegarty, Sheena McHugh","doi":"10.1136/bmjqs-2024-017561","DOIUrl":"10.1136/bmjqs-2024-017561","url":null,"abstract":"<p><strong>Background: </strong>Self-management support (SMS) is a recommended component of cancer survivorship care that improves health-related quality of life and reduces healthcare utilisation. However, widespread implementation has been difficult to achieve, with a gap in the literature on system-wide implementation efforts. This study examines contextual factors perceived to influence SMS adoption and sustainment in cancer centres in the Republic of Ireland.</p><p><strong>Method: </strong>Semistructured interviews were conducted with 47 key informants from 20 cancer organisations across community and hospital settings. Participants were asked to report the level of adoption and sustainment of SMS at their organisation. This information was used to categorise organisations as low, medium or high implementers. We conducted cross-case analysis following the principles of Framework Analysis. Using the Consolidated Framework for Implementation Research as a menu of constructs, we examined factors influencing adoption and sustainment and variation in levels of implementation.</p><p><strong>Results: </strong>National policy, external accreditation, external financing opportunities and the presence of champions in organisations are influential early in the implementation process driving adoption. Healthcare provider-led programmes and evidence of SMS improving patient outcomes and aligning with an organisation's priorities are necessary to secure buy-in, particularly among senior leadership. An organisational culture of entrepreneurship enables adoption and sustainment, with resources and a culture supporting staff well-being enabling sustainment.</p><p><strong>Conclusion: </strong>While national policy is a driver, additional factors related to programme attributes and local contextual features such as the presence of champions, organisational readiness and culture influence implementation. The results may be used for future evaluations of SMS implementation in cancer survivorship care and to inform the development of tailored implementation strategies.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":"798-809"},"PeriodicalIF":6.5,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12703244/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142614508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-19DOI: 10.1136/bmjqs-2025-018715
Adolfo Leonel Molina, Michele K Nichols, Colm P Travers, Stephanie Berger, Emily A Smitherman, David P Galloway, Rachel Kassel, Samuel Gentle, Andrea Kennedy, Chang L Wu, Susan Walley
Introduction: QI education is essential for resident physicians with established requirements from the Accreditation Council for Graduate Medical Education outlining the necessary components. Literature supports the inclusion of both didactic and experiential learning, however, most studies review knowledge and attitude based assessments of residency QI programs. In 2012, our pediatric residency program identified a gap in resident engagement in QI, which led to the formalization of a QI education program grounded in the Institute for Healthcare Improvement (IHI) Model for improvement with objective measures of QI projects.
Methods: Over 13 years, our program implemented interative interventions across three phases to enchance QI training. Initial core interventions involved the structure of didactics to teach core principles of QI and with time focusing on more individualized mentorship. Our efforts were guided through a residency QI committee. Our aim was to (1) increase the percentage of resident QI projects with SMART aims, and (2) increase the use of QI graphs (run charts and SPC charts) of resident QI projects. We tracked graduating resident exit survey satisfaction with the QI program as a balancing measure.
Results: From 2012 through 2025, over 300 resident completed 390 QI projects that were reviewed. The percentage of of projects with SMART aims and QI graphs increased over time. The percentage of projects applying for American Board of Pediatrics Part IV applications and presenting at conferences also increased. Resident satisfaction remained with with an average "Poor" rating of only 2.6%.
Conclusions: Using the model for improvement to assess objective measures in a residency QI program is both feasible and effective. This 13-year intiative demonstrates how systematic, iterative improvement can improve the rigor of resident QI projects. Future goals including leveraging informatics to further support residents with their projects and track downstream patient outcomes.
{"title":"QIing your QI: a 13-year experience of a paediatric residency QI programme.","authors":"Adolfo Leonel Molina, Michele K Nichols, Colm P Travers, Stephanie Berger, Emily A Smitherman, David P Galloway, Rachel Kassel, Samuel Gentle, Andrea Kennedy, Chang L Wu, Susan Walley","doi":"10.1136/bmjqs-2025-018715","DOIUrl":"10.1136/bmjqs-2025-018715","url":null,"abstract":"<p><strong>Introduction: </strong>QI education is essential for resident physicians with established requirements from the Accreditation Council for Graduate Medical Education outlining the necessary components. Literature supports the inclusion of both didactic and experiential learning, however, most studies review knowledge and attitude based assessments of residency QI programs. In 2012, our pediatric residency program identified a gap in resident engagement in QI, which led to the formalization of a QI education program grounded in the Institute for Healthcare Improvement (IHI) Model for improvement with objective measures of QI projects.</p><p><strong>Methods: </strong>Over 13 years, our program implemented interative interventions across three phases to enchance QI training. Initial core interventions involved the structure of didactics to teach core principles of QI and with time focusing on more individualized mentorship. Our efforts were guided through a residency QI committee. Our aim was to (1) increase the percentage of resident QI projects with SMART aims, and (2) increase the use of QI graphs (run charts and SPC charts) of resident QI projects. We tracked graduating resident exit survey satisfaction with the QI program as a balancing measure.</p><p><strong>Results: </strong>From 2012 through 2025, over 300 resident completed 390 QI projects that were reviewed. The percentage of of projects with SMART aims and QI graphs increased over time. The percentage of projects applying for American Board of Pediatrics Part IV applications and presenting at conferences also increased. Resident satisfaction remained with with an average \"Poor\" rating of only 2.6%.</p><p><strong>Conclusions: </strong>Using the model for improvement to assess objective measures in a residency QI program is both feasible and effective. This 13-year intiative demonstrates how systematic, iterative improvement can improve the rigor of resident QI projects. Future goals including leveraging informatics to further support residents with their projects and track downstream patient outcomes.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":"824-832"},"PeriodicalIF":6.5,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144793446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-19DOI: 10.1136/bmjqs-2024-018243
Melissa Therese Baysari, Sarah Nicole Hilmer, Richard O Day, Bethany Annemarie Van Dort, Wu Yi Zheng, Renee Quirk, Danielle Deidun, Maria Moran, Kristian Stanceski, Nanda Aryal, Ahmed Abo Salem, Lauren Farrow, Jannah Baker, Andrew Hargreaves, James Grant, Paula Doherty, Karma Zarif Sourial Mekhail, Johanna I Westbrook, Ling Li
Background: Drug-drug interaction (DDI) alerts target the co-prescription of two potentially interacting medications and are a frequent feature of electronic medical records (EMRs). There have been few controlled studies evaluating the effectiveness of DDI alerts. This study aimed to determine the impact of DDI alerts on rates of DDIs and on associated patient harms.
Methods: Quasi-experimental controlled pre-post study in five Australian hospitals. Three hospitals acted as control hospitals (EMR with no DDI alerts) and two as intervention (EMR with DDI alerts). Only DDI alerts at the highest severity level (defined as 'major contraindicated') were switched on at intervention hospitals. These alerts were not tailored to clinical context (ie, patient, drug). A total of 2078 patients were randomly selected from all patients (adult and paediatric) admitted to hospitals 6 months before and 6 months after EMR implementation. A retrospective chart review was performed by study pharmacists. The primary outcome was the proportion of admissions with a clinically relevant DDI. Secondary outcomes included the proportions of admissions with a potential DDI and with DDI-related harm.
Results: Potential DDIs were identified in the majority of admissions (n=1574, 74.7%) and clinically relevant DDIs identified in half (n=1026, 48.7%). DDI alerts were associated with a reduction in the proportion of admissions with potential DDIs (adjusted OR (AOR)=0.38 (0.19, 0.78)) but no change in clinically relevant DDIs (AOR=1.12 (0.68, 1.84)) or in DDI-related harm (AOR=2.42 (0.47,12.31)). 199 DDIs (76 at control and 123 at intervention hospitals) for 35 patient admissions were associated with patient harm, and 2 patients experienced severe DDI-related harm pre-EMR implementation.
Discussion: Implementation of DDI alerts, without tailoring alerts to clinical context, is unlikely to reduce patient harms from DDIs. Organisations should reconsider implementation of DDI alerts in EMRs where significant tailoring of alerts is not possible. Future research should focus on identifying safe, efficient and cost-effective ways of refining DDI alerts, so expected clinical benefits are achieved, and negative consequences of excessive alerting are minimised.
{"title":"Effectiveness of computerised alerts to reduce drug-drug interactions (DDIs) and DDI-related harm in hospitalised patients: a quasi-experimental controlled pre-post study.","authors":"Melissa Therese Baysari, Sarah Nicole Hilmer, Richard O Day, Bethany Annemarie Van Dort, Wu Yi Zheng, Renee Quirk, Danielle Deidun, Maria Moran, Kristian Stanceski, Nanda Aryal, Ahmed Abo Salem, Lauren Farrow, Jannah Baker, Andrew Hargreaves, James Grant, Paula Doherty, Karma Zarif Sourial Mekhail, Johanna I Westbrook, Ling Li","doi":"10.1136/bmjqs-2024-018243","DOIUrl":"10.1136/bmjqs-2024-018243","url":null,"abstract":"<p><strong>Background: </strong>Drug-drug interaction (DDI) alerts target the co-prescription of two potentially interacting medications and are a frequent feature of electronic medical records (EMRs). There have been few controlled studies evaluating the effectiveness of DDI alerts. This study aimed to determine the impact of DDI alerts on rates of DDIs and on associated patient harms.</p><p><strong>Methods: </strong>Quasi-experimental controlled pre-post study in five Australian hospitals. Three hospitals acted as control hospitals (EMR with no DDI alerts) and two as intervention (EMR with DDI alerts). Only DDI alerts at the highest severity level (defined as 'major contraindicated') were switched on at intervention hospitals. These alerts were not tailored to clinical context (ie, patient, drug). A total of 2078 patients were randomly selected from all patients (adult and paediatric) admitted to hospitals 6 months before and 6 months after EMR implementation. A retrospective chart review was performed by study pharmacists. The primary outcome was the proportion of admissions with a clinically relevant DDI. Secondary outcomes included the proportions of admissions with a potential DDI and with DDI-related harm.</p><p><strong>Results: </strong>Potential DDIs were identified in the majority of admissions (n=1574, 74.7%) and clinically relevant DDIs identified in half (n=1026, 48.7%). DDI alerts were associated with a reduction in the proportion of admissions with potential DDIs (adjusted OR (AOR)=0.38 (0.19, 0.78)) but no change in clinically relevant DDIs (AOR=1.12 (0.68, 1.84)) or in DDI-related harm (AOR=2.42 (0.47,12.31)). 199 DDIs (76 at control and 123 at intervention hospitals) for 35 patient admissions were associated with patient harm, and 2 patients experienced severe DDI-related harm pre-EMR implementation.</p><p><strong>Discussion: </strong>Implementation of DDI alerts, without tailoring alerts to clinical context, is unlikely to reduce patient harms from DDIs. Organisations should reconsider implementation of DDI alerts in EMRs where significant tailoring of alerts is not possible. Future research should focus on identifying safe, efficient and cost-effective ways of refining DDI alerts, so expected clinical benefits are achieved, and negative consequences of excessive alerting are minimised.</p>","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":"788-797"},"PeriodicalIF":6.5,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12703349/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143977307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-09DOI: 10.1136/bmjqs-2025-019580
Laetitia Hattingh, Matt Percival
{"title":"Inappropriate prescribing for older people with reduced kidney function: can we do better at the primary care level?","authors":"Laetitia Hattingh, Matt Percival","doi":"10.1136/bmjqs-2025-019580","DOIUrl":"https://doi.org/10.1136/bmjqs-2025-019580","url":null,"abstract":"","PeriodicalId":9077,"journal":{"name":"BMJ Quality & Safety","volume":" ","pages":""},"PeriodicalIF":6.5,"publicationDate":"2025-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145480824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}