From measures to action: can integrating quality measures provide system-wide insights for quality improvement decision making?

Background: Quality improvement decision makers are left to develop an understanding of quality within their healthcare system from a deluge of narrowly focused measures that reflect existing fragmentation in care and lack a clear method for triggering improvement. A one-to-one metric-to-improvement strategy is intractable and leads to unintended consequences. Although composite measures have been used and their limitations noted in the literature, what remains unknown is 'Can integrating multiple quality measures provide a systemic understanding of care quality across a healthcare system?'

Methods: We devised a four-part data-driven analytic strategy to determine if consistent insights exist about the differential utilisation of end-of-life care using up to eight publicly available end-of-life cancer care quality measures across National Cancer Institute and National Comprehensive Cancer Network-designated cancer hospitals/centres. We performed 92 experiments that included 28 correlation analyses, 4 principal component analyses, 6 parallel coordinate analyses with agglomerative hierarchical clustering across hospitals and 54 parallel coordinate analyses with agglomerative hierarchical clustering within each hospital.

Results: Across 54 centres, integrating quality measures provided no consistent insights across different integration analyses. In other words, we could not integrate quality measures to describe how the underlying quality constructs of interest-intensive care unit (ICU) visits, emergency department (ED) visits, palliative care use, lack of hospice, recent hospice, use of life-sustaining therapy, chemotherapy and advance care planning-are used relative to each other across patients. Quality measure calculations lack interconnection information to construct a story that provides insights about where, when or what care is provided to which patients. And yet, we posit and discuss why administrative claims data-used to calculate quality measures-do contain such interconnection information.

Conclusion: While integrating quality measures does not provide systemic information, new systemic mathematical constructs designed to convey interconnection information can be developed from the same administrative claims data to support quality improvement decision making.