Sijm H Noteboom, Eline Kho, Denise P Veelo, Björn J P van der Ster, Maite M T van Haeren, Victor A Viersen, Marcella C A Müller, Henning Hermanns, Alexander P J Vlaar, Jimmy Schenk
{"title":"Interpretation of Viscoelastic Hemostatic Assays in Cardiac Surgery Patients: Importance of Clinical Context.","authors":"Sijm H Noteboom, Eline Kho, Denise P Veelo, Björn J P van der Ster, Maite M T van Haeren, Victor A Viersen, Marcella C A Müller, Henning Hermanns, Alexander P J Vlaar, Jimmy Schenk","doi":"10.1213/ANE.0000000000007400","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Rotational thromboelastometry (ROTEM) is widely used for point-of-care coagulation testing to reduce blood transfusions. Accurate interpretation of ROTEM data is crucial and requires substantial training. This study investigates the inter- and intrarater reliability of ROTEM interpretation among experts and compares their interpretations with a ROTEM-guided algorithm.</p><p><strong>Methods: </strong>This study was conducted at Amsterdam University Medical Center and included 90 cardiac surgery patients. ROTEM data were collected at 4 surgical stages: before induction, after aortic declamping, postcoagulation correction, and within 2 hours of intensive care unit (ICU) admission. An international panel of 7 cardiovascular anesthesiologists and one intensivist interpreted the data. Interrater reliability was assessed using Fleiss' kappa for binary decisions and the simple matching coefficient (SMC) for multiple-choice questions. Intrarater reliability with the ROTEM-guided algorithm was also evaluated.</p><p><strong>Results: </strong>Three hundred forty-three ROTEM measurements were analyzed. The interrater reliability for binary decisions was substantial to almost perfect, except after declamping (Fleiss' kappa = 0.34). The SMC for determining type of abnormality and interventions ranged from good to excellent across all ROTEM measuring moments (SMC ≥0.75). Intrarater reliability was almost perfect for binary questions (intraclass correlation coefficient [ICC] ≥0.81) and showed excellent agreement for multiple-choice questions. Comparing expert recommendations with the algorithm resulted in an average SMC of 0.70 indicating differences in intervention recommendations, with experts frequently recommending fibrinogen and protamine over the algorithm's suggestions of plasma and PCC.</p><p><strong>Conclusions: </strong>This study demonstrates high inter- and intrarater reliability in ROTEM interpretation among trained professionals in cardiac surgery, with almost perfect agreement on abnormalities and interventions. However, differences between expert evaluations and the ROTEM-guided algorithm underscore the need for advanced clinical decision-making tools. Future efforts should focus on developing personalized, data-driven algorithms without predefined cutoff values to improve accuracy and patient outcomes.</p>","PeriodicalId":7784,"journal":{"name":"Anesthesia and analgesia","volume":" ","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Anesthesia and analgesia","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1213/ANE.0000000000007400","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ANESTHESIOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Rotational thromboelastometry (ROTEM) is widely used for point-of-care coagulation testing to reduce blood transfusions. Accurate interpretation of ROTEM data is crucial and requires substantial training. This study investigates the inter- and intrarater reliability of ROTEM interpretation among experts and compares their interpretations with a ROTEM-guided algorithm.
Methods: This study was conducted at Amsterdam University Medical Center and included 90 cardiac surgery patients. ROTEM data were collected at 4 surgical stages: before induction, after aortic declamping, postcoagulation correction, and within 2 hours of intensive care unit (ICU) admission. An international panel of 7 cardiovascular anesthesiologists and one intensivist interpreted the data. Interrater reliability was assessed using Fleiss' kappa for binary decisions and the simple matching coefficient (SMC) for multiple-choice questions. Intrarater reliability with the ROTEM-guided algorithm was also evaluated.
Results: Three hundred forty-three ROTEM measurements were analyzed. The interrater reliability for binary decisions was substantial to almost perfect, except after declamping (Fleiss' kappa = 0.34). The SMC for determining type of abnormality and interventions ranged from good to excellent across all ROTEM measuring moments (SMC ≥0.75). Intrarater reliability was almost perfect for binary questions (intraclass correlation coefficient [ICC] ≥0.81) and showed excellent agreement for multiple-choice questions. Comparing expert recommendations with the algorithm resulted in an average SMC of 0.70 indicating differences in intervention recommendations, with experts frequently recommending fibrinogen and protamine over the algorithm's suggestions of plasma and PCC.
Conclusions: This study demonstrates high inter- and intrarater reliability in ROTEM interpretation among trained professionals in cardiac surgery, with almost perfect agreement on abnormalities and interventions. However, differences between expert evaluations and the ROTEM-guided algorithm underscore the need for advanced clinical decision-making tools. Future efforts should focus on developing personalized, data-driven algorithms without predefined cutoff values to improve accuracy and patient outcomes.
期刊介绍:
Anesthesia & Analgesia exists for the benefit of patients under the care of health care professionals engaged in the disciplines broadly related to anesthesiology, perioperative medicine, critical care medicine, and pain medicine. The Journal furthers the care of these patients by reporting the fundamental advances in the science of these clinical disciplines and by documenting the clinical, laboratory, and administrative advances that guide therapy. Anesthesia & Analgesia seeks a balance between definitive clinical and management investigations and outstanding basic scientific reports. The Journal welcomes original manuscripts containing rigorous design and analysis, even if unusual in their approach.