Assessing the Accuracy of Physician Self-disclosed PID Reporting: A Comparison of Data from a Physician Survey and Actual PID Case Reports from a State Surveillance System.

Abstract

Pelvic inflammatory disease is a state-mandated notifiable disease in Hawai'i. A survey assessing pelvic inflammatory disease (PID) reporting to the Hawai'i Department of Health (HDOH) PID surveillance system, was administered to physicians in Hawai'i in April 2012. To measure the accuracy of self-disclosed PID reporting, data from the survey were compared to HDOH PID surveillance system case reports. Concordance between the two data sources was assessed using Cohen's kappa statistic. We first linked data by physician name. An adjusted kappa was also calculated to minimize prevalence and bias effects. A second analysis linked data according to physician name or practice setting. In the name-based analysis, the HDOH PID surveillance database successfully matched only ten of 118 physicians (8.5%) who self-disclosed reporting a PID case. Only "slight agreement" (k= 0.09, 95% confidence interval [CI]: 0.02-0.16) was demonstrated between the two databases. The prevalence-adjusted, bias-adjusted kappa demonstrated "moderate agreement" (κ=0.53, 95% CI: 0.45-0.60). In the second (name or practice-based setting) analysis, 77 physicians with linkages were found in the HDOH surveillance database, reflecting "moderate agreement" (κ=0.52, 95% CI 0.43, 0.61). Our findings provide evidence that individual physicians are submerging their case reports into group practice/HMO aggregate reports and not reporting individually as legally mandated and hence are compromising PID surveillance quality.