{"title":"三项基础性执法毒品影响评估验证研究的方法质量。","authors":"Greg Kane","doi":"10.1186/1477-5751-12-16","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>A Drug Influence Evaluation (DIE) is a formal assessment of an impaired driving suspect, performed by a trained law enforcement officer who uses circumstantial facts, questioning, searching, and a physical exam to form an unstandardized opinion as to whether a suspect's driving was impaired by drugs. This paper first identifies the scientific studies commonly cited in American criminal trials as evidence of DIE accuracy, and second, uses the QUADAS tool to investigate whether the methodologies used by these studies allow them to correctly quantify the diagnostic accuracy of the DIEs currently administered by US law enforcement.</p><p><strong>Results: </strong>Three studies were selected for analysis. For each study, the QUADAS tool identified biases that distorted reported accuracies. The studies were subject to spectrum bias, selection bias, misclassification bias, verification bias, differential verification bias, incorporation bias, and review bias. The studies quantified DIE performance with prevalence-dependent accuracy statistics that are internally but not externally valid.</p><p><strong>Conclusion: </strong>The accuracies reported by these studies do not quantify the accuracy of the DIE process now used by US law enforcement. These studies do not validate current DIE practice.</p>","PeriodicalId":73849,"journal":{"name":"Journal of negative results in biomedicine","volume":"12 ","pages":"16"},"PeriodicalIF":0.0000,"publicationDate":"2013-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3828623/pdf/","citationCount":"0","resultStr":"{\"title\":\"The methodological quality of three foundational law enforcement Drug Influence Evaluation validation studies.\",\"authors\":\"Greg Kane\",\"doi\":\"10.1186/1477-5751-12-16\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>A Drug Influence Evaluation (DIE) is a formal assessment of an impaired driving suspect, performed by a trained law enforcement officer who uses circumstantial facts, questioning, searching, and a physical exam to form an unstandardized opinion as to whether a suspect's driving was impaired by drugs. This paper first identifies the scientific studies commonly cited in American criminal trials as evidence of DIE accuracy, and second, uses the QUADAS tool to investigate whether the methodologies used by these studies allow them to correctly quantify the diagnostic accuracy of the DIEs currently administered by US law enforcement.</p><p><strong>Results: </strong>Three studies were selected for analysis. For each study, the QUADAS tool identified biases that distorted reported accuracies. The studies were subject to spectrum bias, selection bias, misclassification bias, verification bias, differential verification bias, incorporation bias, and review bias. The studies quantified DIE performance with prevalence-dependent accuracy statistics that are internally but not externally valid.</p><p><strong>Conclusion: </strong>The accuracies reported by these studies do not quantify the accuracy of the DIE process now used by US law enforcement. These studies do not validate current DIE practice.</p>\",\"PeriodicalId\":73849,\"journal\":{\"name\":\"Journal of negative results in biomedicine\",\"volume\":\"12 \",\"pages\":\"16\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2013-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3828623/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of negative results in biomedicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1186/1477-5751-12-16\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of negative results in biomedicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/1477-5751-12-16","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
背景:药物影响评估(DIE)是由一名训练有素的执法人员对驾驶能力受损的嫌疑人进行的正式评估,执法人员通过间接事实、询问、搜查和身体检查,对嫌疑人的驾驶是否受到药物影响形成非标准化的意见。本文首先确定了在美国刑事审判中常被引用作为DIE准确性证据的科学研究,其次使用QUADAS工具调查这些研究使用的方法是否能够正确量化美国执法部门目前使用的DIE的诊断准确性:我们选择了三项研究进行分析。对于每项研究,QUADAS 工具都发现了歪曲报告准确性的偏差。这些研究存在频谱偏差、选择偏差、误分类偏差、验证偏差、差异验证偏差、纳入偏差和审查偏差。这些研究通过依赖于流行率的准确性统计来量化 DIE 的性能,这些统计具有内部有效性,但不具有外部有效性:结论:这些研究报告的准确性并不能量化美国执法部门目前使用的 DIE 流程的准确性。这些研究并未验证当前的 DIE 实践。
The methodological quality of three foundational law enforcement Drug Influence Evaluation validation studies.
Background: A Drug Influence Evaluation (DIE) is a formal assessment of an impaired driving suspect, performed by a trained law enforcement officer who uses circumstantial facts, questioning, searching, and a physical exam to form an unstandardized opinion as to whether a suspect's driving was impaired by drugs. This paper first identifies the scientific studies commonly cited in American criminal trials as evidence of DIE accuracy, and second, uses the QUADAS tool to investigate whether the methodologies used by these studies allow them to correctly quantify the diagnostic accuracy of the DIEs currently administered by US law enforcement.
Results: Three studies were selected for analysis. For each study, the QUADAS tool identified biases that distorted reported accuracies. The studies were subject to spectrum bias, selection bias, misclassification bias, verification bias, differential verification bias, incorporation bias, and review bias. The studies quantified DIE performance with prevalence-dependent accuracy statistics that are internally but not externally valid.
Conclusion: The accuracies reported by these studies do not quantify the accuracy of the DIE process now used by US law enforcement. These studies do not validate current DIE practice.