排除质量非常差的暴露数据是监管风险评估的核心原则。

E. Tielemans, Y. Christopher, H. Marquart, M. Groenewold, J. V. van Hemmen
{"title":"排除质量非常差的暴露数据是监管风险评估的核心原则。","authors":"E. Tielemans, Y. Christopher, H. Marquart, M. Groenewold, J. V. van Hemmen","doi":"10.1093/ANNHYG/MEF073","DOIUrl":null,"url":null,"abstract":"In a recent issue of this journal, Money and Margary (2002) proposed some thoughtful guidelines for exposure assessment in regulatory risk assessment. Their structured approach acknowledges that currently available exposure data are of very variable quality (Northage and Marquart, 2001). We firmly underline their plea for a hierarchy in available exposure information sources, with a higher weight assigned to data with a lower level of uncertainty. The level of confidence an assessor has in the available exposure information should play an important role in the resultant risk assessment process. Moreover, the classification of data into different uncertainty categories should aid the assessor when conflicting exposure results are reported. Hence, a transparent system quantifying heterogeneity in data quality is crucial if one wants to arrive at consistent risk assessments. The approach of Money and Margary largely coincides with and was to some extent complementary to our decision tree for data quality evaluation published in the same issue (Tielemans et al., 2002). However, we question their statement that all exposure information sources should be considered as being potentially useful in the risk assessment process. On the contrary, it is our opinion that not all exposure information meets even the minimum requirements for incorporation in the exposure assessment process and the exclusion of such data should be the starting point for a transparent and robust exposure assessment. In our paper we defined minimum requirements for four different aspects, i.e. available occupational hygiene information, variability and precision issues, internal validity and external validity. We consider data sources to be unacceptable if very basic requirements are not fulfilled for these aspects. In these cases, the level of uncertainty or bias related to exposure data is in our view difficult to interpret in even a broad sense. In order to evaluate the quality of data in current European Union risk assessments of existing substances, we conducted a small-scale inventory of exposure data. One exposure assessor of our department evaluated data quality of 40 measurement series selected out of five Risk Assessment Reports (RARs). A second researcher also evaluated 20 of these sources in order to study agreement between assessors. The data classification was done according to both a strict and a lenient interpretation of our decision tree (Tielemans et al., 2002). The former implies a rigid adherence of the assessor to the rules of the decision tree. Any non-compliance to the decision rules results in exclusion of the data. The latter refers to an approach that leaves more room for subjective assessment tailored to the specific exposure assessment situation. Table 1 describes the results of our inventory. It is a striking finding that 80% of the information sources were excluded when a strict classification was applied. A lenient approach also yielded exclusion of several measurement series (12.5%), although most ratings shifted towards supplementary information (80%). It should be noted that in both approaches only a small percentage of sources resulted in sufficient information. The percentage agreement between both assessors was 85 and 70% for a strict and lenient approach, respectively. This difference is in accordance with expectation, since a less rigorous approach relies to a larger extent on subjective judgement. The outcome of our analysis clearly illustrates the contrast between a rigorous evaluation that dismisses most data as useless and a lenient approach that allows most data to be incorporated into the risk assessment process. It can be learned from this inventory that a large part of the investigated data is hampered by a poor documentation of occupational hygiene information, low precision or questionable validity. A scientifically rigorous assessment would classify these data as being of very little relevance. We agree with Money and Margary that, as a result of","PeriodicalId":342592,"journal":{"name":"The Annals of occupational hygiene","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2002-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Excluding exposure data of very poor quality is a core principle for regulatory risk assessment.\",\"authors\":\"E. Tielemans, Y. Christopher, H. Marquart, M. Groenewold, J. V. van Hemmen\",\"doi\":\"10.1093/ANNHYG/MEF073\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In a recent issue of this journal, Money and Margary (2002) proposed some thoughtful guidelines for exposure assessment in regulatory risk assessment. Their structured approach acknowledges that currently available exposure data are of very variable quality (Northage and Marquart, 2001). We firmly underline their plea for a hierarchy in available exposure information sources, with a higher weight assigned to data with a lower level of uncertainty. The level of confidence an assessor has in the available exposure information should play an important role in the resultant risk assessment process. Moreover, the classification of data into different uncertainty categories should aid the assessor when conflicting exposure results are reported. Hence, a transparent system quantifying heterogeneity in data quality is crucial if one wants to arrive at consistent risk assessments. The approach of Money and Margary largely coincides with and was to some extent complementary to our decision tree for data quality evaluation published in the same issue (Tielemans et al., 2002). However, we question their statement that all exposure information sources should be considered as being potentially useful in the risk assessment process. On the contrary, it is our opinion that not all exposure information meets even the minimum requirements for incorporation in the exposure assessment process and the exclusion of such data should be the starting point for a transparent and robust exposure assessment. In our paper we defined minimum requirements for four different aspects, i.e. available occupational hygiene information, variability and precision issues, internal validity and external validity. We consider data sources to be unacceptable if very basic requirements are not fulfilled for these aspects. In these cases, the level of uncertainty or bias related to exposure data is in our view difficult to interpret in even a broad sense. In order to evaluate the quality of data in current European Union risk assessments of existing substances, we conducted a small-scale inventory of exposure data. One exposure assessor of our department evaluated data quality of 40 measurement series selected out of five Risk Assessment Reports (RARs). A second researcher also evaluated 20 of these sources in order to study agreement between assessors. The data classification was done according to both a strict and a lenient interpretation of our decision tree (Tielemans et al., 2002). The former implies a rigid adherence of the assessor to the rules of the decision tree. Any non-compliance to the decision rules results in exclusion of the data. The latter refers to an approach that leaves more room for subjective assessment tailored to the specific exposure assessment situation. Table 1 describes the results of our inventory. It is a striking finding that 80% of the information sources were excluded when a strict classification was applied. A lenient approach also yielded exclusion of several measurement series (12.5%), although most ratings shifted towards supplementary information (80%). It should be noted that in both approaches only a small percentage of sources resulted in sufficient information. The percentage agreement between both assessors was 85 and 70% for a strict and lenient approach, respectively. This difference is in accordance with expectation, since a less rigorous approach relies to a larger extent on subjective judgement. The outcome of our analysis clearly illustrates the contrast between a rigorous evaluation that dismisses most data as useless and a lenient approach that allows most data to be incorporated into the risk assessment process. It can be learned from this inventory that a large part of the investigated data is hampered by a poor documentation of occupational hygiene information, low precision or questionable validity. A scientifically rigorous assessment would classify these data as being of very little relevance. We agree with Money and Margary that, as a result of\",\"PeriodicalId\":342592,\"journal\":{\"name\":\"The Annals of occupational hygiene\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2002-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Annals of occupational hygiene\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/ANNHYG/MEF073\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Annals of occupational hygiene","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/ANNHYG/MEF073","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5

摘要

在最近一期的本刊中,Money和Margary(2002)为监管风险评估中的暴露评估提出了一些深思熟虑的指导方针。他们的结构化方法承认,目前可用的暴露数据质量变化很大(Northage和Marquart, 2001)。我们坚定地强调他们对可用暴露信息源的层次结构的请求,对不确定性较低的数据赋予较高的权重。评估人员对现有暴露信息的信任程度应在由此产生的风险评估过程中发挥重要作用。此外,将数据分类为不同的不确定性类别应该有助于评估者在报告冲突的暴露结果时。因此,如果想要达到一致的风险评估,一个透明的系统量化数据质量的异质性是至关重要的。Money和Margary的方法在很大程度上与我们发表在同一期杂志上的数据质量评估决策树相一致,并在某种程度上是互补的(Tielemans et al., 2002)。然而,我们质疑他们关于在风险评估过程中所有暴露信息源都应被视为潜在有用的说法。相反,我们认为并非所有暴露信息都符合纳入暴露评估过程的最低要求,排除此类数据应成为透明和可靠的暴露评估的起点。在本文中,我们定义了四个不同方面的最低要求,即可用的职业卫生信息,变异性和准确性问题,内部效度和外部效度。如果不能满足这些方面的基本要求,我们认为数据源是不可接受的。在这些情况下,我们认为,与暴露数据有关的不确定性或偏差程度即使从广义上也难以解释。为了评估当前欧盟现有物质风险评估数据的质量,我们对暴露数据进行了小规模清查。我科一名暴露评估员对5份风险评估报告(RARs)中选取的40个测量系列的数据质量进行了评估。另一名研究人员也评估了其中的20个来源,以研究评估者之间的一致性。数据分类是根据我们的决策树的严格和宽松的解释来完成的(Tielemans等人,2002年)。前者意味着评估者严格遵守决策树的规则。任何不遵守决策规则的情况都会导致数据被排除在外。后者是指根据具体的暴露评估情况,为主观评估留出更多空间的方法。表1描述了我们盘点的结果。这是一个惊人的发现,80%的信息来源被排除在严格的分类应用。一种宽松的方法也产生了几个测量系列的排除(12.5%),尽管大多数评级转向补充信息(80%)。应当指出,在这两种方法中,只有一小部分来源提供了充分的资料。对于严格和宽松的方法,两个评估者之间的同意百分比分别为85%和70%。这种差异与预期是一致的,因为不那么严格的方法在很大程度上依赖于主观判断。我们的分析结果清楚地说明了严格的评估和宽松的方法之间的对比,前者认为大多数数据是无用的,而后者允许将大多数数据纳入风险评估过程。从这份清单中可以了解到,大部分调查数据受到职业卫生信息记录不良、精度低或有效性可疑的阻碍。科学上严格的评估将把这些数据归为无关紧要。我们同意Money和Margary的观点,因为
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Excluding exposure data of very poor quality is a core principle for regulatory risk assessment.
In a recent issue of this journal, Money and Margary (2002) proposed some thoughtful guidelines for exposure assessment in regulatory risk assessment. Their structured approach acknowledges that currently available exposure data are of very variable quality (Northage and Marquart, 2001). We firmly underline their plea for a hierarchy in available exposure information sources, with a higher weight assigned to data with a lower level of uncertainty. The level of confidence an assessor has in the available exposure information should play an important role in the resultant risk assessment process. Moreover, the classification of data into different uncertainty categories should aid the assessor when conflicting exposure results are reported. Hence, a transparent system quantifying heterogeneity in data quality is crucial if one wants to arrive at consistent risk assessments. The approach of Money and Margary largely coincides with and was to some extent complementary to our decision tree for data quality evaluation published in the same issue (Tielemans et al., 2002). However, we question their statement that all exposure information sources should be considered as being potentially useful in the risk assessment process. On the contrary, it is our opinion that not all exposure information meets even the minimum requirements for incorporation in the exposure assessment process and the exclusion of such data should be the starting point for a transparent and robust exposure assessment. In our paper we defined minimum requirements for four different aspects, i.e. available occupational hygiene information, variability and precision issues, internal validity and external validity. We consider data sources to be unacceptable if very basic requirements are not fulfilled for these aspects. In these cases, the level of uncertainty or bias related to exposure data is in our view difficult to interpret in even a broad sense. In order to evaluate the quality of data in current European Union risk assessments of existing substances, we conducted a small-scale inventory of exposure data. One exposure assessor of our department evaluated data quality of 40 measurement series selected out of five Risk Assessment Reports (RARs). A second researcher also evaluated 20 of these sources in order to study agreement between assessors. The data classification was done according to both a strict and a lenient interpretation of our decision tree (Tielemans et al., 2002). The former implies a rigid adherence of the assessor to the rules of the decision tree. Any non-compliance to the decision rules results in exclusion of the data. The latter refers to an approach that leaves more room for subjective assessment tailored to the specific exposure assessment situation. Table 1 describes the results of our inventory. It is a striking finding that 80% of the information sources were excluded when a strict classification was applied. A lenient approach also yielded exclusion of several measurement series (12.5%), although most ratings shifted towards supplementary information (80%). It should be noted that in both approaches only a small percentage of sources resulted in sufficient information. The percentage agreement between both assessors was 85 and 70% for a strict and lenient approach, respectively. This difference is in accordance with expectation, since a less rigorous approach relies to a larger extent on subjective judgement. The outcome of our analysis clearly illustrates the contrast between a rigorous evaluation that dismisses most data as useless and a lenient approach that allows most data to be incorporated into the risk assessment process. It can be learned from this inventory that a large part of the investigated data is hampered by a poor documentation of occupational hygiene information, low precision or questionable validity. A scientifically rigorous assessment would classify these data as being of very little relevance. We agree with Money and Margary that, as a result of
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Response to Article by Prof. Hans Kromhout, Hygiene Without Numbers. The Validity and Applicability of Using a Generic Exposure Assessment Model for Occupational Exposure to Nano-Objects and Their Aggregates and Agglomerates. Occupational Exposure to Polycyclic Aromatic Hydrocarbons in Polish Coke Plant Workers. A New Miniature Respirable Sampler for In-mask Sampling: Part 2-Tests Performed Inside the Mask. When Are Risk Analyses on Job Titles Informative?
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1