Observer agreement on the morphology of porous cranial lesions: Results from a workshop at the 2019 meeting of the Paleopathology Association

IF 1.3 3区 地球科学 Q3 PALEONTOLOGY International Journal of Paleopathology Pub Date : 2023-10-06 DOI:10.1016/j.ijpp.2023.09.006
Amy S. Anderson
{"title":"Observer agreement on the morphology of porous cranial lesions: Results from a workshop at the 2019 meeting of the Paleopathology Association","authors":"Amy S. Anderson","doi":"10.1016/j.ijpp.2023.09.006","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>This paper presents the results of a 2019 Paleopathology Association workshop that tested observer agreement on porous cranial lesion morphology and presence using multiple sets of existing guidelines for data collection.</p></div><div><h3>Materials</h3><p>Sixteen conference attendees of varying osteological experience served as observers. Three crania were assigned to each of four published guidelines for identifying and categorizing lesion morphology, for a total of twelve well-preserved human crania from the National Museum<span> of Natural History Biological Anthropology Collections.</span></p></div><div><h3>Methods</h3><p>Observers assessed each cranium macroscopically according to its assigned set of guidelines.</p></div><div><h3>Results</h3><p>Observer concordance was higher using scoring guidelines with higher-quality photographs, such as the 2019 guidelines from Rinaldo and colleagues.</p></div><div><h3>Conclusions</h3><p>Data collection guidelines with high-quality color photos may support greater reliability of researcher-generated data on macroscopic skeletal features.</p></div><div><h3>Significance</h3><p>The conclusions of any research study are only as reliable as the data on which they are based. This work highlights the need for ongoing practices of quality control in a field in which much data results from individual judgement calls.</p></div><div><h3>Limitations</h3><p>Observer concordance is not a measure of observer accuracy. Sample size is insufficient to draw broadly generalizable conclusions on the reliability of data collected using the guidelines tested, and conference environments are not a facsimile of research settings.</p></div><div><h3>Suggestions for further research</h3><p>Iterative testing of methodological consistency using larger sample sizes and more non-pathological crania is advised to identify the factors that influence observer discordance and to improve guidelines for qualitative assessments.</p></div>","PeriodicalId":48817,"journal":{"name":"International Journal of Paleopathology","volume":"43 ","pages":"Pages 68-71"},"PeriodicalIF":1.3000,"publicationDate":"2023-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Paleopathology","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1879981723000542","RegionNum":3,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PALEONTOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objective

This paper presents the results of a 2019 Paleopathology Association workshop that tested observer agreement on porous cranial lesion morphology and presence using multiple sets of existing guidelines for data collection.

Materials

Sixteen conference attendees of varying osteological experience served as observers. Three crania were assigned to each of four published guidelines for identifying and categorizing lesion morphology, for a total of twelve well-preserved human crania from the National Museum of Natural History Biological Anthropology Collections.

Methods

Observers assessed each cranium macroscopically according to its assigned set of guidelines.

Results

Observer concordance was higher using scoring guidelines with higher-quality photographs, such as the 2019 guidelines from Rinaldo and colleagues.

Conclusions

Data collection guidelines with high-quality color photos may support greater reliability of researcher-generated data on macroscopic skeletal features.

Significance

The conclusions of any research study are only as reliable as the data on which they are based. This work highlights the need for ongoing practices of quality control in a field in which much data results from individual judgement calls.

Limitations

Observer concordance is not a measure of observer accuracy. Sample size is insufficient to draw broadly generalizable conclusions on the reliability of data collected using the guidelines tested, and conference environments are not a facsimile of research settings.

Suggestions for further research

Iterative testing of methodological consistency using larger sample sizes and more non-pathological crania is advised to identify the factors that influence observer discordance and to improve guidelines for qualitative assessments.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
观察者对多孔性颅骨损伤形态的一致意见:来自古病理学协会2019年会议的一个研讨会的结果。
目的:本文介绍了2019年古病理学协会研讨会的结果,该研讨会使用多套现有的数据收集指南测试了观察者对多孔性颅骨损伤形态和存在的一致性。材料:16名具有不同骨病经验的与会者作为观察员。在国家自然历史博物馆生物人类学收藏的12个保存完好的人类头骨中,四个已发表的损伤形态识别和分类指南中的每一个都分配了三个头骨。方法:观察者根据指定的一套指南对每个头骨进行宏观评估。结果:使用具有更高质量照片的评分指南,如Rinaldo及其同事的2019年指南,观察者的一致性更高。结论:高质量彩色照片的数据收集指南可以支持研究人员生成的宏观骨骼特征数据的更高可靠性。意义:任何研究的结论都只有与所依据的数据一样可靠。这项工作强调了在一个许多数据来自个人判断调用的领域中,需要进行持续的质量控制实践。局限性:观察者的一致性并不是衡量观察者准确性的标准。样本量不足以就使用测试指南收集的数据的可靠性得出广泛的结论,会议环境也不是研究环境的翻版。进一步研究的建议:建议使用更大的样本量和更多的非病理性颅骨对方法的一致性进行迭代测试,以确定影响观察者不一致的因素,并改进定性评估的指南。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
2.90
自引率
25.00%
发文量
43
期刊介绍: Paleopathology is the study and application of methods and techniques for investigating diseases and related conditions from skeletal and soft tissue remains. The International Journal of Paleopathology (IJPP) will publish original and significant articles on human and animal (including hominids) disease, based upon the study of physical remains, including osseous, dental, and preserved soft tissues at a range of methodological levels, from direct observation to molecular, chemical, histological and radiographic analysis. Discussion of ways in which these methods can be applied to the reconstruction of health, disease and life histories in the past is central to the discipline, so the journal would also encourage papers covering interpretive and theoretical issues, and those that place the study of disease at the centre of a bioarchaeological or biocultural approach. Papers dealing with historical evidence relating to disease in the past (rather than history of medicine) will also be published. The journal will also accept significant studies that applied previously developed techniques to new materials, setting the research in the context of current debates on past human and animal health.
期刊最新文献
Histology of pulmonary tuberculosis in a 19th-century mummy from Comiso (Sicily, Italy) Expanding the diagnostic scope of paleopathology: Identification of Q fever (Coxiella burnetii) using a One Paleopathology approach Rickets, resorption and revolution: An investigation into the relationship between vitamin D deficiency in childhood and osteoporosis in adulthood in an 18th-19th century population Characteristics of dental malocclusion in a 18th/19th century population from Radom (Poland) A severe case of bilateral humerus varus deformity from the Middle Bronze age necropolis of Olmo di Nogara, Northeast Italy. The contribution of biomechanical analysis to paleopathological study
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1