CORHOH: Text corpus of holocaust oral histories

IF 1.4 Q3 MULTIDISCIPLINARY SCIENCES Data in Brief Pub Date : 2025-04-01 Epub Date: 2025-02-24 DOI:10.1016/j.dib.2025.111426
Daban Q. Jaff
{"title":"CORHOH: Text corpus of holocaust oral histories","authors":"Daban Q. Jaff","doi":"10.1016/j.dib.2025.111426","DOIUrl":null,"url":null,"abstract":"<div><div>This paper outlines the compilation and annotation process of CORHOH: Text CORpus of <strong>H</strong>olocaust <strong>O</strong>ral <strong>H</strong>istories. The corpus consists of 500 oral histories, each narrative form one survivor. The transcripts of the oral histories are retrieved from the <em>Let Them Speak Project</em> [1]. The transcripts are normalized and further annotated. The corpus offers rich metadata about both the testimony givers and the interviews. All technical content is removed, and a unique identifier is assigned to each question (posed by the interviewer) and answer (provided by the survivor). The corpus complies with the TEI guidelines [2]. The corpus includes 106,519 questions and 107,125 answers, making it easy to distinguish between the utterances that belong to the holocaust survivor or anyone else who is involved in the interview, primarily the interviewer. CORHOH is particularly suited for studies on trauma expression and psychological concepts embedded in survivors' narratives. Additionally, it offers potential for data mining to uncover patterns (e.g., migration trends) and supports natural language processing techniques, such as topic modelling, sentiment analysis, and named entity recognition. The CORHOH data is courtesy of the United States Holocaust Memorial Museum (USHMM) and is publicly available under the CC BY-NC-SA 4.0 license.</div></div>","PeriodicalId":10973,"journal":{"name":"Data in Brief","volume":"59 ","pages":"Article 111426"},"PeriodicalIF":1.4000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Data in Brief","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352340925001581","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/24 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

This paper outlines the compilation and annotation process of CORHOH: Text CORpus of Holocaust Oral Histories. The corpus consists of 500 oral histories, each narrative form one survivor. The transcripts of the oral histories are retrieved from the Let Them Speak Project [1]. The transcripts are normalized and further annotated. The corpus offers rich metadata about both the testimony givers and the interviews. All technical content is removed, and a unique identifier is assigned to each question (posed by the interviewer) and answer (provided by the survivor). The corpus complies with the TEI guidelines [2]. The corpus includes 106,519 questions and 107,125 answers, making it easy to distinguish between the utterances that belong to the holocaust survivor or anyone else who is involved in the interview, primarily the interviewer. CORHOH is particularly suited for studies on trauma expression and psychological concepts embedded in survivors' narratives. Additionally, it offers potential for data mining to uncover patterns (e.g., migration trends) and supports natural language processing techniques, such as topic modelling, sentiment analysis, and named entity recognition. The CORHOH data is courtesy of the United States Holocaust Memorial Museum (USHMM) and is publicly available under the CC BY-NC-SA 4.0 license.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
大屠杀口述历史文本语料库
本文概述了CORHOH:大屠杀口述历史文本语料库的编制和注释过程。该语料库由500个口述历史组成,每个叙述来自一位幸存者。口述历史的文字记录是从“让他们说话”项目b[1]中检索到的。对转录本进行规范化和进一步注释。语料库提供了丰富的关于证词提供者和访谈的元数据。删除所有技术内容,并为每个问题(由采访者提出)和答案(由幸存者提供)分配唯一标识符。语料库符合TEI指南[2]。语料库包括106,519个问题和107,125个答案,因此很容易区分大屠杀幸存者或其他参与访谈的人(主要是采访者)的话语。CORHOH特别适合研究创伤表达和幸存者叙事中嵌入的心理概念。此外,它为数据挖掘提供了揭示模式(例如迁移趋势)的潜力,并支持自然语言处理技术,例如主题建模、情感分析和命名实体识别。CORHOH数据由美国大屠杀纪念博物馆(USHMM)提供,并在CC BY-NC-SA 4.0许可下公开提供。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Data in Brief
Data in Brief MULTIDISCIPLINARY SCIENCES-
CiteScore
3.10
自引率
0.00%
发文量
996
审稿时长
70 days
期刊介绍: Data in Brief provides a way for researchers to easily share and reuse each other''s datasets by publishing data articles that: -Thoroughly describe your data, facilitating reproducibility. -Make your data, which is often buried in supplementary material, easier to find. -Increase traffic towards associated research articles and data, leading to more citations. -Open up doors for new collaborations. Because you never know what data will be useful to someone else, Data in Brief welcomes submissions that describe data from all research areas.
期刊最新文献
Shotgun sequencing data and SSR mining data of aibika (Abelmoschus manihot, Malvaceae) Dataset on multiregional variations of Bangla language (BD-Dialect) InclusiveHAR: A smartphone-based dataset for human activity recognition across diverse physical abilities UzbekPOS: A multi-domain dataset for Uzbek part-of-speech tagging AvianAction101: A Dataset for the dancing behavior of rose-ringed parakeets(Psittacula krameri)
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1