Luis Salamanca, Laurence Brandenberger, L. Gasser, Sophia Schlosser, Marta Balode, Vincent Jung, F. Pérez-Cruz, Frank Schweitzer
{"title":"处理大型档案记录:瑞士议会档案案例","authors":"Luis Salamanca, Laurence Brandenberger, L. Gasser, Sophia Schlosser, Marta Balode, Vincent Jung, F. Pérez-Cruz, Frank Schweitzer","doi":"10.1111/spsr.12590","DOIUrl":null,"url":null,"abstract":"Legislative bodies generally keep records of their activities. While the digitization wave spurred the availability of archival documents, their processing remains a challenge. The Swiss parliamentary records are no exception.In this paper we present a supervised pipeline for extracting and structuring of content of archival records. Our pipeline consists of five steps, starting with an assessment of which elements need extraction and how they relate to each other. Step two involves general pre‐processing to prepare the PDF documents and is followed by an element classification step. Step four involves post‐processing and the final step is a validation of the extracted information. With our supervised approach, we are able to process over 200,000 pages of Swiss parliamentary records (spanning the years 1891–1995), a feat that would exceed the budget of most projects using manual curation. We discuss validation of individual steps and offer guidance to researchers engaged in similar data processing efforts.","PeriodicalId":46785,"journal":{"name":"Swiss Political Science Review","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2024-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Processing Large‐Scale Archival Records: The Case of the Swiss Parliamentary Records\",\"authors\":\"Luis Salamanca, Laurence Brandenberger, L. Gasser, Sophia Schlosser, Marta Balode, Vincent Jung, F. Pérez-Cruz, Frank Schweitzer\",\"doi\":\"10.1111/spsr.12590\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Legislative bodies generally keep records of their activities. While the digitization wave spurred the availability of archival documents, their processing remains a challenge. The Swiss parliamentary records are no exception.In this paper we present a supervised pipeline for extracting and structuring of content of archival records. Our pipeline consists of five steps, starting with an assessment of which elements need extraction and how they relate to each other. Step two involves general pre‐processing to prepare the PDF documents and is followed by an element classification step. Step four involves post‐processing and the final step is a validation of the extracted information. With our supervised approach, we are able to process over 200,000 pages of Swiss parliamentary records (spanning the years 1891–1995), a feat that would exceed the budget of most projects using manual curation. We discuss validation of individual steps and offer guidance to researchers engaged in similar data processing efforts.\",\"PeriodicalId\":46785,\"journal\":{\"name\":\"Swiss Political Science Review\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2024-03-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Swiss Political Science Review\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.1111/spsr.12590\",\"RegionNum\":2,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"POLITICAL SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swiss Political Science Review","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1111/spsr.12590","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"POLITICAL SCIENCE","Score":null,"Total":0}
引用次数: 0
摘要
立法机构通常会保留其活动记录。虽然数字化浪潮推动了档案文件的可用性,但其处理仍是一项挑战。瑞士议会记录也不例外。在本文中,我们介绍了一个用于提取和构建档案记录内容的监督管道。我们的流程包括五个步骤,首先是评估哪些元素需要提取以及它们之间的关系。第二步是对 PDF 文档进行一般预处理,然后进行元素分类。第四步是后处理,最后一步是验证提取的信息。利用我们的监督方法,我们能够处理超过 20 万页的瑞士议会记录(时间跨度为 1891-1995 年),这一壮举超出了大多数使用人工整理的项目的预算。我们讨论了各个步骤的验证,并为从事类似数据处理工作的研究人员提供了指导。
Processing Large‐Scale Archival Records: The Case of the Swiss Parliamentary Records
Legislative bodies generally keep records of their activities. While the digitization wave spurred the availability of archival documents, their processing remains a challenge. The Swiss parliamentary records are no exception.In this paper we present a supervised pipeline for extracting and structuring of content of archival records. Our pipeline consists of five steps, starting with an assessment of which elements need extraction and how they relate to each other. Step two involves general pre‐processing to prepare the PDF documents and is followed by an element classification step. Step four involves post‐processing and the final step is a validation of the extracted information. With our supervised approach, we are able to process over 200,000 pages of Swiss parliamentary records (spanning the years 1891–1995), a feat that would exceed the budget of most projects using manual curation. We discuss validation of individual steps and offer guidance to researchers engaged in similar data processing efforts.