Pub Date : 2023-12-04DOI: 10.1007/s42803-023-00078-7
Thorsten Ries, Karina van Dalen-Oskam, Fabian Offert
{"title":"Reproducibility and explainability in digital humanities","authors":"Thorsten Ries, Karina van Dalen-Oskam, Fabian Offert","doi":"10.1007/s42803-023-00078-7","DOIUrl":"https://doi.org/10.1007/s42803-023-00078-7","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"18 24","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138601980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1007/s42803-023-00074-x
Nabeel Siddiqui
{"title":"Minimal research compendiums: an approach to advance statistical validity and reproducibility in digital humanities research","authors":"Nabeel Siddiqui","doi":"10.1007/s42803-023-00074-x","DOIUrl":"https://doi.org/10.1007/s42803-023-00074-x","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1007/s42803-023-00072-z
Sarah Middle
Abstract Documentation, including information, instructions, and use cases, is key to reproducibility in Digital Humanities research and usability of resulting tools and resources. However, despite multiple studies that support this assertion, clear and comprehensive documentation is often lacking due to fundamental incompatibilities with existing funding models and the resulting prioritisation of project tasks. Through a user study of researchers involved in using and producing Linked Ancient World Data, supplemented by existing literature, I identified components for inclusion in documentation to facilitate use of these tools and resources, as well as the reproducibility of methods used in their production. At the same time, it became clear that producers would benefit from a solution to simplify the process of documentation creation. As a result, I assembled a documentation checklist whose scope for application reaches beyond Linked Ancient World Data to other Humanities disciplines and digital methods. This paper starts by discussing previous work, before providing an overview of my survey and interview methods. I then present my findings and discuss their implications for future research and development, including an introduction to the checklist and its implementation. To conclude, I draw together threads from the preceding sections and suggest wider structural changes to further facilitate and promote transparency and reproducibility in Digital Humanities.
{"title":"A documentation checklist for (Linked) humanities data","authors":"Sarah Middle","doi":"10.1007/s42803-023-00072-z","DOIUrl":"https://doi.org/10.1007/s42803-023-00072-z","url":null,"abstract":"Abstract Documentation, including information, instructions, and use cases, is key to reproducibility in Digital Humanities research and usability of resulting tools and resources. However, despite multiple studies that support this assertion, clear and comprehensive documentation is often lacking due to fundamental incompatibilities with existing funding models and the resulting prioritisation of project tasks. Through a user study of researchers involved in using and producing Linked Ancient World Data, supplemented by existing literature, I identified components for inclusion in documentation to facilitate use of these tools and resources, as well as the reproducibility of methods used in their production. At the same time, it became clear that producers would benefit from a solution to simplify the process of documentation creation. As a result, I assembled a documentation checklist whose scope for application reaches beyond Linked Ancient World Data to other Humanities disciplines and digital methods. This paper starts by discussing previous work, before providing an overview of my survey and interview methods. I then present my findings and discuss their implications for future research and development, including an introduction to the checklist and its implementation. To conclude, I draw together threads from the preceding sections and suggest wider structural changes to further facilitate and promote transparency and reproducibility in Digital Humanities.","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-06DOI: 10.1007/s42803-023-00073-y
Christof Schöch
Abstract This article is motivated by the ‘reproducibility crisis’ that is being discussed intensely in fields such as Psychology or Biology but is also becoming increasingly relevant to Artificial Intelligence, Natural Language Processing and Digital Humanities, not least in the context of Open Science. Using the phrase ‘repetitive research’ as an umbrella term for a range of practices from replication to follow-up research, and with the objective to provide clarity and help establish best practices in this area, this article focuses on two issues: First, the conceptual space of repetitive research is described across five key dimensions, namely those of the research question or hypothesis, the dataset, the method of analysis, the team, and the results or conclusions. Second, building on this new description of the conceptual space and on earlier terminological work, a specific set of terms for recurring scenarios of repetitive research is proposed. For each scenario, its position in the conceptual space is defined, its typical purpose and added value in the research process are discussed, the requirements for enabling it are described, and illustrative examples from the domain of Computational Literary Studies are provided. The key contribution of this article, therefore, is a proposal for a transparent terminology underpinned by a systematic model of the conceptual space of repetitive research.
{"title":"Repetitive research: a conceptual space and terminology of replication, reproduction, revision, reanalysis, reinvestigation and reuse in digital humanities","authors":"Christof Schöch","doi":"10.1007/s42803-023-00073-y","DOIUrl":"https://doi.org/10.1007/s42803-023-00073-y","url":null,"abstract":"Abstract This article is motivated by the ‘reproducibility crisis’ that is being discussed intensely in fields such as Psychology or Biology but is also becoming increasingly relevant to Artificial Intelligence, Natural Language Processing and Digital Humanities, not least in the context of Open Science. Using the phrase ‘repetitive research’ as an umbrella term for a range of practices from replication to follow-up research, and with the objective to provide clarity and help establish best practices in this area, this article focuses on two issues: First, the conceptual space of repetitive research is described across five key dimensions, namely those of the research question or hypothesis, the dataset, the method of analysis, the team, and the results or conclusions. Second, building on this new description of the conceptual space and on earlier terminological work, a specific set of terms for recurring scenarios of repetitive research is proposed. For each scenario, its position in the conceptual space is defined, its typical purpose and added value in the research process are discussed, the requirements for enabling it are described, and illustrative examples from the domain of Computational Literary Studies are provided. The key contribution of this article, therefore, is a proposal for a transparent terminology underpinned by a systematic model of the conceptual space of repetitive research.","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-01DOI: 10.1007/s42803-023-00075-w
James E. Dobson
{"title":"On reading and interpreting black box deep neural networks","authors":"James E. Dobson","doi":"10.1007/s42803-023-00075-w","DOIUrl":"https://doi.org/10.1007/s42803-023-00075-w","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"6 1","pages":"431-449"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139299977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-11DOI: 10.1007/s42803-023-00069-8
Jon Chun, Katherine Elkins
{"title":"eXplainable AI with GPT4 for story analysis and generation: A novel framework for diachronic sentiment analysis","authors":"Jon Chun, Katherine Elkins","doi":"10.1007/s42803-023-00069-8","DOIUrl":"https://doi.org/10.1007/s42803-023-00069-8","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"155 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136210364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-05DOI: 10.1007/s42803-023-00071-0
Jyothi Justin, Nirmala Menon
{"title":"Reproducibility of Indian DH Projects: A case study","authors":"Jyothi Justin, Nirmala Menon","doi":"10.1007/s42803-023-00071-0","DOIUrl":"https://doi.org/10.1007/s42803-023-00071-0","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134975541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-02DOI: 10.1007/s42803-023-00070-1
Hassan El-Hajj, Oliver Eberle, Anika Merklein, Anna Siebold, Noga Shlomi, Jochen Büttner, Julius Martinetz, Klaus-Robert Müller, Grégoire Montavon, Matteo Valleriani
Abstract The recent advancements in the field of Artificial Intelligence (AI) translated to an increased adoption of AI technology in the humanities, which is often challenged by the limited amount of annotated data, as well as its heterogeneity. Despite the scarcity of data it has become common practice to design increasingly complex AI models, usually at the expense of human readability, explainability, and trust. This in turn has led to an increased need for tools to help humanities scholars better explain and validate their models as well as their hypotheses. In this paper, we discuss the importance of employing Explainable AI (XAI) methods within the humanities to gain insights into historical processes as well as ensure model reproducibility and a trustworthy scientific result. To drive our point, we present several representative case studies from the Sphaera project where we analyze a large, well-curated corpus of early modern textbooks using an AI model, and rely on the XAI explanatory outputs to generate historical insights concerning their visual content. More specifically, we show that XAI can be used as a partner when investigating debated subjects in the history of science, such as what strategies were used in the early modern period to showcase mathematical instruments and machines.
{"title":"Explainability and transparency in the realm of digital humanities: toward a historian XAI","authors":"Hassan El-Hajj, Oliver Eberle, Anika Merklein, Anna Siebold, Noga Shlomi, Jochen Büttner, Julius Martinetz, Klaus-Robert Müller, Grégoire Montavon, Matteo Valleriani","doi":"10.1007/s42803-023-00070-1","DOIUrl":"https://doi.org/10.1007/s42803-023-00070-1","url":null,"abstract":"Abstract The recent advancements in the field of Artificial Intelligence (AI) translated to an increased adoption of AI technology in the humanities, which is often challenged by the limited amount of annotated data, as well as its heterogeneity. Despite the scarcity of data it has become common practice to design increasingly complex AI models, usually at the expense of human readability, explainability, and trust. This in turn has led to an increased need for tools to help humanities scholars better explain and validate their models as well as their hypotheses. In this paper, we discuss the importance of employing Explainable AI (XAI) methods within the humanities to gain insights into historical processes as well as ensure model reproducibility and a trustworthy scientific result. To drive our point, we present several representative case studies from the Sphaera project where we analyze a large, well-curated corpus of early modern textbooks using an AI model, and rely on the XAI explanatory outputs to generate historical insights concerning their visual content. More specifically, we show that XAI can be used as a partner when investigating debated subjects in the history of science, such as what strategies were used in the early modern period to showcase mathematical instruments and machines.","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135895083","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-04DOI: 10.1007/s42803-023-00066-x
Adam Crymble, Charlotte M. H. Im
{"title":"Measuring digital humanities learning requirements in Spanish & English-speaking practitioner communities","authors":"Adam Crymble, Charlotte M. H. Im","doi":"10.1007/s42803-023-00066-x","DOIUrl":"https://doi.org/10.1007/s42803-023-00066-x","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"132 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80884904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-31DOI: 10.1007/s42803-023-00067-w
J. Rudman
{"title":"Reproducibility and non-traditional authorship attribution: Invitatio ad Arma","authors":"J. Rudman","doi":"10.1007/s42803-023-00067-w","DOIUrl":"https://doi.org/10.1007/s42803-023-00067-w","url":null,"abstract":"","PeriodicalId":91018,"journal":{"name":"International journal of digital humanities","volume":"24 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87185535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：