Technologies like Head Mounted Display (HMD)-based Virtual Reality (VR) and Augmented Reality (AR) have made HMD-based immersive museums possible. To investigate the user acceptance, medium and interaction experience for HMD-based immersive museums, an app entitled The Extended Journey has been designed, developed, and deployed on both VR headsets and AR headsets. Subsequently, a between-subjects design experiment with sixty-two participants was conducted to measure the user experience and learning outcome in HMD VR and HMD AR conditions. Quantitative results revealed that HMD VR museums had statistically significantly better immersion and empathy compared to HMD AR museums. Qualitative data indicated HMD-based immersive museums were embraced by most young participants while HMD VR had better user acceptance than HMD AR for immersive museums. The interview also demonstrated that the advantage of the HMD-based immersive museum over the traditional online museum is only the sensory immersion from the medium itself, but also the interactive narrative experience that the HMD medium facilitates, especially the natural interaction with the CG characters and the environment in the story.
{"title":"A Comparative Study of HMD-based Virtual and Augmented Realities for Immersive Museums: User Acceptance, Medium and Learning","authors":"Yunshui Jin, Minhua Ma, Liu Yun","doi":"10.1145/3627164","DOIUrl":"https://doi.org/10.1145/3627164","url":null,"abstract":"Technologies like Head Mounted Display (HMD)-based Virtual Reality (VR) and Augmented Reality (AR) have made HMD-based immersive museums possible. To investigate the user acceptance, medium and interaction experience for HMD-based immersive museums, an app entitled The Extended Journey has been designed, developed, and deployed on both VR headsets and AR headsets. Subsequently, a between-subjects design experiment with sixty-two participants was conducted to measure the user experience and learning outcome in HMD VR and HMD AR conditions. Quantitative results revealed that HMD VR museums had statistically significantly better immersion and empathy compared to HMD AR museums. Qualitative data indicated HMD-based immersive museums were embraced by most young participants while HMD VR had better user acceptance than HMD AR for immersive museums. The interview also demonstrated that the advantage of the HMD-based immersive museum over the traditional online museum is only the sensory immersion from the medium itself, but also the interactive narrative experience that the HMD medium facilitates, especially the natural interaction with the CG characters and the environment in the story.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"27 8","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nowadays, technology plays an important role in supporting museum visit and enhancing overall museum visit experiences. An increasing number of studies have evaluated the potential of digitally mediated cultural heritage experiences. However, there is still a lack of a deeper understanding of how mediation devices influence the museum visit experiences and visitors’ behaviours. The article focuses on the mediating role of digital screens in the museum space. This study examines visitors’ activity and experience through their encounters with touchscreens at the Frederic Chopin's Museum in Warsaw, Poland. This article presents and makes use of a recent approach in the philosophy of technology, initiated by the American philosopher Don Ihde, called postphenomenology as well as the theory of affordances. By conducting observations and interviews with museum visitors, the study shows that touchscreens, and digital technologies themselves, are not only functional but also shape the visitor's perception and expectations. This study shows that touchscreens are an embodiment technique and play a role of the touch-substitute for museum visitors.
{"title":"Technologically Mediated Experiences of Visitors to the Frederic Chopin Museum Postphenomenological Perspective on Touchscreens Affordances","authors":"Ewa Drygalska","doi":"10.1145/3631127","DOIUrl":"https://doi.org/10.1145/3631127","url":null,"abstract":"Nowadays, technology plays an important role in supporting museum visit and enhancing overall museum visit experiences. An increasing number of studies have evaluated the potential of digitally mediated cultural heritage experiences. However, there is still a lack of a deeper understanding of how mediation devices influence the museum visit experiences and visitors’ behaviours. The article focuses on the mediating role of digital screens in the museum space. This study examines visitors’ activity and experience through their encounters with touchscreens at the Frederic Chopin's Museum in Warsaw, Poland. This article presents and makes use of a recent approach in the philosophy of technology, initiated by the American philosopher Don Ihde, called postphenomenology as well as the theory of affordances. By conducting observations and interviews with museum visitors, the study shows that touchscreens, and digital technologies themselves, are not only functional but also shape the visitor's perception and expectations. This study shows that touchscreens are an embodiment technique and play a role of the touch-substitute for museum visitors.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"33 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The current research presents an approach to the improvement of the librarian infrastructure via the integration of advanced technology and solutions aiming at an immediate, smooth, and continuous adaptation of the libraries in line with 21 st -century needs. In particular, this paper discusses the design and development of an innovative library environment ensuring descriptive cataloging, subject indexing, intelligent data searching, curation, and collection development aiming to meet the functional needs related to the increasingly growing users’ expectations. The effectiveness of the approach has been validated in the Regional Library “Peyo Yavorov” – Burgas, Bulgaria, an associated content provider in the Bulgarian National Interdisciplinary Research E-Infrastructure for Bulgarian Language and Cultural Heritage Resources and Technologies (CLaDA-BG). Testing of the system was made in order to assure its stability and reliability.
{"title":"Full-fledged Access and Usability of Content in Digital Cultural Heritage Library: Approaches, Paradigms and Implementation","authors":"Desislava Paneva-Marinova, Maxim Goynov, Yanislav Zhelev, Mariya Monova-Zheleva, Emanuela Mitreva, Detelin Luchev, Radoslav Pavlov, Lilia Pavlova","doi":"10.1145/3631135","DOIUrl":"https://doi.org/10.1145/3631135","url":null,"abstract":"The current research presents an approach to the improvement of the librarian infrastructure via the integration of advanced technology and solutions aiming at an immediate, smooth, and continuous adaptation of the libraries in line with 21 st -century needs. In particular, this paper discusses the design and development of an innovative library environment ensuring descriptive cataloging, subject indexing, intelligent data searching, curation, and collection development aiming to meet the functional needs related to the increasingly growing users’ expectations. The effectiveness of the approach has been validated in the Regional Library “Peyo Yavorov” – Burgas, Bulgaria, an associated content provider in the Bulgarian National Interdisciplinary Research E-Infrastructure for Bulgarian Language and Cultural Heritage Resources and Technologies (CLaDA-BG). Testing of the system was made in order to assure its stability and reliability.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"31 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135634904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emotional Expression Recognition (EER) and Facial Expression Recognition (FER) are active research areas in the affective computing field, which involves studying human emotion, recognition, and sentiment analysis. The main objective of this research is to develop algorithms that can accurately interpret and estimate human emotions from portrait images. The emotions depicted in a portrait can reflect various factors such as psychological and physiological states, the artist’s emotional responses, social and environmental aspects, and the period in which the painting was created. This task is challenging because (i) the portraits are often depicted in an artistic or stylized manner rather than realistically or naturally, (ii) the texture and color features obtained from natural faces and paintings differ, affecting the success rate of emotion recognition algorithms, and (iii) it is a new research area, where practically we don’t have visual arts portrait facial emotion estimation models or datasets. To address these challenges, we need a new class of tools and a database specifically tailored to analyze portrait images. This study aims to develop art portrait emotion recognition methods and create a new digital portrait dataset containing 927 images. The proposed model is based on (i) a 3-dimensional estimation of emotions learned by a deep neural network and (ii) a novel deep learning module (3DEmo) that could be easily integrated into existing FER models. To evaluate the effectiveness of the developed models, we also tested their robustness on a facial emotion recognition dataset. The extensive simulation results show that the presented approach outperforms established methods. We expect that this dataset and the developed new tools will encourage further research in recognizing emotions in portrait paintings and predicting artists’ emotions in the painting period based on their artwork.
{"title":"3DEmo: for Portrait Emotion Recognition with New Dataset","authors":"Shao Liu, Sos S. Agaian","doi":"10.1145/3631133","DOIUrl":"https://doi.org/10.1145/3631133","url":null,"abstract":"Emotional Expression Recognition (EER) and Facial Expression Recognition (FER) are active research areas in the affective computing field, which involves studying human emotion, recognition, and sentiment analysis. The main objective of this research is to develop algorithms that can accurately interpret and estimate human emotions from portrait images. The emotions depicted in a portrait can reflect various factors such as psychological and physiological states, the artist’s emotional responses, social and environmental aspects, and the period in which the painting was created. This task is challenging because (i) the portraits are often depicted in an artistic or stylized manner rather than realistically or naturally, (ii) the texture and color features obtained from natural faces and paintings differ, affecting the success rate of emotion recognition algorithms, and (iii) it is a new research area, where practically we don’t have visual arts portrait facial emotion estimation models or datasets. To address these challenges, we need a new class of tools and a database specifically tailored to analyze portrait images. This study aims to develop art portrait emotion recognition methods and create a new digital portrait dataset containing 927 images. The proposed model is based on (i) a 3-dimensional estimation of emotions learned by a deep neural network and (ii) a novel deep learning module (3DEmo) that could be easily integrated into existing FER models. To evaluate the effectiveness of the developed models, we also tested their robustness on a facial emotion recognition dataset. The extensive simulation results show that the presented approach outperforms established methods. We expect that this dataset and the developed new tools will encourage further research in recognizing emotions in portrait paintings and predicting artists’ emotions in the painting period based on their artwork.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"10 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135875397","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
[Purpose/Significance] The annotation of natural language corpus not only facilitates researchers to extract knowledge from it, but also helps to achieve deeper mining of the corpus. But the annotated corpus in the humanities knowledge domain is less. And the semantic annotation of humanities texts is difficult, because it requires a high domain background for researchers, even requires the participation of domain experts. Based on this, this study proposes a method for detecting entities and relations in domain which is lack of annotated corpus, and provides a referenceable idea for constructing conceptual models based on textual instances. [Method/Process] Based on syntactic and semantic features, this study proposes SPO triple recognition rules from the perspective of giving priority to predicates and generalization rules from the perspective of triple's content and the meaning of its predicate. The recognition rules are used to extract text-descriptive SPO triples centered on predicates. After clustering and adjusting triples, use the generalization rules proposed in this study to obtain coarse-grained entities and relations, and then form a conceptual model. [Results/Conclusions] This study recognizes SPO triples with high precision and summarization from descriptive texts, generalizes them and then forms a domain conceptual model. The method proposed in this paper provides a research idea for entity-relation detection in a domain with missing annotated corpus, and the formed domain conceptual model provides a reference for building a domain Linked Data Graph. The feasibility of the method is verified through practice on texts related to the four traditional Chinese festivals.
{"title":"A Joint Entity-Relation Detection and Generalization Method Based on Syntax and semantic for Chinese Intangible Cultural Heritage Texts","authors":"Yuyao Tan, Hao Wang, Zibo Zhao, Tao Fan","doi":"10.1145/3631124","DOIUrl":"https://doi.org/10.1145/3631124","url":null,"abstract":"[Purpose/Significance] The annotation of natural language corpus not only facilitates researchers to extract knowledge from it, but also helps to achieve deeper mining of the corpus. But the annotated corpus in the humanities knowledge domain is less. And the semantic annotation of humanities texts is difficult, because it requires a high domain background for researchers, even requires the participation of domain experts. Based on this, this study proposes a method for detecting entities and relations in domain which is lack of annotated corpus, and provides a referenceable idea for constructing conceptual models based on textual instances. [Method/Process] Based on syntactic and semantic features, this study proposes SPO triple recognition rules from the perspective of giving priority to predicates and generalization rules from the perspective of triple's content and the meaning of its predicate. The recognition rules are used to extract text-descriptive SPO triples centered on predicates. After clustering and adjusting triples, use the generalization rules proposed in this study to obtain coarse-grained entities and relations, and then form a conceptual model. [Results/Conclusions] This study recognizes SPO triples with high precision and summarization from descriptive texts, generalizes them and then forms a domain conceptual model. The method proposed in this paper provides a research idea for entity-relation detection in a domain with missing annotated corpus, and the formed domain conceptual model provides a reference for building a domain Linked Data Graph. The feasibility of the method is verified through practice on texts related to the four traditional Chinese festivals.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"15 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135875756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Several countries have traditional textiles as a piece of their cultural heritage. Indonesia has a traditional textile called batik. Central Java is one of the regions producing batik known for its variety of distinctive themes. It has unique designs and several motifs that emphasize the beauty of historic sites. Since the diversity of central java batik motifs and the lack of knowledge from the surrounding community, only a select group of people, especially the batik craftsmen themselves, can recognize these motifs. Consequently, the method to identify the batik according to the primary ornament pattern is required. Therefore, this study proposes a computer vision-based method for classifying batik patterns. The proposed method required discriminating appropriate features to produce optimal results. The discriminating features were constructed based on color, shape, and texture. Those features were derived using the method of Color Moments, Area Based Invariant Moments, Gray Level Co-occurrence Matrix (GLCM), and Local Binary Pattern (LBP). This study’s proposed hybrid features were formed based on the most discriminating and appropriate features. These were yielded by the Correlation-based feature selection (CFS) method. The hybrid features were then fed into several classifiers to determine the batik pattern. The pattern consists of ten classes: Asem Arang, Asem Sinom, Asem Warak, Blekok, Blekok Warak, Gambang Semarangan, Kembang Sepatu, Semarangan, Tugu Muda, and Warak Beras Utah. Based on the experimental results, the most optimal predicted class of the batik pattern was generated using the Artificial Neural Network (ANN) classifier. It was indicated by achieving an accuracy value of 99.76% based on the 3000 images (each class consists of 300 images) with cross-validation using a k-fold value of 10. This study has proved that the hybrid features incorporated with ANN can be selected as a suitable model to classify the batik patterns.
{"title":"The Hybrid Features and Supervised Learning for Batik Pattern Classification","authors":"Edy Winarno, Anindita Septiarini, Wiwien Hadikurniawati, Hamdani Hamdani","doi":"10.1145/3631131","DOIUrl":"https://doi.org/10.1145/3631131","url":null,"abstract":"Several countries have traditional textiles as a piece of their cultural heritage. Indonesia has a traditional textile called batik. Central Java is one of the regions producing batik known for its variety of distinctive themes. It has unique designs and several motifs that emphasize the beauty of historic sites. Since the diversity of central java batik motifs and the lack of knowledge from the surrounding community, only a select group of people, especially the batik craftsmen themselves, can recognize these motifs. Consequently, the method to identify the batik according to the primary ornament pattern is required. Therefore, this study proposes a computer vision-based method for classifying batik patterns. The proposed method required discriminating appropriate features to produce optimal results. The discriminating features were constructed based on color, shape, and texture. Those features were derived using the method of Color Moments, Area Based Invariant Moments, Gray Level Co-occurrence Matrix (GLCM), and Local Binary Pattern (LBP). This study’s proposed hybrid features were formed based on the most discriminating and appropriate features. These were yielded by the Correlation-based feature selection (CFS) method. The hybrid features were then fed into several classifiers to determine the batik pattern. The pattern consists of ten classes: Asem Arang, Asem Sinom, Asem Warak, Blekok, Blekok Warak, Gambang Semarangan, Kembang Sepatu, Semarangan, Tugu Muda, and Warak Beras Utah. Based on the experimental results, the most optimal predicted class of the batik pattern was generated using the Artificial Neural Network (ANN) classifier. It was indicated by achieving an accuracy value of 99.76% based on the 3000 images (each class consists of 300 images) with cross-validation using a k-fold value of 10. This study has proved that the hybrid features incorporated with ANN can be selected as a suitable model to classify the batik patterns.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135875409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A new method using optics in non-contact photogrammetry to find the dimensions of target objects by digital archive and/or open source digital images has been presented in this paper. In the proposed method a reference object of known dimension must be present in the field of view of pair of images collected at any two unknown arbitrary positions along the axis of camera (z-axis) and 2D size measurement (x-y) of other target objects is done successfully with the help of the proposed algorithm. The presented method is applicable to the number of images(>=2) containing the target objects and reference object which are not in the same plane and which may be shot from any camera not known to user and hence the internal and external specifications of the camera are completely unknown to the user. The method has been verified successfully to show its applicability in low-cost surveys by determining the dimensions of Washington-Monument, Christ the Redeemer (Rio De Janerio) and Eiffel Tower (Paris) from open source images. Further an example case of Notre-Dame Cathedral is demonstrated to find the size of the destroyed Spire from the undestroyed reference structure. The results are being compared with known standard values of structures and the relative error percentage for all the cases using the proposed algorithm are found to be less than 1%. The method may find applications in survey or analysis by old digital video footages or images from archive/libraries where the camera specifications are not known to the user.
{"title":"A Low-Cost Method and Surveying of the Historical Structures from Digital Resources","authors":"Sandeep Kumar Roy, Mriganka Roy Basunia","doi":"10.1145/3631126","DOIUrl":"https://doi.org/10.1145/3631126","url":null,"abstract":"A new method using optics in non-contact photogrammetry to find the dimensions of target objects by digital archive and/or open source digital images has been presented in this paper. In the proposed method a reference object of known dimension must be present in the field of view of pair of images collected at any two unknown arbitrary positions along the axis of camera (z-axis) and 2D size measurement (x-y) of other target objects is done successfully with the help of the proposed algorithm. The presented method is applicable to the number of images(>=2) containing the target objects and reference object which are not in the same plane and which may be shot from any camera not known to user and hence the internal and external specifications of the camera are completely unknown to the user. The method has been verified successfully to show its applicability in low-cost surveys by determining the dimensions of Washington-Monument, Christ the Redeemer (Rio De Janerio) and Eiffel Tower (Paris) from open source images. Further an example case of Notre-Dame Cathedral is demonstrated to find the size of the destroyed Spire from the undestroyed reference structure. The results are being compared with known standard values of structures and the relative error percentage for all the cases using the proposed algorithm are found to be less than 1%. The method may find applications in survey or analysis by old digital video footages or images from archive/libraries where the camera specifications are not known to the user.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"1 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135876456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tangible and Embodied interactions are areas of research within HCI and Interaction design. They refer to a way in which interacting with computer systems is closer to the way we interact with the real world. Instead of using devices such as a computer or a phone, we interact using seemingly non-technological objects, by moving our bodies or by using gestures. Since the early 2000s, tangible and embodied interactions have been applied and researched also in Cultural Heritage and museums, in an attempt to overcome issues induced by screen-based devices that may disengage visitors from the objects, their materiality and the physicality of the visit. This article surveys tangible and embodied interactions in museums, over a period of two decades since 2000. Over 120 projects have been researched and analysed thematically to provide a categorization based on cultural communication, interaction features and museological aspects. This categorization offers a conceptualization of tangible and embodied interactions in museums and Cultural Heritage; it suggests a terminology to describe the design characteristics of tangible and embodied interaction interventions, therefore facilitating the orientation of future research efforts in the field.
{"title":"Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage Sites","authors":"Daniele Duranti, Davide Spallazzo, Daniela Petrelli","doi":"10.1145/3631132","DOIUrl":"https://doi.org/10.1145/3631132","url":null,"abstract":"Tangible and Embodied interactions are areas of research within HCI and Interaction design. They refer to a way in which interacting with computer systems is closer to the way we interact with the real world. Instead of using devices such as a computer or a phone, we interact using seemingly non-technological objects, by moving our bodies or by using gestures. Since the early 2000s, tangible and embodied interactions have been applied and researched also in Cultural Heritage and museums, in an attempt to overcome issues induced by screen-based devices that may disengage visitors from the objects, their materiality and the physicality of the visit. This article surveys tangible and embodied interactions in museums, over a period of two decades since 2000. Over 120 projects have been researched and analysed thematically to provide a categorization based on cultural communication, interaction features and museological aspects. This categorization offers a conceptualization of tangible and embodied interactions in museums and Cultural Heritage; it suggests a terminology to describe the design characteristics of tangible and embodied interaction interventions, therefore facilitating the orientation of future research efforts in the field.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"8 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135875407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Amanda Henley, Lorin Bruckner, Hannah Jacobs, Matthew Jansen, Brianna Nunez, Rolando Rodriguez, Morgan Wilson
On the Books: Jim Crow and Algorithms of Resistance is a collections as data and machine learning project from the University Libraries at the University of North Carolina at Chapel Hill. This project has created a plain text corpus of North Carolina legal volumes (1866-1967) and used machine learning to identify likely Jim Crow laws. The project has been well received and is now being expanded to two additional states, while assessing the use of On the Books products in research and instruction. State partners at the University of South Carolina and the University of Virginia are adapting the On the Books methodology to create corpora for their own states. Three teaching fellows created learning modules that use products from On the Books and taught the modules to college-level courses. Research fellows are making use of the products on research projects of their own design. This paper will provide background for the On the Books project and will assess its use for multiple purposes: as a workflow to be reproduced by others, as content for use in teaching and learning, and as a resource for researchers. To demonstrate the utility of On the Books as a research tool, the article is co-authored by one of the research fellows. The project, “Mental Health, Disability, and Jim Crow Laws in North Carolina, 1866-1967,” makes use of the legal corpus as a primary source for researching the intersections of information, mental health, nutrition, and shifts from agricultural to industrial economics in the history of North Carolina. By assessing the experiences of those making use of On the Books products, this paper contributes to the understanding of best practices for those interested in creating and supporting collections as data so they may be used successfully for reproducibility, research, and teaching.
在书中:吉姆·克劳和抵抗算法是来自北卡罗来纳大学教堂山分校大学图书馆的数据和机器学习项目的集合。该项目创建了北卡罗来纳州法律卷(1866-1967)的纯文本语料库,并使用机器学习来识别可能的吉姆·克劳法律。该项目受到了好评,现在正在扩展到另外两个州,同时评估On The Books产品在研究和教学中的使用情况。南卡罗来纳大学(University of South Carolina)和弗吉尼亚大学(University of Virginia)的州政府合作伙伴正在采用On the Books的方法,为自己的州创建语料库。三位助教创建了使用On the Books产品的学习模块,并将这些模块教授给大学水平的课程。研究人员正在自己设计的研究项目中使用这些产品。本文将提供On the Books项目的背景,并将评估其在多种用途上的使用:作为他人复制的工作流程,作为教学和学习使用的内容,以及作为研究人员的资源。为了展示On the Books作为一种研究工具的实用性,本文由一位研究人员共同撰写。该项目名为“北卡罗莱纳州的精神健康、残疾和吉姆·克劳法,1866-1967”,利用法律语料库作为研究北卡罗莱纳州历史上信息、精神健康、营养和从农业到工业经济转变的交叉点的主要来源。通过评估那些使用On the Books产品的人的经验,本文有助于理解那些对创建和支持集合作为数据感兴趣的人的最佳实践,以便他们可以成功地用于再现、研究和教学。
{"title":"On the Books: Jim Crow and Algorithms of Resistance, a Collections as Data Case Study","authors":"Amanda Henley, Lorin Bruckner, Hannah Jacobs, Matthew Jansen, Brianna Nunez, Rolando Rodriguez, Morgan Wilson","doi":"10.1145/3631128","DOIUrl":"https://doi.org/10.1145/3631128","url":null,"abstract":"On the Books: Jim Crow and Algorithms of Resistance is a collections as data and machine learning project from the University Libraries at the University of North Carolina at Chapel Hill. This project has created a plain text corpus of North Carolina legal volumes (1866-1967) and used machine learning to identify likely Jim Crow laws. The project has been well received and is now being expanded to two additional states, while assessing the use of On the Books products in research and instruction. State partners at the University of South Carolina and the University of Virginia are adapting the On the Books methodology to create corpora for their own states. Three teaching fellows created learning modules that use products from On the Books and taught the modules to college-level courses. Research fellows are making use of the products on research projects of their own design. This paper will provide background for the On the Books project and will assess its use for multiple purposes: as a workflow to be reproduced by others, as content for use in teaching and learning, and as a resource for researchers. To demonstrate the utility of On the Books as a research tool, the article is co-authored by one of the research fellows. The project, “Mental Health, Disability, and Jim Crow Laws in North Carolina, 1866-1967,” makes use of the legal corpus as a primary source for researching the intersections of information, mental health, nutrition, and shifts from agricultural to industrial economics in the history of North Carolina. By assessing the experiences of those making use of On the Books products, this paper contributes to the understanding of best practices for those interested in creating and supporting collections as data so they may be used successfully for reproducibility, research, and teaching.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"138 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135372242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hayun Kim, Maryam Shakeri, Jae-eun Shin, Woontack Woo
Virtual Reality (VR) provides curators with the tools to design immersive 3D exhibition spaces. However, manually positioning artworks in VR is labor-intensive, and most existing automated methods are limited in considering both artwork content and spatial characteristics, as well as accommodating curators’ design preferences. To address these challenges, we present a virtual exhibition authoring system that automatically generates optimized artwork placements for thematic space layouts, where exhibits are grouped by conceptual themes and arranged as clusters. Our approach clusters artworks based on five content similarity factors—color, material, description, artist, and production date—and allows curators to adjust the importance of each factor and set limits on cluster sizes according to their design goals. A genetic optimization algorithm is employed to determine the placement of artworks, using four cost functions—intra-cluster distance, inter-cluster distance, intra-cluster intervisibility, and occupancy—to evaluate the arrangement with respect to spatial characteristics. The effectiveness of our approach is demonstrated through a series of practical scenarios and an expert evaluation with curators.
{"title":"Space-Adaptive Artwork Placement Based on Content Similarities for Curating Thematic Spaces in a Virtual Museum","authors":"Hayun Kim, Maryam Shakeri, Jae-eun Shin, Woontack Woo","doi":"10.1145/3631134","DOIUrl":"https://doi.org/10.1145/3631134","url":null,"abstract":"Virtual Reality (VR) provides curators with the tools to design immersive 3D exhibition spaces. However, manually positioning artworks in VR is labor-intensive, and most existing automated methods are limited in considering both artwork content and spatial characteristics, as well as accommodating curators’ design preferences. To address these challenges, we present a virtual exhibition authoring system that automatically generates optimized artwork placements for thematic space layouts, where exhibits are grouped by conceptual themes and arranged as clusters. Our approach clusters artworks based on five content similarity factors—color, material, description, artist, and production date—and allows curators to adjust the importance of each factor and set limits on cluster sizes according to their design goals. A genetic optimization algorithm is employed to determine the placement of artworks, using four cost functions—intra-cluster distance, inter-cluster distance, intra-cluster intervisibility, and occupancy—to evaluate the arrangement with respect to spatial characteristics. The effectiveness of our approach is demonstrated through a series of practical scenarios and an expert evaluation with curators.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"32 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136104146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}