Identifying Relationships and Classifying Western-Style Paintings: Machine Learning Approaches for Artworks by Western Artists and Meiji-Era Japanese Artists
{"title":"Identifying Relationships and Classifying Western-Style Paintings: Machine Learning Approaches for Artworks by Western Artists and Meiji-Era Japanese Artists","authors":"Phongtharin Vinayavekhin, Banphatree Khomkham, Vorapong Suppakitpaisarn, Phillippe Codognet, Torahiko Terada, Atsushi Miura","doi":"10.1145/3631136","DOIUrl":null,"url":null,"abstract":"Many Western-style paintings by Japanese artists in the early 1900s, though maintaining a unique quality, were greatly inspired by the works of Western artists. In this paper, we employ machine learning to identify relationships and classify the works of Japanese and Western artists. The relationships are of significant interest to numerous art historians, as they can reveal how Western art was introduced to Japan. Historically, art historians have manually annotated these correspondences, which is a time-consuming and labor-intensive process. In this paper, we introduce a new method for finding correspondences between related artworks by comparing their overall outline information. This technique is based on Siamese neural networks (SNNs) and a self-supervised learning approach. Additionally, we have compiled a dataset of illustrations from Japanese artists such as Seiki Kuroda and Western artists such as Raphaël Collin, complete with correspondence annotations. On the other hand, to exhibit the unique quality of works by Japanese artists, we demonstrate that machine learning can classify between artworks created by Japanese artists and those created by Western artists.","PeriodicalId":54310,"journal":{"name":"ACM Journal on Computing and Cultural Heritage","volume":"59 1","pages":"0"},"PeriodicalIF":2.1000,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Journal on Computing and Cultural Heritage","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3631136","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Many Western-style paintings by Japanese artists in the early 1900s, though maintaining a unique quality, were greatly inspired by the works of Western artists. In this paper, we employ machine learning to identify relationships and classify the works of Japanese and Western artists. The relationships are of significant interest to numerous art historians, as they can reveal how Western art was introduced to Japan. Historically, art historians have manually annotated these correspondences, which is a time-consuming and labor-intensive process. In this paper, we introduce a new method for finding correspondences between related artworks by comparing their overall outline information. This technique is based on Siamese neural networks (SNNs) and a self-supervised learning approach. Additionally, we have compiled a dataset of illustrations from Japanese artists such as Seiki Kuroda and Western artists such as Raphaël Collin, complete with correspondence annotations. On the other hand, to exhibit the unique quality of works by Japanese artists, we demonstrate that machine learning can classify between artworks created by Japanese artists and those created by Western artists.
期刊介绍:
ACM Journal on Computing and Cultural Heritage (JOCCH) publishes papers of significant and lasting value in all areas relating to the use of information and communication technologies (ICT) in support of Cultural Heritage. The journal encourages the submission of manuscripts that demonstrate innovative use of technology for the discovery, analysis, interpretation and presentation of cultural material, as well as manuscripts that illustrate applications in the Cultural Heritage sector that challenge the computational technologies and suggest new research opportunities in computer science.