Benchmarking methods and data for the whole-outline geometric morphometric analysis of lithic tools

IF 4.6 2区 社会学 Q1 ANTHROPOLOGY Evolutionary Anthropology Pub Date : 2023-05-04 DOI:10.1002/evan.21981
Renata P. Araujo, Felix Riede, Mercedes Okumura, Astolfo G. M. Araujo, Alice Leplongeon, Colin Wren, José R. Rabuñal, Marcelo Cardillo, María B. Cruz, David N. Matzig
{"title":"Benchmarking methods and data for the whole-outline geometric morphometric analysis of lithic tools","authors":"Renata P. Araujo,&nbsp;Felix Riede,&nbsp;Mercedes Okumura,&nbsp;Astolfo G. M. Araujo,&nbsp;Alice Leplongeon,&nbsp;Colin Wren,&nbsp;José R. Rabuñal,&nbsp;Marcelo Cardillo,&nbsp;María B. Cruz,&nbsp;David N. Matzig","doi":"10.1002/evan.21981","DOIUrl":null,"url":null,"abstract":"<p>Originally developed for the quantitative analysis of organismal shapes, both two-dimensional (2D) and 3D geometric morphometric methods (GMMs) have recently gained some prominence in archaeology for the analysis of stone tools<span><sup>1-3</sup></span>—unquestionably the primary deep-time data source for the earliest periods of human cultural evolution.<span><sup>4</sup></span> The key strength of GMM rests in its ability to statistically quantify and hence qualify complex shapes, which in turn can be used to infer social interaction,<span><sup>5</sup></span> function,<span><sup>6, 7</sup></span> reduction,<span><sup>8</sup></span> as well as to assess classification systems and cultural relatedness.<span><sup>9-11</sup></span></p><p>The methodological diversification that has accompanied the rise in popularity of this particular suite of methods has, however, also resulted in an increasing lack of comparability and interoperability, which—ironically—works against the promise of GMM to provide a tool for comparing artifact shapes that is not sensitive to interanalyst variation. Standardized protocols, vetted datasets, as well as case-transferable and fully reproducible methods do not currently exist, hampering the full utility of geometric morphometrics as an approach to comparatively understand human behavior as reflected in these lithic proxies. Additionally, the emerging issue of methodological diversity in the geometric morphometric analysis of stone tools is further compounded by issues related to landmark selection. When applied to organisms, landmark selection is guided by <i>a priori</i> knowledge about ontogeny, homology, and function. For stone tools, however, only very few such evident landmarks suggest themselves.<span><sup>2</sup></span> Instead, many studies have used landmarks selected specifically to highlight particular design features of a given tool class (e.g., stemmed points or leaf points). These cannot, however, be easily compared across tool classes. Other studies have used sets of equidistant landmarks measured perpendicularly from a given tool's longest axis to its margins to describe overall shape.</p><p>In this context, whole-outline geometric morphometrics offers an alternative approach that circumvents landmark selection by describing the entire outline of the recorded artifact. It is computationally tractable, readily replicable, and well-suited for 2D object representations such as drawings and photographs, many of which exist in excavation reports, catalogs, finds registers and the published literature at large. Furthermore, emerging approaches in paleobiology now allow such continuous shape data to be used in phylogenetic applications, opening up the possibility of effectively combining stone tool geometric morphometrics with cultural phylogenetics in one workflow.</p><p>From 26 to 30 September 2022, the authors convened for a workshop with the title “Cultural evolutionary tools for stone tool shape analysis: Geometric morphometrics and Bayesian phylogenetics” at the Aarhus Institute for Advanced Studies, in Aarhus, Denmark. This workshop was held under auspices and with funding from Cultural Evolution Society (https://culturalevolutionsociety.org/) and in direct continuation of the Society's biannual conference. The aim was to stimulate and foster the use and application of whole-outline GMM to questions of cultural evolution, and to begin assembling a data set of stone tools—probable projectile points in the first instance, but other classes of artifacts as well—that may be used to explore these methods and benchmark interpretations.</p><p>The specific outline based GMM approach applied in this workshop follows the protocol recently published by Matzig<span><sup>13, 14</sup></span> who also led the workshop. This approach includes the semi-automated extraction of outlines from legacy data, such as drawings or photographs. Vitally, this protocol relies entirely on open-source software and is, beyond basic image preparation, fully replicable and reproducible. Before the start of the workshop, all participants had prepared their own individual sets of photographs or drawings related to their expertise alongside associated metadata such as geographical coordinates and dating.</p><p>During the workshop, focus rested initially on how to prepare the images for the extraction of artifact outlines using the open-source imaging software GIMP (http://www.gimp.org) and R. Thereafter, the outline datasets created in this way and ranging from Late Pleistocene Europe and Northern Africa to Holocene North and South America (Figure 2) were analyzed in a multivariate framework closely following the approach of Matzig et al.<span><sup>15</sup></span> The performance of this methodology has been directly compared to previous published analyses that use both traditional typo-technological attributes as well as those using landmark-based GMM and was shown to capture salient differences in artifact forms where they exist.</p><p>On the first day of workshop, each participant presented their data set and shared their assumptions regarding the cultural evolutionary processes they sought to test; these hypotheses related variously to chronological and spatial differentiation, or to cultural taxonomic assessments of the material at hand. Each participant's data set and research questions differed substantially in their geographical and chronological scope, and the number of artifacts in each data set also varied. Some datasets were best suited to analyses regarding their diachronic, intra-site patterns of cultural evolution, while for others, patterns on a continental, and temporally deep scale were most pertinent. After each participant's presentation of their datasets and objectives, they completed their metadata sheets with all relevant information.</p><p>The second day was dedicated to image preparation to a common standard so that these could be transferred into the automated outline extraction protocol. The third and fourth days then focused on the main analytical pipeline, the first steps of which consist of the quantification of the extracted outlines using elliptic Fourier analysis<span><sup>16</sup></span> and principal component analysis for initial visualization. Then, the resulting data are further interrogated using both hierarchical clustering and disparity analysis. The latter, implemented using the R package <i>dispaRity</i>,<span><sup>17</sup></span> represents a multivariate measure of variance within a morphometric data set that is comparable to the coefficient of variation (CV) for linear measurements. By quantifying variance, the CV is commonly used in cultural transmission research to infer the dominant modes of social learning related to ancient craft production, including stone tools.<span><sup>18, 19</sup></span> but see Premo.<span><sup>20</sup></span> The disparity measures, together with multivariate analyses that reveal internal structure within the stone tool shape data at hand, facilitate interpretations of social transmission and cultural evolution (Figure 3). On the fifth and last day, participants presented their results and discussed them in relation to their <i>a priori</i> expectations. Furthermore, all datasets were combined and analyzed together following the exact same analytical pipeline.</p><p>With its focus on both conceptual issues as well as data wrangling and analysis, this workshop was intense, productive, and collaborative. Participants walked away with a set of tools to reproducibly analyze 2D lithic outlines. By the same token, the heterogeneity of the data and research questions brought to the table by the participants afforded the occasion to review the analytical workflow's strengths and weaknesses. For most datasets, the hierarchical clustering proved to be a useful tool to visualize the relations between artifact shapes and compare the efficacy of existing classifications. As all analyses were performed in the flexible computing environment of R, mapping or others forms of downstream visualizations can be added in a straightforward manner, all the while retaining reproducibility.<span><sup>21</sup></span> The final day ended with a stimulating discussion concerning the suitability of the methods to capture tool shape heterogeneity, and raising vital issues such as the orientation criteria for asymmetrical tools, such as backed pieces. Issues of sampling bias and analytical scale were also raised, with the current workflow being best suited to macroarchaeological approaches.</p><p>Besides these important findings and the training of the participants, the data set collated as part of this workshop is now freely available (https://doi.org/10.5281/zenodo.7757171); relevant metadata are available as Supporting Information alongside this report. We hope that future studies will use, update, and add to these data. In time, such a public repository would be a first step towards the comparative study of cultural evolution at large geographic and chronological scales.</p><p>The workshop's final discussion revolved around the potential to couple whole-outline GMM with the analysis of specific technological traits, and how to integrate these into emerging phylogenetic applications. So far, phylogenetic analyses of stone projectile points have partitioned artifacts using different traits to capture their key characteristics as well as their shape. Only such trait- and landmark-based GMM have offered an integration with phylogenetic methods.<span><sup>22</sup></span> Yet, both BEAST<span><sup>23</sup></span> as well as RevBayes<span><sup>24</sup></span> in principle allow continuous characters to be used, not least within a Bayesian statistical framework. Thanks to such recent developments, a fuller integration between these powerful quantitative methods for stone tool analysis looms on the horizon. The potential thus emerges that both rich outline shape data can be combined with technological traits under one analytical protocol.</p>","PeriodicalId":47849,"journal":{"name":"Evolutionary Anthropology","volume":"32 3","pages":"124-127"},"PeriodicalIF":4.6000,"publicationDate":"2023-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/evan.21981","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evolutionary Anthropology","FirstCategoryId":"90","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/evan.21981","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ANTHROPOLOGY","Score":null,"Total":0}
引用次数: 1

Abstract

Originally developed for the quantitative analysis of organismal shapes, both two-dimensional (2D) and 3D geometric morphometric methods (GMMs) have recently gained some prominence in archaeology for the analysis of stone tools1-3—unquestionably the primary deep-time data source for the earliest periods of human cultural evolution.4 The key strength of GMM rests in its ability to statistically quantify and hence qualify complex shapes, which in turn can be used to infer social interaction,5 function,6, 7 reduction,8 as well as to assess classification systems and cultural relatedness.9-11

The methodological diversification that has accompanied the rise in popularity of this particular suite of methods has, however, also resulted in an increasing lack of comparability and interoperability, which—ironically—works against the promise of GMM to provide a tool for comparing artifact shapes that is not sensitive to interanalyst variation. Standardized protocols, vetted datasets, as well as case-transferable and fully reproducible methods do not currently exist, hampering the full utility of geometric morphometrics as an approach to comparatively understand human behavior as reflected in these lithic proxies. Additionally, the emerging issue of methodological diversity in the geometric morphometric analysis of stone tools is further compounded by issues related to landmark selection. When applied to organisms, landmark selection is guided by a priori knowledge about ontogeny, homology, and function. For stone tools, however, only very few such evident landmarks suggest themselves.2 Instead, many studies have used landmarks selected specifically to highlight particular design features of a given tool class (e.g., stemmed points or leaf points). These cannot, however, be easily compared across tool classes. Other studies have used sets of equidistant landmarks measured perpendicularly from a given tool's longest axis to its margins to describe overall shape.

In this context, whole-outline geometric morphometrics offers an alternative approach that circumvents landmark selection by describing the entire outline of the recorded artifact. It is computationally tractable, readily replicable, and well-suited for 2D object representations such as drawings and photographs, many of which exist in excavation reports, catalogs, finds registers and the published literature at large. Furthermore, emerging approaches in paleobiology now allow such continuous shape data to be used in phylogenetic applications, opening up the possibility of effectively combining stone tool geometric morphometrics with cultural phylogenetics in one workflow.

From 26 to 30 September 2022, the authors convened for a workshop with the title “Cultural evolutionary tools for stone tool shape analysis: Geometric morphometrics and Bayesian phylogenetics” at the Aarhus Institute for Advanced Studies, in Aarhus, Denmark. This workshop was held under auspices and with funding from Cultural Evolution Society (https://culturalevolutionsociety.org/) and in direct continuation of the Society's biannual conference. The aim was to stimulate and foster the use and application of whole-outline GMM to questions of cultural evolution, and to begin assembling a data set of stone tools—probable projectile points in the first instance, but other classes of artifacts as well—that may be used to explore these methods and benchmark interpretations.

The specific outline based GMM approach applied in this workshop follows the protocol recently published by Matzig13, 14 who also led the workshop. This approach includes the semi-automated extraction of outlines from legacy data, such as drawings or photographs. Vitally, this protocol relies entirely on open-source software and is, beyond basic image preparation, fully replicable and reproducible. Before the start of the workshop, all participants had prepared their own individual sets of photographs or drawings related to their expertise alongside associated metadata such as geographical coordinates and dating.

During the workshop, focus rested initially on how to prepare the images for the extraction of artifact outlines using the open-source imaging software GIMP (http://www.gimp.org) and R. Thereafter, the outline datasets created in this way and ranging from Late Pleistocene Europe and Northern Africa to Holocene North and South America (Figure 2) were analyzed in a multivariate framework closely following the approach of Matzig et al.15 The performance of this methodology has been directly compared to previous published analyses that use both traditional typo-technological attributes as well as those using landmark-based GMM and was shown to capture salient differences in artifact forms where they exist.

On the first day of workshop, each participant presented their data set and shared their assumptions regarding the cultural evolutionary processes they sought to test; these hypotheses related variously to chronological and spatial differentiation, or to cultural taxonomic assessments of the material at hand. Each participant's data set and research questions differed substantially in their geographical and chronological scope, and the number of artifacts in each data set also varied. Some datasets were best suited to analyses regarding their diachronic, intra-site patterns of cultural evolution, while for others, patterns on a continental, and temporally deep scale were most pertinent. After each participant's presentation of their datasets and objectives, they completed their metadata sheets with all relevant information.

The second day was dedicated to image preparation to a common standard so that these could be transferred into the automated outline extraction protocol. The third and fourth days then focused on the main analytical pipeline, the first steps of which consist of the quantification of the extracted outlines using elliptic Fourier analysis16 and principal component analysis for initial visualization. Then, the resulting data are further interrogated using both hierarchical clustering and disparity analysis. The latter, implemented using the R package dispaRity,17 represents a multivariate measure of variance within a morphometric data set that is comparable to the coefficient of variation (CV) for linear measurements. By quantifying variance, the CV is commonly used in cultural transmission research to infer the dominant modes of social learning related to ancient craft production, including stone tools.18, 19 but see Premo.20 The disparity measures, together with multivariate analyses that reveal internal structure within the stone tool shape data at hand, facilitate interpretations of social transmission and cultural evolution (Figure 3). On the fifth and last day, participants presented their results and discussed them in relation to their a priori expectations. Furthermore, all datasets were combined and analyzed together following the exact same analytical pipeline.

With its focus on both conceptual issues as well as data wrangling and analysis, this workshop was intense, productive, and collaborative. Participants walked away with a set of tools to reproducibly analyze 2D lithic outlines. By the same token, the heterogeneity of the data and research questions brought to the table by the participants afforded the occasion to review the analytical workflow's strengths and weaknesses. For most datasets, the hierarchical clustering proved to be a useful tool to visualize the relations between artifact shapes and compare the efficacy of existing classifications. As all analyses were performed in the flexible computing environment of R, mapping or others forms of downstream visualizations can be added in a straightforward manner, all the while retaining reproducibility.21 The final day ended with a stimulating discussion concerning the suitability of the methods to capture tool shape heterogeneity, and raising vital issues such as the orientation criteria for asymmetrical tools, such as backed pieces. Issues of sampling bias and analytical scale were also raised, with the current workflow being best suited to macroarchaeological approaches.

Besides these important findings and the training of the participants, the data set collated as part of this workshop is now freely available (https://doi.org/10.5281/zenodo.7757171); relevant metadata are available as Supporting Information alongside this report. We hope that future studies will use, update, and add to these data. In time, such a public repository would be a first step towards the comparative study of cultural evolution at large geographic and chronological scales.

The workshop's final discussion revolved around the potential to couple whole-outline GMM with the analysis of specific technological traits, and how to integrate these into emerging phylogenetic applications. So far, phylogenetic analyses of stone projectile points have partitioned artifacts using different traits to capture their key characteristics as well as their shape. Only such trait- and landmark-based GMM have offered an integration with phylogenetic methods.22 Yet, both BEAST23 as well as RevBayes24 in principle allow continuous characters to be used, not least within a Bayesian statistical framework. Thanks to such recent developments, a fuller integration between these powerful quantitative methods for stone tool analysis looms on the horizon. The potential thus emerges that both rich outline shape data can be combined with technological traits under one analytical protocol.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
石制工具整体轮廓几何形态分析的基准方法和数据
几何形态计量学(GMMs)最初是为生物形状的定量分析而发展起来的,但近年来,二维(2D)和三维(3D)几何形态计量学方法(GMMs)在石器分析方面取得了一些突出成就GMM的关键优势在于其统计量化的能力,从而限定复杂的形状,这反过来又可以用来推断社会互动,5功能,6,7减少,8以及评估分类系统和文化相关性。9-11方法的多样化伴随着这一套特殊方法的流行,然而,也导致了可比性和互操作性的日益缺乏,具有讽刺意味的是,这违背了GMM的承诺,即提供一种工具来比较对分析人员之间的变化不敏感的工件形状。目前还不存在标准化的协议、经过审查的数据集,以及病例可转移和完全可重复的方法,这阻碍了几何形态计量学作为一种相对理解这些石器代用物所反映的人类行为的方法的充分利用。此外,石制工具几何形态计量学分析方法多样性的新问题因与地标选择有关的问题而进一步复杂化。当应用于生物体时,里程碑选择是由关于个体发生、同源性和功能的先验知识指导的。然而,对于石器来说,只有很少的明显的标志表明了自己相反,许多研究使用专门选择的地标来突出给定工具类的特定设计特征(例如,茎点或叶点)。然而,这些不能很容易地跨工具类进行比较。其他研究使用从给定工具的最长轴到其边缘垂直测量的等距地标集来描述整体形状。在这种情况下,整体轮廓几何形态计量学提供了一种替代方法,通过描述记录的人工制品的整个轮廓来避免地标选择。它在计算上易于处理,易于复制,并且非常适合2D对象表示,例如图纸和照片,其中许多存在于挖掘报告,目录,发现登记册和大量已发表的文献中。此外,古生物学中的新兴方法现在允许将这种连续的形状数据用于系统发育应用,从而在一个工作流程中有效地将石器几何形态测量学与文化系统发育学结合起来。2022年9月26日至30日,作者在丹麦奥胡斯高级研究所召开了题为“石器形状分析的文化进化工具:几何形态计量学和贝叶斯系统发育学”的研讨会。这个讲习班是由文化进化学会(https://culturalevolutionsociety.org/)主持和资助的,是该学会两年一次会议的直接延续。其目的是刺激和促进对文化进化问题的整体轮廓GMM的使用和应用,并开始收集石器工具的数据集——第一次可能是抛射点,但也有其他类别的人工制品——可以用来探索这些方法和基准解释。本次研讨会中应用的基于GMM方法的具体大纲遵循了Matzig13, 14最近发表的协议,他也是本次研讨会的负责人。该方法包括从遗留数据(如绘图或照片)中半自动提取轮廓。重要的是,该协议完全依赖于开源软件,并且除了基本的图像准备之外,完全可复制和可再现。在讲习班开始之前,所有与会者都准备了与他们的专业知识相关的个人照片或图纸,以及相关的元数据,如地理坐标和日期。在研讨会期间,重点首先放在如何使用开源成像软件GIMP (http://www.gimp.org)和r准备图像以提取工件轮廓。以这种方式创建的大纲数据集,范围从晚更新世的欧洲和北非到全新世的北美和南美(图2),在一个多变量框架中进行了分析,密切遵循Matzig等人的方法。15这种方法的性能直接与之前发表的分析进行了比较,这些分析使用传统的排版技术属性以及使用基于地标的GMM,并被证明可以捕捉到人工制品形式的显着差异它们存在的地方。 在研讨会的第一天,每个参与者都展示了他们的数据集,并分享了他们对他们想要测试的文化进化过程的假设;这些假设不同地与时间和空间差异有关,或与手头材料的文化分类评估有关。每个参与者的数据集和研究问题在地理和时间范围上有很大的不同,每个数据集中的人工制品数量也各不相同。一些数据集最适合分析它们的历时性、遗址内的文化进化模式,而对其他数据集来说,大陆上的模式和时间上的深度尺度是最相关的。在每位参与者介绍了他们的数据集和目标之后,他们完成了包含所有相关信息的元数据表。第二天是专门为一个共同标准的图像准备,以便这些可以转移到自动轮廓提取协议。第三天和第四天集中在主要的分析管道上,第一步包括使用椭圆傅里叶分析和主成分分析对提取的轮廓进行量化,以进行初步可视化。然后,使用层次聚类和差异分析对结果数据进行进一步查询。后者使用R软件包“差异”实现,17表示形态测量数据集中的多变量方差测量,与线性测量的变异系数(CV)相当。通过量化方差,CV通常用于文化传播研究,以推断与古代工艺生产(包括石器)相关的社会学习的主导模式。差异测量,以及揭示手头石器形状数据内部结构的多元分析,促进了对社会传播和文化演变的解释(图3)。在第五天也是最后一天,参与者展示了他们的结果,并就他们的先验期望进行了讨论。此外,所有数据集都按照完全相同的分析管道进行组合和分析。由于它的重点是概念问题以及数据争论和分析,这个研讨会是紧张的、富有成效的和协作的。参与者带着一套工具离开,以重现分析2D岩屑轮廓。出于同样的原因,参与者提出的数据和研究问题的异质性为回顾分析工作流的优势和劣势提供了机会。对于大多数数据集,分层聚类被证明是可视化工件形状之间关系和比较现有分类效果的有用工具。由于所有的分析都是在灵活的R计算环境中进行的,映射或其他形式的下游可视化可以以直接的方式添加,同时保持可重复性最后一天以一场关于捕获工具形状异质性方法的适用性的激进性讨论结束,并提出了诸如不对称工具(如背面件)的定向标准等重要问题。抽样偏差和分析尺度的问题也被提出,目前的工作流程是最适合宏观考古方法。除了这些重要的发现和对参与者的培训之外,作为讲习班的一部分整理的数据集现已免费提供(https://doi.org/10.5281/zenodo.7757171);相关元数据可作为本报告的支持信息。我们希望未来的研究将使用、更新和增加这些数据。随着时间的推移,这样一个公共资料库将是在大地理和时间尺度上对文化演变进行比较研究的第一步。研讨会的最后讨论围绕着将整体轮廓GMM与特定技术特征分析结合起来的潜力,以及如何将这些整合到新兴的系统发育应用中。到目前为止,对石头抛射点的系统发育分析已经用不同的特征来划分人工制品,以捕捉它们的关键特征和形状。只有这样基于特征和里程碑的GMM才提供了与系统发育方法的整合然而,BEAST23和RevBayes24原则上都允许使用连续字符,尤其是在贝叶斯统计框架内。由于这些最近的发展,在这些强大的石器分析定量方法之间更全面的整合迫在眉睫。因此,在一个分析方案下,这两种丰富的轮廓形状数据可以与技术特征相结合。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
7.00
自引率
5.40%
发文量
46
期刊介绍: Evolutionary Anthropology is an authoritative review journal that focuses on issues of current interest in biological anthropology, paleoanthropology, archaeology, functional morphology, social biology, and bone biology — including dentition and osteology — as well as human biology, genetics, and ecology. In addition to lively, well-illustrated articles reviewing contemporary research efforts, this journal also publishes general news of relevant developments in the scientific, social, or political arenas. Reviews of noteworthy new books are also included, as are letters to the editor and listings of various conferences. The journal provides a valuable source of current information for classroom teaching and research activities in evolutionary anthropology.
期刊最新文献
A biochronological date of 3.6 million years for "Little Foot" (StW 573, Australopithecus prometheus from Sterkfontein, South Africa). The evolutionary origin of human kissing. Issue Information Issue Information Back(s) to basics: The concept of backing in stone tool technologies for tracing hominins' technical innovations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1