首页 > 最新文献

Journal of Systems and Software最新文献

英文 中文
Do code reviews lead to fewer code smells? 代码审查会减少代码臭味吗?
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-20 DOI: 10.1016/j.jss.2024.112101
Erdem Tuna , Carolyn Seaman , Eray Tüzün

Context:

The code review process is conducted by software teams with various motivations. Among other goals, code reviews act as a gatekeeper for software quality.

Objective:

In this study, we explore whether code reviews have an impact on one specific aspect of software quality, software maintainability. We further extend our investigation by analyzing whether code review process quality (as evidenced by the presence of code review process smells) influences software maintainability (as evidenced by the presence of code smells).

Method:

We investigate whether smells in the code review process are related to smells in the code that was reviewed by using correlation analysis. We augment our quantitative analysis with a focus group study to learn practitioners’ opinions.

Results:

Our investigations revealed that the level of code smells neither increases nor decreases in 8 out of 10 code reviews, regardless of the quality of the code review. Contrary to our own intuition and that of the practitioners in our focus groups, we found that code review process smells have little to no correlation with the level of code smells. We identified multiple potential reasons behind the counter-intuitive results based on our focus group data. Furthermore, practitioners still believe that code reviews are helpful in improving software maintainability.

Conclusion:

Our results imply that the community should update our goals for code review practices and reevaluate those practices to align them with more relevant and modern realities.

背景:软件团队出于各种动机进行代码审查。目标:在本研究中,我们将探讨代码审查是否会影响软件质量的一个特定方面,即软件的可维护性。我们通过分析代码审查过程的质量(通过代码审查过程中是否存在异味来证明)是否会影响软件的可维护性(通过是否存在代码异味来证明)来进一步扩展我们的研究。方法:我们通过相关分析来研究代码审查过程中的异味是否与被审查代码中的异味有关。结果:我们的调查显示,无论代码审查的质量如何,在 10 次代码审查中,有 8 次的代码气味水平既没有增加也没有减少。与我们的直觉和焦点小组中从业人员的直觉相反,我们发现代码审查过程中的气味与代码气味水平几乎没有关联。根据焦点小组的数据,我们找出了这一反直觉结果背后的多种潜在原因。此外,从业人员仍然认为代码审查有助于提高软件的可维护性。结论:我们的研究结果表明,社会各界应该更新代码审查实践的目标,并重新评估这些实践,使其符合更加相关和现代的现实。
{"title":"Do code reviews lead to fewer code smells?","authors":"Erdem Tuna ,&nbsp;Carolyn Seaman ,&nbsp;Eray Tüzün","doi":"10.1016/j.jss.2024.112101","DOIUrl":"10.1016/j.jss.2024.112101","url":null,"abstract":"<div><h3>Context:</h3><p>The code review process is conducted by software teams with various motivations. Among other goals, code reviews act as a gatekeeper for software quality.</p></div><div><h3>Objective:</h3><p>In this study, we explore whether code reviews have an impact on one specific aspect of software quality, software maintainability. We further extend our investigation by analyzing whether code review process quality (as evidenced by the presence of code review process smells) influences software maintainability (as evidenced by the presence of code smells).</p></div><div><h3>Method:</h3><p>We investigate whether smells in the code review process are related to smells in the code that was reviewed by using correlation analysis. We augment our quantitative analysis with a focus group study to learn practitioners’ opinions.</p></div><div><h3>Results:</h3><p>Our investigations revealed that the level of code smells neither increases nor decreases in 8 out of 10 code reviews, regardless of the quality of the code review. Contrary to our own intuition and that of the practitioners in our focus groups, we found that code review process smells have little to no correlation with the level of code smells. We identified multiple potential reasons behind the counter-intuitive results based on our focus group data. Furthermore, practitioners still believe that code reviews are helpful in improving software maintainability.</p></div><div><h3>Conclusion:</h3><p>Our results imply that the community should update our goals for code review practices and reevaluate those practices to align them with more relevant and modern realities.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141130097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EFACT: An External Function Auto-Completion Tool to strengthen static binary lifting EFACT:加强二进制静态提升的外部函数自动完成工具
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-17 DOI: 10.1016/j.jss.2024.112092
Yilei Zhang, Haoyu Liao, Zekun Wang, Bo Huang, Jianmei Guo

Static binary lifting is essential in binary rewriting frameworks. Existing tools overlook the impact of External Function Completion (EXFC) in static binary lifting. EXFC recovers the declarations of External Functions (EXFs, functions defined in standard shared libraries) using only the function symbols available. Incorrect EXFC can misinterpret the source binary, or cause memory overflows in static binary translation, which eventually results in program crashes. Notably, existing tools struggle to recover the declarations of mangled EXFs originating from binaries compiled from C++. Moreover, they require time-consuming manual processing to support new libraries.

This paper presents EFACT, an External Function Auto-Completion Tool for static binary lifting. Our EXF recovery algorithm better recovers the declarations of mangled EXFs, particularly addressing the template specialization mechanism in C++. EFACT is designed as a lightweight plugin to strengthen other static binary rewriting frameworks in EXFC. Our evaluation shows that EFACT outperforms RetDec and McSema in mangled EXF recovery by 96.4% and 97.3% on SPECrate 2017.

Furthermore, we delve deeper into static binary translation and address several cross-ISA EXFC problems. When integrated with McSema, EFACT correctly translates 36.7% more benchmarks from x86-64 to x86-64 and 93.6% more from x86-64 to AArch64 than McSema alone on EEMBC.

静态二进制提升在二进制重写框架中至关重要。现有工具忽视了外部函数补全(EXFC)在静态二进制提升中的影响。EXFC 仅使用可用的函数符号来恢复外部函数(EXF,标准共享库中定义的函数)的声明。不正确的 EXFC 会误解源二进制文件,或在静态二进制转换中导致内存溢出,最终导致程序崩溃。值得注意的是,现有工具很难恢复源于 C++ 编译的二进制文件中被弄错的 EXF 声明。此外,它们还需要耗时的人工处理才能支持新的库。本文介绍了用于静态二进制转换的外部函数自动完成工具 EFACT。我们的 EXF 恢复算法能更好地恢复被混淆的 EXF 声明,特别是解决 C++ 中的模板特化机制。EFACT 被设计成一个轻量级插件,用于加强 EXFC 中的其他静态二进制重写框架。我们的评估结果表明,在 SPECrate 2017 上,EFACT 的误码 EXF 恢复率分别比 RetDec 和 McSema 高 96.4% 和 97.3%。此外,我们还深入研究了静态二进制翻译,并解决了几个跨 ISA EXFC 问题。与 McSema 集成后,EFACT 在 EEMBC 上正确翻译 x86-64 到 x86-64 的基准比单独翻译 McSema 多 36.7%,正确翻译 x86-64 到 AArch64 的基准比单独翻译 McSema 多 93.6%。
{"title":"EFACT: An External Function Auto-Completion Tool to strengthen static binary lifting","authors":"Yilei Zhang,&nbsp;Haoyu Liao,&nbsp;Zekun Wang,&nbsp;Bo Huang,&nbsp;Jianmei Guo","doi":"10.1016/j.jss.2024.112092","DOIUrl":"10.1016/j.jss.2024.112092","url":null,"abstract":"<div><p>Static binary lifting is essential in binary rewriting frameworks. Existing tools overlook the impact of External Function Completion (EXFC) in static binary lifting. EXFC recovers the declarations of External Functions (EXFs, functions defined in standard shared libraries) using only the function symbols available. Incorrect EXFC can misinterpret the source binary, or cause memory overflows in static binary translation, which eventually results in program crashes. Notably, existing tools struggle to recover the declarations of mangled EXFs originating from binaries compiled from C++. Moreover, they require time-consuming manual processing to support new libraries.</p><p>This paper presents EFACT, an External Function Auto-Completion Tool for static binary lifting. Our EXF recovery algorithm better recovers the declarations of mangled EXFs, particularly addressing the template specialization mechanism in C++. EFACT is designed as a lightweight plugin to strengthen other static binary rewriting frameworks in EXFC. Our evaluation shows that EFACT outperforms RetDec and McSema in mangled EXF recovery by 96.4% and 97.3% on SPECrate 2017.</p><p>Furthermore, we delve deeper into static binary translation and address several cross-ISA EXFC problems. When integrated with McSema, EFACT correctly translates 36.7% more benchmarks from x86-64 to x86-64 and 93.6% more from x86-64 to AArch64 than McSema alone on EEMBC.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141028560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Semantic interoperability for an AI-based applications platform for smart hospitals using HL7 FHIR 利用 HL7 FHIR 实现基于人工智能的智慧医院应用平台的语义互操作性
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-16 DOI: 10.1016/j.jss.2024.112093
Emmanouil S. Rigas , Paris Lagakis , Makis Karadimas , Evangelos Logaras , Dimitra Latsou , Magda Hatzikou , Athanasios Poulakidas , Antonis Billis , Panagiotis D. Bamidis

The digitization of the healthcare domain has the potential to drastically improve healthcare services, reduce the time to diagnosis, and lower costs. However, digital applications for the healthcare domain need to be interoperable to maximize their potential. Additionally, with the rapid expansion of Artificial Intelligence (AI) and, specifically, Machine Learning (ML), large amounts of diverse types of data are being utilized. Thus, to achieve interoperability in such applications, the adoption of common semantic data models becomes imperative. In this paper, we describe the adoption of such a common semantic data model, using the well-known Health Level Seven Fast Health Interoperability Resources (HL7 FHIR) standard, in a platform that assists in the creation and storage of a plethora of AI-based applications for several medical conditions. The FHIR server’s efficiency is being showcased by using it in an application predicting coronary artery stenosis as well as for managing the platform’s key performance indicators.

医疗保健领域的数字化有可能极大地改善医疗保健服务,缩短诊断时间并降低成本。然而,医疗保健领域的数字应用需要具有互操作性,才能最大限度地发挥其潜力。此外,随着人工智能(AI),特别是机器学习(ML)的快速发展,大量不同类型的数据正在被利用。因此,要在此类应用中实现互操作性,采用通用语义数据模型势在必行。在本文中,我们介绍了在一个平台中采用这种通用语义数据模型的情况,该平台采用了众所周知的健康七级快速健康互操作性资源(HL7 FHIR)标准,可协助创建和存储大量基于人工智能的应用,适用于多种医疗条件。FHIR 服务器在预测冠状动脉狭窄以及管理平台关键性能指标的应用中的使用,展示了它的效率。
{"title":"Semantic interoperability for an AI-based applications platform for smart hospitals using HL7 FHIR","authors":"Emmanouil S. Rigas ,&nbsp;Paris Lagakis ,&nbsp;Makis Karadimas ,&nbsp;Evangelos Logaras ,&nbsp;Dimitra Latsou ,&nbsp;Magda Hatzikou ,&nbsp;Athanasios Poulakidas ,&nbsp;Antonis Billis ,&nbsp;Panagiotis D. Bamidis","doi":"10.1016/j.jss.2024.112093","DOIUrl":"10.1016/j.jss.2024.112093","url":null,"abstract":"<div><p>The digitization of the healthcare domain has the potential to drastically improve healthcare services, reduce the time to diagnosis, and lower costs. However, digital applications for the healthcare domain need to be interoperable to maximize their potential. Additionally, with the rapid expansion of Artificial Intelligence (AI) and, specifically, Machine Learning (ML), large amounts of diverse types of data are being utilized. Thus, to achieve interoperability in such applications, the adoption of common semantic data models becomes imperative. In this paper, we describe the adoption of such a common semantic data model, using the well-known Health Level Seven Fast Health Interoperability Resources (HL7 FHIR) standard, in a platform that assists in the creation and storage of a plethora of AI-based applications for several medical conditions. The FHIR server’s efficiency is being showcased by using it in an application predicting coronary artery stenosis as well as for managing the platform’s key performance indicators.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0164121224001389/pdfft?md5=f346d164625ed64202f88e37aa46e21d&pid=1-s2.0-S0164121224001389-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141044062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantum circuit optimization of an integer divider 整数除法器的量子电路优化
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-10 DOI: 10.1016/j.jss.2024.112091
Francisco Orts, Remigijus Paulavičius, Ernestas Filatovas

Efficient arithmetic operations in quantum circuits play a vital role in the implementation of quantum algorithms. Quantum circuits constructed exclusively using gates of the Clifford+T group are compatible with error detection and correction codes available in the quantum literature. However, the T gate, a member of this group, has a higher cost compared to other gates, making it crucial to minimize its usage to reduce circuit expenses. While the T gate cannot be entirely avoided since the Clifford group is not a universal set of gates, circuit optimization can effectively reduce the number of T gates required for implementation. In this work, we present a novel divider circuit for quantum computing that focuses on reducing the number of T gates while maintaining a reasonable number of qubits for this type of operation. To achieve this, we introduce variants of minor circuits, including a comparator and two types of subtractors. These circuits are based on published literature but undergo modifications to optimize their resource utilization for performing the division operation. The obtained results demonstrate that the proposed divider circuit outperforms other currently published divider circuits in terms of T gate usage, highlighting its efficiency and potential practicality in quantum algorithms.

量子电路中的高效算术运算对量子算法的实现起着至关重要的作用。完全使用 Clifford+T 门组构建的量子电路与量子文献中的错误检测和纠错码兼容。然而,与其他门电路相比,该门电路中的 T 门具有更高的成本,因此最大限度地减少 T 门的使用以降低电路成本至关重要。虽然由于克利福德门不是一组通用的门,因此不能完全避免 T 门,但电路优化可以有效减少实现所需的 T 门数量。在这项工作中,我们提出了一种用于量子计算的新型除法器电路,其重点是减少 T 门的数量,同时为这类操作保持合理的量子比特数量。为此,我们引入了次要电路的变体,包括一个比较器和两种减法器。这些电路以已发表的文献为基础,但进行了修改,以优化执行除法运算时的资源利用率。研究结果表明,所提出的除法电路在 T 门使用方面优于目前已发表的其他除法电路,突出了其在量子算法中的效率和潜在实用性。
{"title":"Quantum circuit optimization of an integer divider","authors":"Francisco Orts,&nbsp;Remigijus Paulavičius,&nbsp;Ernestas Filatovas","doi":"10.1016/j.jss.2024.112091","DOIUrl":"10.1016/j.jss.2024.112091","url":null,"abstract":"<div><p>Efficient arithmetic operations in quantum circuits play a vital role in the implementation of quantum algorithms. Quantum circuits constructed exclusively using gates of the Clifford+T group are compatible with error detection and correction codes available in the quantum literature. However, the T gate, a member of this group, has a higher cost compared to other gates, making it crucial to minimize its usage to reduce circuit expenses. While the T gate cannot be entirely avoided since the Clifford group is not a universal set of gates, circuit optimization can effectively reduce the number of T gates required for implementation. In this work, we present a novel divider circuit for quantum computing that focuses on reducing the number of T gates while maintaining a reasonable number of qubits for this type of operation. To achieve this, we introduce variants of minor circuits, including a comparator and two types of subtractors. These circuits are based on published literature but undergo modifications to optimize their resource utilization for performing the division operation. The obtained results demonstrate that the proposed divider circuit outperforms other currently published divider circuits in terms of T gate usage, highlighting its efficiency and potential practicality in quantum algorithms.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141046270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Distribution-aware fairness test generation 生成分布感知的公平性测试
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-10 DOI: 10.1016/j.jss.2024.112090
Sai Sathiesh Rajan , Ezekiel Soremekun , Yves Le Traon , Sudipta Chattopadhyay

Ensuring that all classes of objects are detected with equal accuracy is essential in AI systems. For instance, being unable to identify any one class of objects could have fatal consequences in autonomous driving systems. Hence, ensuring the reliability of image recognition systems is crucial. This work addresses how to validate group fairness in image recognition software. We propose a distribution-aware fairness testing approach (called DISTROFAIR) that systematically exposes class-level fairness violations in image classifiers via a synergistic combination of out-of-distribution (OOD) testing and semantic-preserving image mutation. DISTROFAIR automatically learns the distribution (e.g., number/orientation) of objects in a set of images. Then it systematically mutates objects in the images to become OOD using three semantic-preserving image mutationsobject deletion, object insertion and object rotation. We evaluate DISTROFAIR using two well-known datasets (CityScapes and MS-COCO) and three major, commercial image recognition software (namely, Amazon Rekognition, Google Cloud Vision and Azure Computer Vision). Results show that about 21% of images generated by DISTROFAIR reveal class-level fairness violations using either ground truth or metamorphic oracles. DISTROFAIR is up to 2.3× more effective than two main baselines, i.e., (a) an approach which focuses on generating images only within the distribution (ID) and (b) fairness analysis using only the original image dataset. We further observed that DISTROFAIR is efficient, it generates 460 images per hour, on average. Finally, we evaluate the semantic validity of our approach via a user study with 81 participants, using 30 real images and 30 corresponding mutated images generated by DISTROFAIR. We found that images generated by DISTROFAIR are 80% as realistic as real-world images.

在人工智能系统中,确保以同样的准确度检测到所有类别的物体至关重要。例如,在自动驾驶系统中,无法识别任何一类物体都可能造成致命后果。因此,确保图像识别系统的可靠性至关重要。这项工作涉及如何验证图像识别软件中的群体公平性。我们提出了一种分布感知公平性测试方法(称为 DISTROFAIR),它通过分布外(OOD)测试和语义保护图像突变的协同组合,系统性地揭露图像分类器中的类级公平性违规行为。DISTROFAIR 可自动学习一组图像中对象的分布(如数量/方向)。然后,它通过三种语义保护图像突变--对象删除、对象插入和对象旋转--系统地突变图像中的对象,使其成为 OOD。我们使用两个著名的数据集(CityScapes 和 MS-COCO)和三个主要的商业图像识别软件(即 Amazon Rekognition、Google Cloud Vision 和 Azure Computer Vision)对 DISTROFAIR 进行了评估。结果表明,使用 DISTROFAIR 生成的图像中,约有 21% 在使用地面实况或蜕变指标时显示出违反类级公平性的情况。DISTROFAIR 比两个主要基线(即 (a) 仅在分布 (ID) 范围内生成图像的方法和 (b) 仅使用原始图像数据集进行公平性分析)高出 2.3 倍。我们进一步观察到,DISTROFAIR 的效率很高,平均每小时可生成 460 幅图像。最后,我们使用 DISTROFAIR 生成的 30 幅真实图像和 30 幅相应的变异图像,通过对 81 名参与者进行用户研究,评估了我们方法的语义有效性。我们发现,DISTROFAIR 生成的图像有 80% 与真实世界的图像一样逼真。
{"title":"Distribution-aware fairness test generation","authors":"Sai Sathiesh Rajan ,&nbsp;Ezekiel Soremekun ,&nbsp;Yves Le Traon ,&nbsp;Sudipta Chattopadhyay","doi":"10.1016/j.jss.2024.112090","DOIUrl":"https://doi.org/10.1016/j.jss.2024.112090","url":null,"abstract":"<div><p>Ensuring that all classes of objects are detected with equal accuracy is essential in AI systems. For instance, being unable to identify any one class of objects could have fatal consequences in autonomous driving systems. Hence, ensuring the reliability of image recognition systems is crucial. This work addresses <em>how to validate group fairness in image recognition software</em>. We propose a <em>distribution-aware fairness testing</em> approach (called DISTROFAIR) that systematically exposes class-level fairness violations in image classifiers via a synergistic combination of <em>out-of-distribution (OOD) testing</em> and <em>semantic-preserving image mutation</em>. DISTROFAIR automatically <em>learns the distribution</em> (e.g., number/orientation) of objects in a set of images. Then it <em>systematically mutates objects in the images</em> to become OOD using three <em>semantic-preserving image mutations</em> – <em>object deletion</em>, <em>object insertion</em> and <em>object rotation</em>. We evaluate DISTROFAIR using two well-known datasets (CityScapes and MS-COCO) and three major, commercial image recognition software (namely, Amazon Rekognition, Google Cloud Vision and Azure Computer Vision). Results show that about 21% of images generated by DISTROFAIR reveal class-level fairness violations using either ground truth or metamorphic oracles. DISTROFAIR is up to 2.3× more effective than two main <em>baselines</em>, i.e., (a) an approach which focuses on generating images only <em>within the distribution</em> (ID) and (b) fairness analysis using only the original image dataset. We further observed that DISTROFAIR is efficient, it generates 460 images per hour, on average. Finally, we evaluate the semantic validity of our approach via a user study with 81 participants, using 30 real images and 30 corresponding mutated images generated by DISTROFAIR. We found that images generated by DISTROFAIR are 80% as realistic as real-world images.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141163702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond code: Is there a difference between comments in visual and textual languages? 代码之外:视觉语言和文本语言的注释有区别吗?
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-09 DOI: 10.1016/j.jss.2024.112087
Alexander Boll , Pooja Rani , Alexander Schultheiß , Timo Kehrer

Code comments are crucial for program comprehension and maintenance. To better understand the nature and content of comments, previous work proposed taxonomies of comment information for textual languages, notably classical programming languages. However, paradigms such as model-driven or model-based engineering often promote the use of visual languages, to which existing taxonomies are not directly applicable. Taking MATLAB/Simulink as a representative of a sophisticated and widely used modeling environment, we extend a multi-language comment taxonomy onto new (visual) comment types and two new languages: Simulink and MATLAB. Furthermore, we outline Simulink commenting practices and compare them to textual languages. We analyze 259,267 comments from 9095 Simulink models and 17,792 MATLAB scripts. We identify the comment types, their usage frequency, classify comment information, and analyze their correlations with model metrics. We manually analyze 757 comments to extend the taxonomy. We also analyze commenting guidelines and developer adherence to them. Our extended taxonomy, SCoT (Simulink Comment Taxonomy), contains 25 categories. We find that Simulink comments, although often duplicated, are used at all model hierarchy levels. Of all comment types, Annotations are used most often; Notes scarcely. Our results indicate that Simulink developers, instead of extending comments, add new ones, and rarely follow commenting guidelines. Overall, we find Simulink comment information comparable to textual languages, which highlights commenting practice similarity across languages.

代码注释对于程序的理解和维护至关重要。为了更好地理解注释的性质和内容,以前的工作提出了文本语言,特别是经典编程语言的注释信息分类法。然而,模型驱动或基于模型的工程等范例往往提倡使用可视化语言,而现有的分类标准并不能直接适用于这些范例。以 MATLAB/Simulink 为代表,我们将多语言注释分类法扩展到了新的(可视化)注释类型和两种新的语言上:Simulink 和 MATLAB。此外,我们还概述了 Simulink 评论实践,并将其与文本语言进行了比较。我们分析了来自 9095 个 Simulink 模型和 17792 个 MATLAB 脚本的 259267 条注释。我们确定了注释类型及其使用频率,对注释信息进行了分类,并分析了它们与模型指标的相关性。我们手动分析了 757 条评论,以扩展分类法。我们还分析了评论指南和开发人员对指南的遵守情况。我们的扩展分类法 SCoT(Simulink 评论分类法)包含 25 个类别。我们发现,Simulink 注释虽然经常重复,但在所有模型层次结构中都有使用。在所有注释类型中,"注释 "的使用频率最高,而 "注解 "则很少使用。我们的结果表明,Simulink 开发人员不是扩展注释,而是添加新的注释,而且很少遵循注释指南。总体而言,我们发现 Simulink 的注释信息与文本语言相当,这凸显了不同语言注释实践的相似性。
{"title":"Beyond code: Is there a difference between comments in visual and textual languages?","authors":"Alexander Boll ,&nbsp;Pooja Rani ,&nbsp;Alexander Schultheiß ,&nbsp;Timo Kehrer","doi":"10.1016/j.jss.2024.112087","DOIUrl":"10.1016/j.jss.2024.112087","url":null,"abstract":"<div><p>Code comments are crucial for program comprehension and maintenance. To better understand the nature and content of comments, previous work proposed taxonomies of comment information for textual languages, notably classical programming languages. However, paradigms such as model-driven or model-based engineering often promote the use of visual languages, to which existing taxonomies are not directly applicable. Taking MATLAB/Simulink as a representative of a sophisticated and widely used modeling environment, we extend a multi-language comment taxonomy onto new (visual) comment types and two new languages: Simulink and MATLAB. Furthermore, we outline Simulink commenting practices and compare them to textual languages. We analyze 259,267 comments from 9095 Simulink models and 17,792 MATLAB scripts. We identify the comment types, their usage frequency, classify comment information, and analyze their correlations with model metrics. We manually analyze 757 comments to extend the taxonomy. We also analyze commenting guidelines and developer adherence to them. Our extended taxonomy, SCoT (Simulink Comment Taxonomy), contains 25 categories. We find that Simulink comments, although often duplicated, are used at all model hierarchy levels. Of all comment types, Annotations are used most often; Notes scarcely. Our results indicate that Simulink developers, instead of extending comments, add new ones, and rarely follow commenting guidelines. Overall, we find Simulink comment information comparable to textual languages, which highlights commenting practice similarity across languages.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0164121224001328/pdfft?md5=4c770110e1561bfd35b9eb9bfc3fee5d&pid=1-s2.0-S0164121224001328-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141057286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Thoughts on applicability 关于适用性的思考
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-08 DOI: 10.1016/j.jss.2024.112086
Titus Winters

The gulf between industry and academic interests in Software Engineering appears to continue to widen. With software taking on an ever-growing role in society, it is somewhat concerning that the interests and research focuses of academic software engineers seem to rarely overlap with industry interests. In this editorial, I hypothesize four major concerns I have with the applicability of much of the research in this area. I also surface the important meta question: What is Software Engineering Research? Is this the study of software engineers, or the study of best practices in software engineering? Does academic SE research owe more to anthropology, or the study of what makes software successful?

在软件工程领域,产业界和学术界的兴趣差距似乎在继续扩大。随着软件在社会中扮演越来越重要的角色,学术界软件工程师的兴趣和研究重点似乎很少与产业界的兴趣重叠,这多少令人担忧。在这篇社论中,我对这一领域大部分研究的适用性提出了四大担忧。我还提出了一个重要的元问题:什么是软件工程研究?它是对软件工程师的研究,还是对软件工程最佳实践的研究?学术性的 SE 研究更像是人类学,还是研究软件成功的原因?
{"title":"Thoughts on applicability","authors":"Titus Winters","doi":"10.1016/j.jss.2024.112086","DOIUrl":"10.1016/j.jss.2024.112086","url":null,"abstract":"<div><p>The gulf between industry and academic interests in Software Engineering appears to continue to widen. With software taking on an ever-growing role in society, it is somewhat concerning that the interests and research focuses of academic software engineers seem to rarely overlap with industry interests. In this editorial, I hypothesize four major concerns I have with the applicability of much of the research in this area. I also surface the important meta question: What is Software Engineering Research? Is this the study of software engineers, or the study of best practices in software engineering? Does academic SE research owe more to anthropology, or the study of what makes software successful?</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141030457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What is discussed about Flutter on Stack Overflow (SO) question-and-answer (Q&A) website: An empirical study Stack Overflow (SO) 问答网站上有关 Flutter 的讨论情况:实证研究
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-07 DOI: 10.1016/j.jss.2024.112089
Afit Alanazi , Reem Alfayez

Context:

Mobile applications are growing in prevalence. Cross-platform application is one of the main challenges within mobile application development. Aiming to facilitate the process of mobile application development, the software engineering community developed multiple solutions to support cross-platform application development. Flutter is a recent cross-platform software development kit (SDK) that has been rising in popularity.

Objective:

This study aims to gain a better understanding of Flutter stance on Stack Overflow (SO).

Method:

The study identified and analyzed 176,876 Flutter-related questions to understand the interest towards Flutter. The study utilized Latent Dirichlet Allocation (LDA) to identify Flutter-related topics discussed within the identified questions. Subsequently, a number of heuristics were utilized to gauge the popularity and difficulty of topics.

Results:

The study revealed that interest towards Flutter was steadily increasing on SO until it dropped in 2023 and SO users discuss 12 Flutter-related topics, with the topic of setup and build automation being the most popular and most difficult.

Conclusion:

This study highlights the interest towards Flutter on SO, identifies Flutter-related topics discussed on the website, and assess the topics popularity and difficulty. Software researchers, practitioners, educators, and Flutter contributors may utilize the results to steer their future Flutter-related efforts.

背景:移动应用日益普及。跨平台应用是移动应用开发的主要挑战之一。为了促进移动应用开发过程,软件工程界开发了多种解决方案来支持跨平台应用开发。Flutter是最近流行起来的一种跨平台软件开发工具包(SDK)。研究目的:本研究旨在更好地了解Stack Overflow(SO)上的Flutter立场。该研究利用潜狄利克特分配法(LDA)来识别已识别问题中讨论的 Flutter 相关主题。结果:研究显示,用户对 Flutter 的兴趣在 SO 上稳步上升,直到 2023 年才有所下降,SO 用户讨论了 12 个与 Flutter 相关的话题,其中设置和构建自动化话题最受欢迎,也最难。软件研究人员、从业人员、教育工作者和 Flutter 贡献者可以利用这些结果来指导他们未来与 Flutter 相关的工作。
{"title":"What is discussed about Flutter on Stack Overflow (SO) question-and-answer (Q&A) website: An empirical study","authors":"Afit Alanazi ,&nbsp;Reem Alfayez","doi":"10.1016/j.jss.2024.112089","DOIUrl":"https://doi.org/10.1016/j.jss.2024.112089","url":null,"abstract":"<div><h3>Context:</h3><p>Mobile applications are growing in prevalence. Cross-platform application is one of the main challenges within mobile application development. Aiming to facilitate the process of mobile application development, the software engineering community developed multiple solutions to support cross-platform application development. Flutter is a recent cross-platform software development kit (SDK) that has been rising in popularity.</p></div><div><h3>Objective:</h3><p>This study aims to gain a better understanding of Flutter stance on Stack Overflow (SO).</p></div><div><h3>Method:</h3><p>The study identified and analyzed 176,876 Flutter-related questions to understand the interest towards Flutter. The study utilized Latent Dirichlet Allocation (LDA) to identify Flutter-related topics discussed within the identified questions. Subsequently, a number of heuristics were utilized to gauge the popularity and difficulty of topics.</p></div><div><h3>Results:</h3><p>The study revealed that interest towards Flutter was steadily increasing on SO until it dropped in 2023 and SO users discuss 12 Flutter-related topics, with the topic of setup and build automation being the most popular and most difficult.</p></div><div><h3>Conclusion:</h3><p>This study highlights the interest towards Flutter on SO, identifies Flutter-related topics discussed on the website, and assess the topics popularity and difficulty. Software researchers, practitioners, educators, and Flutter contributors may utilize the results to steer their future Flutter-related efforts.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140948053","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Code search engines for the next generation 下一代代码搜索引擎
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-05-06 DOI: 10.1016/j.jss.2024.112065
Marcus Kessel, Colin Atkinson

Given the abundance of software in open source repositories, code search engines are increasingly turning to “big data” technologies such as natural language processing and machine learning, to deliver more useful search results. However, like the syntax-based approaches traditionally used to analyze and compare code in the first generation of code search engines, big data technologies are essentially static analysis processes. When dynamic properties of software, such as run-time behavior (i.e., semantics) and performance, are among the search criteria, the exclusive use of static algorithms has a significant negative impact on the precision and recall of the search results as well as other key usability factors such as ranking quality. Therefore, to address these weaknesses and provide a more reliable and usable service, the next generation of code search engines needs to complement static code analysis techniques with equally large-scale, dynamic analysis techniques based on its execution and observation. In this paper we describe a new software platform specifically developed to achieve this by simplifying and largely automating the dynamic analysis (i.e., observation) of code at a large scale. We show how this platform can combine dynamically observed properties of code modules with static properties to improve the quality and usability of code search results.

鉴于开源软件库中软件的丰富性,代码搜索引擎越来越多地转向 "大数据 "技术,如自然语言处理和机器学习,以提供更有用的搜索结果。然而,与第一代代码搜索引擎传统上用于分析和比较代码的基于语法的方法一样,大数据技术本质上也是静态分析过程。当软件的动态属性(如运行时行为(即语义)和性能)成为搜索标准之一时,只使用静态算法会对搜索结果的精确度和召回率以及其他关键可用性因素(如排名质量)产生显著的负面影响。因此,为了解决这些弱点并提供更可靠、更可用的服务,下一代代码搜索引擎需要以同样大规模的、基于执行和观察的动态分析技术来补充静态代码分析技术。在本文中,我们介绍了一个新的软件平台,该平台是专门为实现这一目标而开发的,它简化了大规模代码动态分析(即观察),并在很大程度上实现了自动化。我们展示了该平台如何将动态观察到的代码模块属性与静态属性相结合,从而提高代码搜索结果的质量和可用性。
{"title":"Code search engines for the next generation","authors":"Marcus Kessel,&nbsp;Colin Atkinson","doi":"10.1016/j.jss.2024.112065","DOIUrl":"10.1016/j.jss.2024.112065","url":null,"abstract":"<div><p>Given the abundance of software in open source repositories, code search engines are increasingly turning to “big data” technologies such as natural language processing and machine learning, to deliver more useful search results. However, like the syntax-based approaches traditionally used to analyze and compare code in the first generation of code search engines, big data technologies are essentially static analysis processes. When dynamic properties of software, such as run-time behavior (i.e., semantics) and performance, are among the search criteria, the exclusive use of static algorithms has a significant negative impact on the precision and recall of the search results as well as other key usability factors such as ranking quality. Therefore, to address these weaknesses and provide a more reliable and usable service, the next generation of code search engines needs to complement static code analysis techniques with equally large-scale, dynamic analysis techniques based on its execution and observation. In this paper we describe a new software platform specifically developed to achieve this by simplifying and largely automating the dynamic analysis (i.e., observation) of code at a large scale. We show how this platform can combine dynamically observed properties of code modules with static properties to improve the quality and usability of code search results.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0164121224001109/pdfft?md5=129b984a3b00807acd30accacae25c39&pid=1-s2.0-S0164121224001109-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141027902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FragQC: An efficient quantum error reduction technique using quantum circuit fragmentation FragQC:利用量子电路碎片的高效量子错误减少技术
IF 3.5 2区 计算机科学 Q1 Computer Science Pub Date : 2024-04-30 DOI: 10.1016/j.jss.2024.112085
Saikat Basu , Arnav Das , Amit Saha , Amlan Chakrabarti , Susmita Sur-Kolay

Quantum computers must meet extremely stringent qualitative and quantitative requirements on their qubits in order to solve real-life problems. Quantum circuit fragmentation techniques divide a large quantum circuit into a number of sub-circuits that can be executed on the smaller noisy quantum hardware available. However, the process of quantum circuit fragmentation involves finding an ideal cut that has exponential time complexity and also the classical post-processing required to reconstruct the output. In this paper, we represent a quantum circuit using a weighted graph and propose a novel classical graph partitioning algorithm for selecting an efficient fragmentation that reduces the entanglement between the sub-circuits along with balancing the estimated error in each sub-circuit. We also demonstrate a comparative study of different classical and quantum approaches to graph partitioning for finding such a cut. We present FragQC, a software tool that cuts a quantum circuit into sub-circuits when its error probability exceeds a certain threshold. With this proposed approach, we achieve an increase in fidelity of 13.38% compared to direct execution without cutting the circuit, and 7.88% over the state-of-the-art ILP-based method for the benchmark circuits.

The code for FragQC is available at https://github.com/arnavdas88/FragQC.

量子计算机必须满足对其量子比特极其严格的定性和定量要求,才能解决现实生活中的问题。量子电路分片技术可将大型量子电路分割成若干子电路,这些子电路可在较小的噪声量子硬件上执行。然而,量子电路分片的过程涉及寻找一个理想的切口,该切口具有指数级的时间复杂度,同时还需要进行经典的后处理来重建输出。在本文中,我们使用加权图来表示量子电路,并提出了一种新颖的经典图分割算法,用于选择有效的分片,以减少子电路之间的纠缠,同时平衡每个子电路中的估计误差。我们还展示了不同经典和量子图分割方法的比较研究,以找到这样的切分。我们介绍了 FragQC,这是一种软件工具,可在量子电路的错误概率超过一定阈值时将其切割成子电路。与不切割电路的直接执行方法相比,我们提出的这一方法提高了 13.38% 的保真度,与基于 ILP 方法的最先进基准电路相比,提高了 7.88%。FragQC 的代码可在 https://github.com/arnavdas88/FragQC 上获取。
{"title":"FragQC: An efficient quantum error reduction technique using quantum circuit fragmentation","authors":"Saikat Basu ,&nbsp;Arnav Das ,&nbsp;Amit Saha ,&nbsp;Amlan Chakrabarti ,&nbsp;Susmita Sur-Kolay","doi":"10.1016/j.jss.2024.112085","DOIUrl":"https://doi.org/10.1016/j.jss.2024.112085","url":null,"abstract":"<div><p>Quantum computers must meet extremely stringent qualitative and quantitative requirements on their qubits in order to solve real-life problems. Quantum circuit fragmentation techniques divide a large quantum circuit into a number of sub-circuits that can be executed on the smaller noisy quantum hardware available. However, the process of quantum circuit fragmentation involves finding an ideal cut that has exponential time complexity and also the classical post-processing required to reconstruct the output. In this paper, we represent a quantum circuit using a weighted graph and propose a novel classical graph partitioning algorithm for selecting an efficient fragmentation that reduces the entanglement between the sub-circuits along with balancing the estimated error in each sub-circuit. We also demonstrate a comparative study of different classical and quantum approaches to graph partitioning for finding such a cut. We present <em>FragQC</em>, a software tool that cuts a quantum circuit into sub-circuits when its error probability exceeds a certain threshold. With this proposed approach, we achieve an increase in fidelity of 13.38% compared to direct execution without cutting the circuit, and 7.88% over the state-of-the-art ILP-based method for the benchmark circuits.</p><p>The code for <em>FragQC</em> is available at <span>https://github.com/arnavdas88/FragQC</span><svg><path></path></svg>.</p></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":null,"pages":null},"PeriodicalIF":3.5,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140825820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Systems and Software
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1