BenchCouncil Transactions on Benchmarks, Standards and Evaluations最新文献_第4页

AI-powered Mathematical Sentiment Model and graph theory for social media trends 社交媒体趋势的人工智能数学情感模型和图论

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-12-01 DOI: 10.1016/j.tbench.2025.100202

M. VENKATACHALAM , R․VIKRAMA PRASAD

Significant issues have arisen as a result of the global spread of monkeypox, such as the extensive transmission of false information, public fear, and stigmatization on social media. Increased fear, prejudice, stigmatization of minority groups, and opposition to public health initiatives are frequently the results of these problems. Furthermore, health authorities are unable to provide correct information and prompt actions due to a lack of efficient methods for analyzing the enormous amounts of unstructured social media data. This disparity weakens crisis management initiatives and increases public skepticism of health guidelines. In order to address these issues, this study looks into the attitude around monkeypox on social media in order to pinpoint public worries, counter false information, and enhance communication tactics. The study intends to improve public comprehension, offer practical insights, and help health authorities manage the outbreak by fusing graph theory with AI-driven sentiment analysis. In order to facilitate semantic analysis of tweets through structured information extraction, graph theory is used to organize unstructured or semi-structured data by creating meaningful links between entities. Furthermore, opinions on monkeypox infection in social media are analyzed and user sentiments are detected using a reinforcement Markov decision process. According to experimental results, the suggested model's accuracy on the Monkeypox tweet dataset was 98 %. These results help raise awareness of monkeypox among the general population and promote an educated and robust social response.

猴痘的全球传播导致了一些重大问题，如虚假信息的广泛传播、公众的恐惧以及社交媒体上的污名化。这些问题的结果往往是对少数群体的恐惧、偏见、污名化和对公共卫生倡议的反对。此外，由于缺乏分析大量非结构化社交媒体数据的有效方法，卫生当局无法提供正确的信息和迅速采取行动。这种差距削弱了危机管理举措，并增加了公众对健康指南的怀疑。为了解决这些问题，本研究调查了社交媒体上对猴痘的态度，以确定公众的担忧，反击虚假信息，并加强沟通策略。该研究旨在通过融合图论和人工智能驱动的情绪分析，提高公众的理解，提供实用的见解，并帮助卫生当局管理疫情。为了便于通过结构化信息提取对tweets进行语义分析，图论通过在实体之间创建有意义的链接来组织非结构化或半结构化数据。此外，分析了社交媒体上关于猴痘感染的意见，并使用强化马尔可夫决策过程检测用户情绪。实验结果表明，该模型在猴痘推文数据集上的准确率为98%。这些结果有助于提高一般人群对猴痘的认识，并促进有知识和强有力的社会反应。

{"title":"AI-powered Mathematical Sentiment Model and graph theory for social media trends","authors":"M. VENKATACHALAM , R․VIKRAMA PRASAD","doi":"10.1016/j.tbench.2025.100202","DOIUrl":"10.1016/j.tbench.2025.100202","url":null,"abstract":"<div><div>Significant issues have arisen as a result of the global spread of monkeypox, such as the extensive transmission of false information, public fear, and stigmatization on social media. Increased fear, prejudice, stigmatization of minority groups, and opposition to public health initiatives are frequently the results of these problems. Furthermore, health authorities are unable to provide correct information and prompt actions due to a lack of efficient methods for analyzing the enormous amounts of unstructured social media data. This disparity weakens crisis management initiatives and increases public skepticism of health guidelines. In order to address these issues, this study looks into the attitude around monkeypox on social media in order to pinpoint public worries, counter false information, and enhance communication tactics. The study intends to improve public comprehension, offer practical insights, and help health authorities manage the outbreak by fusing graph theory with AI-driven sentiment analysis. In order to facilitate semantic analysis of tweets through structured information extraction, graph theory is used to organize unstructured or semi-structured data by creating meaningful links between entities. Furthermore, opinions on monkeypox infection in social media are analyzed and user sentiments are detected using a reinforcement Markov decision process. According to experimental results, the suggested model's accuracy on the Monkeypox tweet dataset was 98 %. These results help raise awareness of monkeypox among the general population and promote an educated and robust social response.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 4","pages":"Article 100202"},"PeriodicalIF":0.0,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145871528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

MultiPoint: Enabling scalable pre-silicon performance evaluation for multi-task workloads 多点：支持多任务工作负载的可伸缩预硅性能评估

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2025.100189

Chenji Han , Xinyu Li , Feng Xue , Weitong Wang , Yuxuan Wu , Wenxiang Wang , Fuxin Zhang

With the core numbers integrated within single processors growing and the fast development of cloud computing, performance evaluation for multi-core systems is increasingly crucial. It is typically conducted by executing multi-task workloads, exemplified by SPEC CPU Rate, to measure metrics like system’s throughput. In response, several sampling-based methods have been developed for their pre-silicon performance evaluation. Nevertheless, these methods involve directly capturing multi-task checkpoints, which presents scalability issues of significant storage and time overheads. Therefore, enabling more scalable performance evaluation remains a critical problem.

In this work, we propose MultiPoint to enable scalable pre-silicon performance evaluation for multi-task workloads. It is noted that in the multi-task workloads of interest, each task executes independently without inter-task communication. Therefore, MultiPoint is motivated to construct the required multi-task checkpoints by recovering multiple single-task checkpoints across different cores and guarantee their smooth execution through address remapping and shuffling. We implemented MultiPoint on the Emulator Accelerator and assessed its evaluation accuracy against its post-silicon Loongson 3A6000 processor. Using SPEC CPU 2017 as the benchmark, MultiPoint achieved the estimation errors of 6.20%, 5.45%, and 6.99% for Rate 2, Rate 4, and Rate 8, respectively, achieving comparable accuracy compared to direct multi-task checkpointing but in a more scalable manner with substantially 86.0% lower storage and 93.7% less time overheads.

随着集成在单核处理器中的内核数量不断增加以及云计算的快速发展，多核系统的性能评估变得越来越重要。评估通常通过执行多任务工作负载（如 SPEC CPU Rate）来衡量系统吞吐量等指标。为此，人们开发了几种基于采样的方法，用于硅前性能评估。然而，这些方法涉及直接捕获多任务检查点，会带来大量存储和时间开销的可扩展性问题。因此，实现更具可扩展性的性能评估仍然是一个关键问题。在这项工作中，我们提出了 MultiPoint，以实现多任务工作负载的可扩展硅前性能评估。我们注意到，在所关注的多任务工作负载中，每个任务都是独立执行的，任务间没有通信。因此，MultiPoint 的动机是通过在不同内核间恢复多个单任务检查点来构建所需的多任务检查点，并通过地址重映射和洗牌保证其顺利执行。我们在仿真器加速器上实施了MultiPoint，并针对其硅片后的Loongson 3A6000处理器评估了其评估精度。以 SPEC CPU 2017 为基准，MultiPoint 对速率 2、速率 4 和速率 8 的估算误差分别为 6.20%、5.45% 和 6.99%，与直接多任务检查点相比，精度相当，但扩展性更强，存储开销大幅降低 86.0%，时间开销降低 93.7%。

{"title":"MultiPoint: Enabling scalable pre-silicon performance evaluation for multi-task workloads","authors":"Chenji Han , Xinyu Li , Feng Xue , Weitong Wang , Yuxuan Wu , Wenxiang Wang , Fuxin Zhang","doi":"10.1016/j.tbench.2025.100189","DOIUrl":"10.1016/j.tbench.2025.100189","url":null,"abstract":"<div><div>With the core numbers integrated within single processors growing and the fast development of cloud computing, performance evaluation for multi-core systems is increasingly crucial. It is typically conducted by executing multi-task workloads, exemplified by SPEC CPU Rate, to measure metrics like system’s throughput. In response, several sampling-based methods have been developed for their pre-silicon performance evaluation. Nevertheless, these methods involve directly capturing multi-task checkpoints, which presents scalability issues of significant storage and time overheads. Therefore, enabling more scalable performance evaluation remains a critical problem.</div><div>In this work, we propose MultiPoint to enable scalable pre-silicon performance evaluation for multi-task workloads. It is noted that in the multi-task workloads of interest, each task executes independently without inter-task communication. Therefore, MultiPoint is motivated to construct the required multi-task checkpoints by recovering multiple single-task checkpoints across different cores and guarantee their smooth execution through address remapping and shuffling. We implemented MultiPoint on the Emulator Accelerator and assessed its evaluation accuracy against its post-silicon Loongson 3A6000 processor. Using SPEC CPU 2017 as the benchmark, MultiPoint achieved the estimation errors of 6.20%, 5.45%, and 6.99% for Rate 2, Rate 4, and Rate 8, respectively, achieving comparable accuracy compared to direct multi-task checkpointing but in a more scalable manner with substantially 86.0% lower storage and 93.7% less time overheads.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 3","pages":"Article 100189"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143445331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluation of mechanical properties of natural fiber based polymer composite 天然纤维基聚合物复合材料机械性能评估

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100183

Tarikur Jaman Pramanik , Md. Rafiquzzaman , Anup Karmakar , Marzan Hasan Nayeem , S M Kalbin Salim Turjo , Md. Ragib Abid

Natural fiber based polymer composites are eco-friendly alternatives to synthetic materials, with greater mechanical properties, biodegradability, availability, ease of access, and affordability. Jute fiber is widely recognized as one of the most important and beneficial natural fibers due to its strength, durability, and biodegradability. In this study, the jute composite is designed and fabricated using a 5-layer jute and epoxy resin, utilizing the manual hand lay-up technique. The combination of 52.5 % jute and 47.5 % of epoxy resin and harder is found optimized to achieve the goals of improving the tensile strength and flexural strength, reducing the cost of epoxy resin, and promoting eco-friendliness and sustainability. Tensile testing was performed on a universal testing machine, while flexural testing was done with a three-point bending test. Experimentally, the composites reinforced with jute and epoxy resin were capable of achieving the required levels of tensile strength (42.91 MPa) and bending strength (69.30 MPa). To validate and visualize specimens, numerical analysis was performed on the ABAQUS simulation software. The numerical simulation utilized ASTM D3039 and ASTM D7264 as the specified requirements for tensile and flexural behavior. For validation, these tensile and flexural test results were then numerically analyzed and compared to the experimental data. Finally, composite design, fabrication, and optimization can improve mechanical properties, reduce composite weight, lower resin cost, and increase sustainability. The proposed design and composition can be implemented to achieve lightweight properties in various applications, such as car components, door handle sheets, bicycle seat backs, and luggage covers.

基于天然纤维的聚合物复合材料是合成材料的生态友好型替代品，具有更高的机械性能、生物可降解性、可用性、易获取性和经济性。黄麻纤维因其强度、耐久性和生物可降解性，被公认为最重要、最有益的天然纤维之一。在这项研究中，我们利用手工铺层技术，设计并制造了一种由 5 层黄麻和环氧树脂组成的黄麻复合材料。研究发现，52.5% 的黄麻和 47.5%的环氧树脂以及较硬的黄麻的优化组合可实现提高拉伸强度和抗弯强度、降低环氧树脂成本以及促进生态友好性和可持续性的目标。拉伸测试在万能试验机上进行，而弯曲测试则采用三点弯曲试验。实验结果表明，用黄麻和环氧树脂增强的复合材料能够达到所需的拉伸强度（42.91 兆帕）和弯曲强度（69.30 兆帕）。为了验证和观察试样，使用 ABAQUS 仿真软件进行了数值分析。数值模拟采用 ASTM D3039 和 ASTM D7264 作为拉伸和弯曲行为的指定要求。然后，对这些拉伸和弯曲测试结果进行数值分析，并与实验数据进行比较，以进行验证。最后，复合材料的设计、制造和优化可以改善机械性能、减轻复合材料重量、降低树脂成本并提高可持续性。所建议的设计和组成可在汽车部件、门把手板、自行车椅背和行李箱盖等各种应用中实现轻质特性。

{"title":"Evaluation of mechanical properties of natural fiber based polymer composite","authors":"Tarikur Jaman Pramanik , Md. Rafiquzzaman , Anup Karmakar , Marzan Hasan Nayeem , S M Kalbin Salim Turjo , Md. Ragib Abid","doi":"10.1016/j.tbench.2024.100183","DOIUrl":"10.1016/j.tbench.2024.100183","url":null,"abstract":"<div><div>Natural fiber based polymer composites are eco-friendly alternatives to synthetic materials, with greater mechanical properties, biodegradability, availability, ease of access, and affordability. Jute fiber is widely recognized as one of the most important and beneficial natural fibers due to its strength, durability, and biodegradability. In this study, the jute composite is designed and fabricated using a 5-layer jute and epoxy resin, utilizing the manual hand lay-up technique. The combination of 52.5 % jute and 47.5 % of epoxy resin and harder is found optimized to achieve the goals of improving the tensile strength and flexural strength, reducing the cost of epoxy resin, and promoting eco-friendliness and sustainability. Tensile testing was performed on a universal testing machine, while flexural testing was done with a three-point bending test. Experimentally, the composites reinforced with jute and epoxy resin were capable of achieving the required levels of tensile strength (42.91 MPa) and bending strength (69.30 MPa). To validate and visualize specimens, numerical analysis was performed on the ABAQUS simulation software. The numerical simulation utilized ASTM D3039 and ASTM D7264 as the specified requirements for tensile and flexural behavior. For validation, these tensile and flexural test results were then numerically analyzed and compared to the experimental data. Finally, composite design, fabrication, and optimization can improve mechanical properties, reduce composite weight, lower resin cost, and increase sustainability. The proposed design and composition can be implemented to achieve lightweight properties in various applications, such as car components, door handle sheets, bicycle seat backs, and luggage covers.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 3","pages":"Article 100183"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142418440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Analyzing the obstacles to the establishment of sustainable supply chain in the textile industry of Bangladesh 分析孟加拉国纺织行业建立可持续供应链的障碍

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100185

Md. Hasibul Hasan Hemal , Farjana Parvin , Alberuni Aziz

Bangladesh's textile sector plays a crucial role in its economy by creating jobs and significantly contributing to export revenue. However, this industry faces challenges, including contaminated water sources and the release of airborne pollutants due to its high-water usage, chemical dyes, and manufacturing processes. Therefore, establishing a sustainable supply chain is essential. This study aims to identify the critical obstacles to establishing a sustainable supply chain. Multi-Criteria Decision Making (MCDM) techniques, such as DEMATEL, help reveal the relationships between different components and determine the relative importance of each in the decision-making model. Meanwhile, Fuzzy TOPSIS proves reliable in situations of uncertainty, allowing for effective ranking of the barriers. The findings indicate that the most pressing barriers include resistance to change and the adoption of innovation, financial constraints or high costs, and a lack of support and commitment from top management. This assessment helps pinpoint crucial obstacles that must be addressed to achieve sustainability in the textile sector. By effectively identifying and eliminating these barriers, this study aims to assist those involved in the industry in their pursuit of a more sustainable future.

孟加拉国的纺织部门通过创造就业机会和为出口收入做出重大贡献，在其经济中发挥着至关重要的作用。然而，这个行业面临着挑战，包括受污染的水源和由于其高用水量、化学染料和制造过程而导致的空气污染物的释放。因此，建立可持续的供应链至关重要。本研究旨在确定建立可持续供应链的关键障碍。多标准决策（MCDM）技术，如DEMATEL，有助于揭示不同组成部分之间的关系，并确定决策模型中每个组成部分的相对重要性。同时，模糊TOPSIS在不确定的情况下证明是可靠的，允许对障碍进行有效的排序。调查结果表明，最紧迫的障碍包括对变革和创新的抵制、财务限制或高成本、以及缺乏高层管理人员的支持和承诺。这一评估有助于查明为实现纺织部门的可持续性必须解决的关键障碍。通过有效地识别和消除这些障碍，本研究旨在帮助那些参与该行业的人追求更可持续的未来。

{"title":"Analyzing the obstacles to the establishment of sustainable supply chain in the textile industry of Bangladesh","authors":"Md. Hasibul Hasan Hemal , Farjana Parvin , Alberuni Aziz","doi":"10.1016/j.tbench.2024.100185","DOIUrl":"10.1016/j.tbench.2024.100185","url":null,"abstract":"<div><div>Bangladesh's textile sector plays a crucial role in its economy by creating jobs and significantly contributing to export revenue. However, this industry faces challenges, including contaminated water sources and the release of airborne pollutants due to its high-water usage, chemical dyes, and manufacturing processes. Therefore, establishing a sustainable supply chain is essential. This study aims to identify the critical obstacles to establishing a sustainable supply chain. Multi-Criteria Decision Making (MCDM) techniques, such as DEMATEL, help reveal the relationships between different components and determine the relative importance of each in the decision-making model. Meanwhile, Fuzzy TOPSIS proves reliable in situations of uncertainty, allowing for effective ranking of the barriers. The findings indicate that the most pressing barriers include resistance to change and the adoption of innovation, financial constraints or high costs, and a lack of support and commitment from top management. This assessment helps pinpoint crucial obstacles that must be addressed to achieve sustainability in the textile sector. By effectively identifying and eliminating these barriers, this study aims to assist those involved in the industry in their pursuit of a more sustainable future.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 3","pages":"Article 100185"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143133060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Corrigendum regarding missing Declaration Conflict-of -Interests statements in previously published articles 关于先前发表的文章中缺少声明利益冲突声明的更正

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100186

引用次数: 0

Five Axioms of Things 事物的五大公理

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100184

Jianfeng Zhan

This article explicitly defines several concepts, such as variables, models, and truth of a thing, that are fundamental to natural and social sciences. I present a generalized methodology for understaning a thing, categorically defining six foundational understanding approaches based on the nature of the thing and diverse perspectives: conjecture, observation, experiment, evaluation, measurement, and testing. I extend my previous work on the five axioms of evaluation to understanding a thing, which I call the five axioms of things. Also, I comment on five paradigms of science.

本文明确定义了自然科学和社会科学的几个基本概念，如变量、模型和事物的真理。我提出了一种理解事物的广义方法，根据事物的本质和不同的观点，分类定义了六种基本的理解方法：猜想、观察、实验、评估、测量和测试。我把我之前关于评价五公理的工作扩展到理解事物，我称之为事物五公理。此外，我还评论了五种科学范式。

引用次数: 0

Could bibliometrics reveal top science and technology achievements and researchers? The case for evaluatology-based science and technology evaluation 文献计量学能否揭示顶尖科技成果和研究人员？基于评价学的科技评价案例

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100182

Guoxin Kang , Wanling Gao , Lei Wang , Chunjie Luo , Hainan Ye , Qian He , Shaopeng Dai , Jianfeng Zhan

By utilizing statistical methods to analyze bibliographic data, bibliometrics faces inherent limitations in identifying the most significant science and technology achievements and researchers. To overcome this challenge, we present an evaluatology-based science and technology evaluation methodology. At the heart of this approach lies the concept of an extended evaluation condition (EC), encompassing nine crucial components derived from a field. We define four relationships that illustrate the connections among various achievements based on their mapped extended EC components, as well as their temporal and citation links. Within a relationship under an extended EC, evaluators can effectively compare these achievements by carefully addressing the influence of confounding variables. We establish a real-world evaluation system encompassing an entire collection of achievements, each of which is mapped to several components of an extended EC. Within a specific field like chip technology or open source, we construct a perfect evaluation model that can accurately trace the evolution and development of all achievements in terms of four relationships based on the real-world evaluation system. Building upon the foundation of the perfect evaluation model, we put forth four-round rules to eliminate non-significant achievements by utilizing four relationships. This process allows us to establish a pragmatic evaluation model that effectively captures the essential achievements, serving as a curated collection of the top N achievements within a specific field during a specific timeframe. We present a case study on the top 100 Chip achievements to demonstrate the effectiveness of our science and technology evaluatology. The case study highlights its practical application and efficacy in identifying significant achievements and researchers that otherwise cannot be identified by using bibliometrics.

通过利用统计方法分析书目数据，文献计量学在确定最重要的科技成果和研究人员方面面临固有的局限性。为了克服这一挑战，我们提出了一种基于评价学的科技评价方法。这种方法的核心是扩展评价条件（EC）的概念，包括从一个领域衍生出来的九个关键要素。我们定义了四种关系，根据其映射的扩展 EC 要素及其时间和引文联系来说明各种成果之间的联系。在扩展 EC 下的关系中，评估人员可以通过仔细处理混杂变量的影响，有效地比较这些成就。我们建立了一个真实世界的评估系统，其中包含一整套成就，每项成就都映射到扩展 EC 的若干组成部分。在芯片技术或开源技术等特定领域内，我们构建了一个完美的评价模型，该模型可以在真实世界评价体系的基础上，根据四种关系准确追踪所有成果的演变和发展。在完美评价模型的基础上，我们提出了四轮规则，利用四种关系剔除不重要的成果。通过这一过程，我们建立了一个务实的评价模型，有效地捕捉到了基本成就，成为特定时间段内特定领域内 N 项顶级成就的精选集。我们介绍了一个关于前 100 项芯片成就的案例研究，以展示我们的科技评估方法的有效性。该案例研究强调了其在识别重要成果和研究人员方面的实际应用和功效，而这些成果和研究人员是无法通过文献计量学识别的。

{"title":"Could bibliometrics reveal top science and technology achievements and researchers? The case for evaluatology-based science and technology evaluation","authors":"Guoxin Kang , Wanling Gao , Lei Wang , Chunjie Luo , Hainan Ye , Qian He , Shaopeng Dai , Jianfeng Zhan","doi":"10.1016/j.tbench.2024.100182","DOIUrl":"10.1016/j.tbench.2024.100182","url":null,"abstract":"<div><div>By utilizing statistical methods to analyze bibliographic data, bibliometrics faces inherent limitations in identifying the most significant science and technology achievements and researchers. To overcome this challenge, we present an evaluatology-based science and technology evaluation methodology. At the heart of this approach lies the concept of an extended evaluation condition (EC), encompassing nine crucial components derived from a field. We define four relationships that illustrate the connections among various achievements based on their mapped extended EC components, as well as their temporal and citation links. Within a relationship under an extended EC, evaluators can effectively compare these achievements by carefully addressing the influence of confounding variables. We establish a real-world evaluation system encompassing an entire collection of achievements, each of which is mapped to several components of an extended EC. Within a specific field like chip technology or open source, we construct a perfect evaluation model that can accurately trace the evolution and development of all achievements in terms of four relationships based on the real-world evaluation system. Building upon the foundation of the perfect evaluation model, we put forth four-round rules to eliminate non-significant achievements by utilizing four relationships. This process allows us to establish a pragmatic evaluation model that effectively captures the essential achievements, serving as a curated collection of the top N achievements within a specific field during a specific timeframe. We present a case study on the top 100 Chip achievements to demonstrate the effectiveness of our science and technology evaluatology. The case study highlights its practical application and efficacy in identifying significant achievements and researchers that otherwise cannot be identified by using bibliometrics.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 3","pages":"Article 100182"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142662450","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring the Orca Predation Algorithm for Economic Dispatch Optimization in Power Systems 电力系统经济调度优化中的逆戟鲸捕食算法研究

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2024.100187

Vivi Aida Fitria , Arif Nur Afandi , Aripriharta

The Economic Dispatch problem is essential for minimizing generation costs while satisfying power demand in electrical systems. This research looks into the Orca Predation Algorithm, an optimization method based on biology that can solve the Economic Dispatch problem for systems with 6, 13, or 15 producing units. The idea behind Orca Predation Algorithm came from the way orcas hunt for food. It solves problems that other optimization methods and bio-inspired algorithms have, like too much population diversity and too early convergence. This research shows that Orca Predation Algorithm consistently does better than other bio-inspired algorithms like Particle Swarm Optimization, Whale Optimization Algorithm, Grey Wolf Optimizer, the Bat Algorithm, Genetic Algorithm and Ant Colony Optimization in terms of minimum cost, average cost, and solution stability. The sensitivity analysis of the parameters regulating the exploration-exploitation balance in Orca Predation Algorithm demonstrated substantial performance enhancements. By changing these parameters, the best prices came in at $15,275.93 for the 6-unit system, $17,932.49 for the 13-unit system, and $32,256.97 for the 15-unit system. These prices are lower than those in the previous parameter setting. Although Orca Predation Algorithm demonstrates greater performance, it necessitates extended computing time, which future research could mitigate by exploring parallelization or hybrid methodologies. This paper shows that Orca Predation Algorithm is a reliable tool for optimizing Economic Dispatch problems. It gives useful information to power system engineers who are looking for effective and scalable optimization methods for modern power systems.

经济调度问题是电力系统在满足电力需求的同时实现发电成本最小化的关键问题。本研究着眼于Orca捕食算法，这是一种基于生物学的优化方法，可以解决具有6、13或15个生产单元的系统的经济调度问题。逆戟鲸捕食算法背后的想法来自逆戟鲸寻找食物的方式。它解决了其他优化方法和生物启发算法存在的问题，如人口多样性过多和过早收敛。研究表明，在最小成本、平均成本和解的稳定性方面，Orca捕食算法始终优于粒子群算法、鲸鱼优化算法、灰狼优化器、蝙蝠算法、遗传算法和蚁群优化等生物类算法。通过对虎鲸捕食算法中调节探索-利用平衡参数的敏感性分析，表明该算法的性能得到了显著提高。通过改变这些参数，6单元系统的最佳价格为15,275.93美元，13单元系统的最佳价格为17,932.49美元，15单元系统的最佳价格为32,256.97美元。这些价格低于之前的参数设置。尽管Orca捕食算法表现出更高的性能，但它需要延长计算时间，未来的研究可以通过探索并行化或混合方法来缓解这一问题。研究表明，逆戟鲸捕食算法是优化经济调度问题的可靠工具。它提供了有用的信息，电力系统工程师谁正在寻找有效的和可扩展的优化方法，为现代电力系统。

{"title":"Exploring the Orca Predation Algorithm for Economic Dispatch Optimization in Power Systems","authors":"Vivi Aida Fitria , Arif Nur Afandi , Aripriharta","doi":"10.1016/j.tbench.2024.100187","DOIUrl":"10.1016/j.tbench.2024.100187","url":null,"abstract":"<div><div>The Economic Dispatch problem is essential for minimizing generation costs while satisfying power demand in electrical systems. This research looks into the Orca Predation Algorithm, an optimization method based on biology that can solve the Economic Dispatch problem for systems with 6, 13, or 15 producing units. The idea behind Orca Predation Algorithm came from the way orcas hunt for food. It solves problems that other optimization methods and bio-inspired algorithms have, like too much population diversity and too early convergence. This research shows that Orca Predation Algorithm consistently does better than other bio-inspired algorithms like Particle Swarm Optimization, Whale Optimization Algorithm, Grey Wolf Optimizer, the Bat Algorithm, Genetic Algorithm and Ant Colony Optimization in terms of minimum cost, average cost, and solution stability. The sensitivity analysis of the parameters regulating the exploration-exploitation balance in Orca Predation Algorithm demonstrated substantial performance enhancements. By changing these parameters, the best prices came in at $15,275.93 for the 6-unit system, $17,932.49 for the 13-unit system, and $32,256.97 for the 15-unit system. These prices are lower than those in the previous parameter setting. Although Orca Predation Algorithm demonstrates greater performance, it necessitates extended computing time, which future research could mitigate by exploring parallelization or hybrid methodologies. This paper shows that Orca Predation Algorithm is a reliable tool for optimizing Economic Dispatch problems. It gives useful information to power system engineers who are looking for effective and scalable optimization methods for modern power systems.</div></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 3","pages":"Article 100187"},"PeriodicalIF":0.0,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143133057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Fundamental concepts and methodologies in evaluatology 评价学的基本概念和方法

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-09-01 DOI: 10.1016/j.tbench.2025.100188

Jianfeng Zhan

While I have authored three articles introducing Evaluatology, a novel discipline that encompasses the science and engineering of evaluation across various domains, I have struggled to fully depict this challenging yet promising field.

This article delves into the fundamental concepts and methodologies within Evaluatology. I aim to provide a complete picture of evaluation problems in Evaluatology based on my proposed fundamental methodology of understanding a thing. In diverse engineering fields, testbeds, experimental platforms, or simulation environments are commonly utilized to evaluate design or implementation decisions. However, a rigorous methodology is often lacking. I propose a rigorous methodology rooted in Evaluatology for testbeds, experimental platforms, or simulation environments.

虽然我已经撰写了三篇介绍评估学的文章，这是一门新学科，涵盖了各种领域的评估科学和工程，但我一直在努力全面描述这个具有挑战性但有前途的领域。本文深入探讨了评估学中的基本概念和方法。我的目标是根据我提出的理解事物的基本方法论，提供评估学中评估问题的完整图景。在不同的工程领域，测试平台、实验平台或模拟环境通常用于评估设计或实现决策。然而，通常缺乏严格的方法。我提出了一种严格的方法论，它植根于测试平台、实验平台或模拟环境的评估学。

引用次数: 0

Enhanced deep learning based decision support system for kidney tumour detection 基于深度学习的肾脏肿瘤检测增强型决策支持系统

BenchCouncil Transactions on Benchmarks, Standards and Evaluations

Pub Date : 2024-06-01 DOI: 10.1016/j.tbench.2024.100174

Taha ETEM , Mustafa TEKE

This study presents a high-accuracy deep learning-based decision support system for kidney cancer detection. The research utilizes a relatively large dataset of 10,000 CT images, including both healthy and tumour-detected kidney scans. After data preprocessing and optimization, various deep learning models were evaluated, with DenseNet-201 emerging as the top performer, achieving an accuracy of 99.75 %. The study compares multiple deep learning architectures, including AlexNet, EfficientNet, Darknet-53, Xception, and DenseNet-201, across different learning rates. Performance metrics such as accuracy, precision, sensitivity, F1-score, and specificity are analysed using confusion matrices. The proposed system outperforms different deep learning networks, demonstrating superior accuracy in kidney cancer detection. The improvement is attributed to effective data engineering and hyperparameter optimization of the deep learning networks. This research contributes to the field of medical image analysis by providing a robust decision support tool for early and rapid diagnosis of kidney cancer. The high accuracy and efficiency of the proposed system make it a promising aid for healthcare professionals in clinical settings.

本研究提出了一种基于深度学习的高精度肾癌检测决策支持系统。研究利用了一个包含 10,000 张 CT 图像的相对较大的数据集，其中包括健康肾脏扫描图像和检测到肿瘤的肾脏扫描图像。经过数据预处理和优化后，对各种深度学习模型进行了评估，其中 DenseNet-201 表现最佳，准确率达到 99.75%。该研究比较了不同学习率下的多种深度学习架构，包括 AlexNet、EfficientNet、Darknet-53、Xception 和 DenseNet-201。使用混淆矩阵分析了准确度、精确度、灵敏度、F1-分数和特异性等性能指标。所提出的系统优于不同的深度学习网络，在肾癌检测方面表现出更高的准确性。这一改进归功于有效的数据工程和深度学习网络的超参数优化。这项研究为肾癌的早期快速诊断提供了强大的决策支持工具，从而为医学图像分析领域做出了贡献。所提议系统的高准确性和高效率使其成为临床环境中医护人员的理想助手。

{"title":"Enhanced deep learning based decision support system for kidney tumour detection","authors":"Taha ETEM , Mustafa TEKE","doi":"10.1016/j.tbench.2024.100174","DOIUrl":"10.1016/j.tbench.2024.100174","url":null,"abstract":"<div><p>This study presents a high-accuracy deep learning-based decision support system for kidney cancer detection. The research utilizes a relatively large dataset of 10,000 CT images, including both healthy and tumour-detected kidney scans. After data preprocessing and optimization, various deep learning models were evaluated, with DenseNet-201 emerging as the top performer, achieving an accuracy of 99.75 %. The study compares multiple deep learning architectures, including AlexNet, EfficientNet, Darknet-53, Xception, and DenseNet-201, across different learning rates. Performance metrics such as accuracy, precision, sensitivity, F1-score, and specificity are analysed using confusion matrices. The proposed system outperforms different deep learning networks, demonstrating superior accuracy in kidney cancer detection. The improvement is attributed to effective data engineering and hyperparameter optimization of the deep learning networks. This research contributes to the field of medical image analysis by providing a robust decision support tool for early and rapid diagnosis of kidney cancer. The high accuracy and efficiency of the proposed system make it a promising aid for healthcare professionals in clinical settings.</p></div>","PeriodicalId":100155,"journal":{"name":"BenchCouncil Transactions on Benchmarks, Standards and Evaluations","volume":"4 2","pages":"Article 100174"},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772485924000267/pdfft?md5=1e6e92b87d485e865811a8bedeb30bc4&pid=1-s2.0-S2772485924000267-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142232454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0