首页 > 最新文献

Knowledge and Information Systems最新文献

英文 中文
An aviation accidents prediction method based on MTCNN and Bayesian optimization 基于 MTCNN 和贝叶斯优化的航空事故预测方法
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-26 DOI: 10.1007/s10115-024-02168-6
Minglan Xiong, Zhaoguo Hou, Huawei Wang, Changchang Che, Rui Luo

The safety of the civil aviation system has been of increasing concern with several accidents in recent years. It is urgent to put forward a precise accident prediction model, which can systematically analyze safety from the perspective of accident mechanism to enhance training accuracy. Furthermore, the predictive model is critical for stakeholders to identify risk and implement the proactive safety paradigm. In this work, to mitigate casualties and economic losses arising from aviation accidents and improve system safety, the focus is on predicting the aircraft damage severity, the injury/death severity, and the flight phases in the sequence of identifying event risk sources. This work establishes a multi-task deep convolutional neural network (MTCNN) learning framework to accomplish this goal. An innovative prediction rule will be developed to refine prediction results from two approaches: handling imbalanced classes and Bayesian optimization. By comparing the performance of the proposed multi-task model with other single-task machine learning models with ten-fold cross-validation and statistical testing, the effectiveness of the developed model in predicting aviation accident severity and flight phase is demonstrated.

近年来,随着多起事故的发生,民航系统的安全问题日益受到关注。提出精确的事故预测模型,从事故机理的角度系统地分析安全问题,提高培训的准确性,已迫在眉睫。此外,预测模型对于利益相关者识别风险和实施主动安全范式也至关重要。在这项工作中,为了减少航空事故造成的人员伤亡和经济损失,提高系统安全性,重点是预测飞机损坏严重程度、人员伤亡严重程度,以及按事件风险源识别顺序预测飞行阶段。为实现这一目标,本研究建立了多任务深度卷积神经网络(MTCNN)学习框架。将开发一种创新的预测规则,以完善两种方法的预测结果:处理不平衡类和贝叶斯优化。通过十倍交叉验证和统计测试,比较所提出的多任务模型与其他单任务机器学习模型的性能,证明了所开发模型在预测航空事故严重程度和飞行阶段方面的有效性。
{"title":"An aviation accidents prediction method based on MTCNN and Bayesian optimization","authors":"Minglan Xiong, Zhaoguo Hou, Huawei Wang, Changchang Che, Rui Luo","doi":"10.1007/s10115-024-02168-6","DOIUrl":"https://doi.org/10.1007/s10115-024-02168-6","url":null,"abstract":"<p>The safety of the civil aviation system has been of increasing concern with several accidents in recent years. It is urgent to put forward a precise accident prediction model, which can systematically analyze safety from the perspective of accident mechanism to enhance training accuracy. Furthermore, the predictive model is critical for stakeholders to identify risk and implement the proactive safety paradigm. In this work, to mitigate casualties and economic losses arising from aviation accidents and improve system safety, the focus is on predicting the aircraft damage severity, the injury/death severity, and the flight phases in the sequence of identifying event risk sources. This work establishes a multi-task deep convolutional neural network (MTCNN) learning framework to accomplish this goal. An innovative prediction rule will be developed to refine prediction results from two approaches: handling imbalanced classes and Bayesian optimization. By comparing the performance of the proposed multi-task model with other single-task machine learning models with ten-fold cross-validation and statistical testing, the effectiveness of the developed model in predicting aviation accident severity and flight phase is demonstrated.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"10 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep reinforcement learning-based scheduling in distributed systems: a critical review 基于深度强化学习的分布式系统调度:重要综述
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-26 DOI: 10.1007/s10115-024-02167-7
Zahra Jalali Khalil Abadi, Najme Mansouri, Mohammad Masoud Javidi

Many fields of research use parallelized and distributed computing environments, including astronomy, earth science, and bioinformatics. Due to an increase in client requests, service providers face various challenges, such as task scheduling, security, resource management, and virtual machine migration. NP-hard scheduling problems require a long time to implement an optimal or suboptimal solution due to their large solution space. With recent advances in artificial intelligence, deep reinforcement learning (DRL) can be used to solve scheduling problems. The DRL approach combines the strength of deep learning and neural networks with reinforcement learning’s feedback-based learning. This paper provides a comprehensive overview of DRL-based scheduling algorithms in distributed systems by categorizing algorithms and applications. As a result, several articles are assessed based on their main objectives, quality of service and scheduling parameters, as well as evaluation environments (i.e., simulation tools, real-world environment). The literature review indicates that algorithms based on RL, such as Q-learning, are effective for learning scaling and scheduling policies in a cloud environment. Additionally, the challenges and directions for further research on deep reinforcement learning to address scheduling problems were summarized (e.g., edge intelligence, ideal dynamic task scheduling framework, human–machine interaction, resource-hungry artificial intelligence (AI) and sustainability).

许多研究领域都使用并行化和分布式计算环境,包括天文学、地球科学和生物信息学。由于客户请求的增加,服务提供商面临着任务调度、安全性、资源管理和虚拟机迁移等各种挑战。由于 NP 难调度问题的求解空间很大,因此需要很长时间才能找到最优或次优解。随着人工智能领域的最新进展,深度强化学习(DRL)可用于解决调度问题。DRL 方法将深度学习和神经网络的优势与强化学习的反馈学习相结合。本文通过对算法和应用进行分类,全面概述了分布式系统中基于 DRL 的调度算法。因此,本文根据其主要目标、服务质量和调度参数以及评估环境(即仿真工具、真实世界环境)对多篇文章进行了评估。文献综述表明,基于 RL 的算法(如 Q-learning)可有效学习云环境中的扩展和调度策略。此外,还总结了深度强化学习在解决调度问题方面面临的挑战和进一步研究的方向(如边缘智能、理想的动态任务调度框架、人机交互、资源饥渴型人工智能(AI)和可持续性)。
{"title":"Deep reinforcement learning-based scheduling in distributed systems: a critical review","authors":"Zahra Jalali Khalil Abadi, Najme Mansouri, Mohammad Masoud Javidi","doi":"10.1007/s10115-024-02167-7","DOIUrl":"https://doi.org/10.1007/s10115-024-02167-7","url":null,"abstract":"<p>Many fields of research use parallelized and distributed computing environments, including astronomy, earth science, and bioinformatics. Due to an increase in client requests, service providers face various challenges, such as task scheduling, security, resource management, and virtual machine migration. NP-hard scheduling problems require a long time to implement an optimal or suboptimal solution due to their large solution space. With recent advances in artificial intelligence, deep reinforcement learning (DRL) can be used to solve scheduling problems. The DRL approach combines the strength of deep learning and neural networks with reinforcement learning’s feedback-based learning. This paper provides a comprehensive overview of DRL-based scheduling algorithms in distributed systems by categorizing algorithms and applications. As a result, several articles are assessed based on their main objectives, quality of service and scheduling parameters, as well as evaluation environments (i.e., simulation tools, real-world environment). The literature review indicates that algorithms based on RL, such as Q-learning, are effective for learning scaling and scheduling policies in a cloud environment. Additionally, the challenges and directions for further research on deep reinforcement learning to address scheduling problems were summarized (e.g., edge intelligence, ideal dynamic task scheduling framework, human–machine interaction, resource-hungry artificial intelligence (AI) and sustainability).</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"39 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510290","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UCAD: commUnity disCovery method in Attribute-based multicoloreD networks UCAD:基于属性的多核网络中的通信一致性发现方法
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-19 DOI: 10.1007/s10115-024-02163-x
Félicité Gamgne Domgue, Norbert Tsopze, René Ndoundam

Many hierarchical methods for community detection in multicolored networks are capable of finding clusters when there are interslice correlation between layers. However, in general, they aggregate all the links in different layer treating them as being equivalent. Therefore, such aggregation might ignore the information about the relevance of a dimension in which the node is involved. In this paper, we fill this gap by proposing a hierarchical classification-based Louvain method for interslice-multicolored networks. In particular, we define a new node centrality measure named Attractivity to describe the inter-slice correlation that incorporates within and across-dimension topological features in order to identify the relevant dimension. Then, after merging dimensions through a frequential aggregation, we group nodes by their relational and attribute similarity, where attributes correspond to their relevant dimensions. We conduct an extensive experimentation using seven real-world multicolored networks, which also includes comparison with state-of-the-art methods. Results show the significance of our proposed method in discovering relevant communities over multiple dimensions and highlight its ability in producing optimal covers with higher values of the multidimensional version of the modularity function.

许多用于多色网络中群落检测的分层方法都能在层与层之间存在相关性时找到群落。但是,一般情况下,这些方法会将不同层中的所有链接聚合在一起,将其视为等价链接。因此,这种聚合可能会忽略节点所在维度的相关性信息。在本文中,我们针对互译-多色网络提出了一种基于分层分类的卢万方法,从而填补了这一空白。具体而言,我们定义了一种名为 "吸引力"(Attractivity)的新节点中心性度量来描述切片间的相关性,该度量结合了维内和跨维拓扑特征,以识别相关维度。然后,在通过频率聚合合并维度后,我们根据节点的关系和属性相似性对节点进行分组,其中属性对应于相关维度。我们使用七个真实世界的多色网络进行了广泛的实验,其中还包括与最先进方法的比较。实验结果表明,我们提出的方法在发现多个维度上的相关社区方面具有重要意义,并突出了该方法在产生具有更高模块化函数多维版本值的最佳覆盖方面的能力。
{"title":"UCAD: commUnity disCovery method in Attribute-based multicoloreD networks","authors":"Félicité Gamgne Domgue, Norbert Tsopze, René Ndoundam","doi":"10.1007/s10115-024-02163-x","DOIUrl":"https://doi.org/10.1007/s10115-024-02163-x","url":null,"abstract":"<p>Many hierarchical methods for community detection in multicolored networks are capable of finding clusters when there are interslice correlation between layers. However, in general, they aggregate all the links in different layer treating them as being equivalent. Therefore, such aggregation might ignore the information about the relevance of a dimension in which the node is involved. In this paper, we fill this gap by proposing a hierarchical classification-based Louvain method for interslice-multicolored networks. In particular, we define a new node centrality measure named <i>Attractivity</i> to describe the inter-slice correlation that incorporates within and across-dimension topological features in order to identify the relevant dimension. Then, after merging dimensions through a frequential aggregation, we group nodes by their relational and attribute similarity, where attributes correspond to their relevant dimensions. We conduct an extensive experimentation using seven real-world multicolored networks, which also includes comparison with state-of-the-art methods. Results show the significance of our proposed method in discovering relevant communities over multiple dimensions and highlight its ability in producing optimal covers with higher values of the multidimensional version of the modularity function.\u0000</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"48 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Situational Data Integration in Question Answering systems: a survey over two decades 问题解答系统中的情景数据整合:二十年来的调查
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-18 DOI: 10.1007/s10115-024-02136-0
Maria Helena Franciscatto, Luis Carlos Erpen de Bona, Celio Trois, Marcos Didonet Del FabroFabro, João Carlos Damasceno Lima

Question Answering (QA) systems provide accurate answers to questions; however, they lack the ability to consolidate data from multiple sources, making it difficult to manage complex questions that could be answered with additional data retrieved and integrated on the fly. This integration is inherent to Situational Data Integration (SDI) approaches that deal with dynamic requirements of ad hoc queries that neither traditional database management systems, nor search engines are effective in providing an answer. Thus, if QA systems include SDI characteristics, they could be able to return validated and immediate information for supporting users decisions. For this reason, we surveyed QA-based systems, assessing their capabilities to support SDI features, i.e., Ad hoc Data Retrieval, Data Management, and Timely Decision Support. We also identified patterns concerning these features in the surveyed studies, highlighting them in a timeline that shows the SDI evolution in the QA domain. To the best of your knowledge, this study is precursor in the joint analysis of SDI and QA, showing a combination that can favor the way systems support users. Our analyses show that most of SDI features are rarely addressed in QA systems, and based on that, we discuss directions for further research.

问题解答(QA)系统可以为问题提供准确的答案,但它们缺乏整合来自多个来源的数据的能力,因此难以管理复杂的问题,而这些问题可以通过即时检索和整合额外的数据来回答。这种整合是情境数据整合(SDI)方法所固有的,它可以处理临时查询的动态需求,而传统的数据库管理系统或搜索引擎都无法有效地提供答案。因此,如果质量保证系统包含 SDI 特性,就能返回经过验证的即时信息,为用户决策提供支持。为此,我们对基于质量保证的系统进行了调查,评估它们支持 SDI 特性的能力,即临时数据检索、数据管理和及时决策支持。我们还在调查研究中找出了与这些功能相关的模式,并在显示质量保证领域 SDI 演进的时间轴中突出了这些模式。据我们所知,这项研究是对 SDI 和质量保证进行联合分析的先驱,显示出两者的结合有利于系统为用户提供支持。我们的分析表明,大多数 SDI 功能在质量保证系统中很少涉及,在此基础上,我们讨论了进一步研究的方向。
{"title":"Situational Data Integration in Question Answering systems: a survey over two decades","authors":"Maria Helena Franciscatto, Luis Carlos Erpen de Bona, Celio Trois, Marcos Didonet Del FabroFabro, João Carlos Damasceno Lima","doi":"10.1007/s10115-024-02136-0","DOIUrl":"https://doi.org/10.1007/s10115-024-02136-0","url":null,"abstract":"<p>Question Answering (QA) systems provide accurate answers to questions; however, they lack the ability to consolidate data from multiple sources, making it difficult to manage complex questions that could be answered with additional data retrieved and integrated on the fly. This integration is inherent to Situational Data Integration (SDI) approaches that deal with dynamic requirements of ad hoc queries that neither traditional database management systems, nor search engines are effective in providing an answer. Thus, if QA systems include SDI characteristics, they could be able to return validated and immediate information for supporting users decisions. For this reason, we surveyed QA-based systems, assessing their capabilities to support SDI features, i.e., <i>Ad hoc Data Retrieval, Data Management,</i> and <i>Timely Decision Support</i>. We also identified patterns concerning these features in the surveyed studies, highlighting them in a timeline that shows the SDI evolution in the QA domain. To the best of your knowledge, this study is precursor in the joint analysis of SDI and QA, showing a combination that can favor the way systems support users. Our analyses show that most of SDI features are rarely addressed in QA systems, and based on that, we discuss directions for further research.\u0000</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"175 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A hybrid storage blockchain-based query efficiency enhancement method for business environment evaluation 基于混合存储区块链的商业环境评估查询效率提升方法
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-17 DOI: 10.1007/s10115-024-02144-0
Su Li, Junlu Wang, Wanting Ji, Ze Chen, Baoyan Song

A favorable business environment plays a crucial role in facilitating the high-quality development of a modern economy. In order to enhance the credibility and efficiency of business environment evaluation, this paper proposes a hybrid storage blockchain-based query efficiency enhancement method for business environment evaluation. Currently, most blockchain systems store block data in key-value databases or file systems with simple semantic descriptions. However, such systems have a single query interface, limited supported query types, and high storage overhead, which leads to low performance. To tackle these challenges, this paper proposes a query efficiency enhancement method based on hybrid storage blockchain. Firstly, data are stored in a hybrid data storage architecture combining on-chain and off-chain. Additionally, relational semantics are added to block data, and three index mechanisms are designed to expedite data access. Subsequently, corresponding query efficiency enhancement algorithms are designed based on the query types that are applicable to the aforementioned three index mechanisms, further refining the query processing. Finally, a comprehensive authentication query is implemented on the blockchain for the light client, and the user can verify the soundness and integrity of the query results. Experimental results on three open datasets show that the method proposed in this paper significantly reduces storage overhead, has shorter query latency for three different query types, and improves retrieval performance and verification efficiency.

良好的营商环境对推动现代经济高质量发展起着至关重要的作用。为提升营商环境评价的公信力和效率,本文提出了一种基于混合存储区块链的营商环境评价查询效率提升方法。目前,大多数区块链系统将区块数据存储在键值数据库或文件系统中,语义描述简单。然而,这类系统的查询接口单一,支持的查询类型有限,存储开销大,导致性能低下。针对这些挑战,本文提出了一种基于混合存储区块链的查询效率提升方法。首先,数据存储在链上和链下相结合的混合数据存储架构中。此外,还为区块数据添加了关系语义,并设计了三种索引机制来加快数据访问速度。随后,根据适用于上述三种索引机制的查询类型,设计了相应的查询效率增强算法,进一步完善了查询处理。最后,在区块链上为轻客户端实现了综合认证查询,用户可以验证查询结果的合理性和完整性。在三个开放数据集上的实验结果表明,本文提出的方法显著降低了存储开销,缩短了三种不同查询类型的查询延迟,提高了检索性能和验证效率。
{"title":"A hybrid storage blockchain-based query efficiency enhancement method for business environment evaluation","authors":"Su Li, Junlu Wang, Wanting Ji, Ze Chen, Baoyan Song","doi":"10.1007/s10115-024-02144-0","DOIUrl":"https://doi.org/10.1007/s10115-024-02144-0","url":null,"abstract":"<p>A favorable business environment plays a crucial role in facilitating the high-quality development of a modern economy. In order to enhance the credibility and efficiency of business environment evaluation, this paper proposes a hybrid storage blockchain-based query efficiency enhancement method for business environment evaluation. Currently, most blockchain systems store block data in key-value databases or file systems with simple semantic descriptions. However, such systems have a single query interface, limited supported query types, and high storage overhead, which leads to low performance. To tackle these challenges, this paper proposes a query efficiency enhancement method based on hybrid storage blockchain. Firstly, data are stored in a hybrid data storage architecture combining on-chain and off-chain. Additionally, relational semantics are added to block data, and three index mechanisms are designed to expedite data access. Subsequently, corresponding query efficiency enhancement algorithms are designed based on the query types that are applicable to the aforementioned three index mechanisms, further refining the query processing. Finally, a comprehensive authentication query is implemented on the blockchain for the light client, and the user can verify the soundness and integrity of the query results. Experimental results on three open datasets show that the method proposed in this paper significantly reduces storage overhead, has shorter query latency for three different query types, and improves retrieval performance and verification efficiency.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"26 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Semantic similarity-aware feature selection and redundancy removal for text classification using joint mutual information 利用联合互信息为文本分类选择语义相似性感知特征并去除冗余
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-13 DOI: 10.1007/s10115-024-02143-1
Farek Lazhar, Benaidja Amira

The high dimensionality of text data is a challenging issue that requires efficient methods to reduce vector space and improve classification accuracy. Existing filter-based methods fail to address the redundancy issue, resulting in the selection of irrelevant and redundant features. Information theory-based methods effectively solve this problem but are not practical for large amounts of data due to their high time complexity. The proposed method, termed semantic similarity-aware feature selection and redundancy removal (SS-FSRR), employs joint mutual information between the pairs of semantically related terms and the class label to capture redundant features. It is predicated on the assumption that semantically related terms imply potentially redundant ones, which can significantly reduce execution time by avoiding sequential search strategies. In this work, we use Word2Vec’s CBOW model to obtain semantic similarity between terms. The efficiency of the SS-FSRR is compared to six state-of-the-art competitive selection methods for categorical data using two traditional classifiers (SVM and NB) and a robust deep learning model (LSTM) on seven datasets with 10-fold cross-validation, where experimental results show that the SS-FSRR outperforms the other methods on most tested datasets with high stability as measured by the Jaccard’s Index.

文本数据的高维性是一个具有挑战性的问题,需要高效的方法来减少向量空间并提高分类精度。现有的基于滤波器的方法无法解决冗余问题,导致选择不相关的冗余特征。基于信息论的方法能有效解决这一问题,但由于时间复杂度高,对于海量数据来说并不实用。所提出的方法被称为语义相似性感知特征选择和冗余去除(SS-FSRR),它利用语义相关术语对和类别标签之间的联合互信息来捕捉冗余特征。它的前提假设是,语义相关的术语意味着潜在的冗余术语,这就避免了顺序搜索策略,从而大大缩短了执行时间。在这项工作中,我们使用 Word2Vec 的 CBOW 模型来获取术语之间的语义相似性。实验结果表明,在大多数测试数据集上,SS-FSRR 的性能都优于其他方法,而且以 Jaccard 指数衡量,SS-FSRR 具有很高的稳定性。
{"title":"Semantic similarity-aware feature selection and redundancy removal for text classification using joint mutual information","authors":"Farek Lazhar, Benaidja Amira","doi":"10.1007/s10115-024-02143-1","DOIUrl":"https://doi.org/10.1007/s10115-024-02143-1","url":null,"abstract":"<p>The high dimensionality of text data is a challenging issue that requires efficient methods to reduce vector space and improve classification accuracy. Existing filter-based methods fail to address the redundancy issue, resulting in the selection of irrelevant and redundant features. Information theory-based methods effectively solve this problem but are not practical for large amounts of data due to their high time complexity. The proposed method, termed semantic similarity-aware feature selection and redundancy removal (SS-FSRR), employs joint mutual information between the pairs of semantically related terms and the class label to capture redundant features. It is predicated on the assumption that semantically related terms imply potentially redundant ones, which can significantly reduce execution time by avoiding sequential search strategies. In this work, we use Word2Vec’s CBOW model to obtain semantic similarity between terms. The efficiency of the SS-FSRR is compared to six state-of-the-art competitive selection methods for categorical data using two traditional classifiers (SVM and NB) and a robust deep learning model (LSTM) on seven datasets with 10-fold cross-validation, where experimental results show that the SS-FSRR outperforms the other methods on most tested datasets with high stability as measured by the Jaccard’s Index.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"48 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141510379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning and deep learning models for human activity recognition in security and surveillance: a review 用于安防和监控领域人类活动识别的机器学习和深度学习模型:综述
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-04 DOI: 10.1007/s10115-024-02122-6
Sheetal Waghchaware, Radhika Joshi

Human activity recognition (HAR) has received the significant attention in the field of security and surveillance due to its high potential for real-time monitoring, identifying the abnormal activities and situational awareness. HAR is able to identify the abnormal activity or behaviour patterns, which may indicate potential security risks. HAR system attempts to automatically provide the information and classification regarding activities performed in the environment by learning the data captured through sensor or video stream. The overview of existing research work in the security and surveillance area, which includes traditional, machine learning (ML) and deep learning (DL) algorithms applicable to field, is presented. The comparative analysis of different HAR techniques based on features, input source, public data sets is presented for quick understanding, and it focuses on the recent trends in HAR field. This review paper provides guidelines for the selection of appropriate algorithm, data set, performance metrics when evaluating HAR systems in the context of security and surveillance. Overall, this review aims to provide a comprehensive understanding of HAR in the field of security and surveillance and to serve as a basis for further research and development.

人类活动识别(HAR)因其在实时监控、识别异常活动和态势感知方面的巨大潜力,在安全和监控领域备受关注。HAR 能够识别异常活动或行为模式,这可能预示着潜在的安全风险。HAR 系统试图通过学习传感器或视频流捕获的数据,自动提供有关环境中活动的信息和分类。本文概述了安防和监控领域的现有研究工作,包括适用于该领域的传统算法、机器学习(ML)算法和深度学习(DL)算法。为了便于快速理解,本文对基于特征、输入源和公共数据集的不同 HAR 技术进行了比较分析,并重点介绍了 HAR 领域的最新趋势。本综述论文为在安防和监控背景下评估 HAR 系统时选择合适的算法、数据集和性能指标提供了指导。总之,本综述旨在提供对安防和监控领域 HAR 的全面了解,并为进一步研究和开发奠定基础。
{"title":"Machine learning and deep learning models for human activity recognition in security and surveillance: a review","authors":"Sheetal Waghchaware, Radhika Joshi","doi":"10.1007/s10115-024-02122-6","DOIUrl":"https://doi.org/10.1007/s10115-024-02122-6","url":null,"abstract":"<p>Human activity recognition (HAR) has received the significant attention in the field of security and surveillance due to its high potential for real-time monitoring, identifying the abnormal activities and situational awareness. HAR is able to identify the abnormal activity or behaviour patterns, which may indicate potential security risks. HAR system attempts to automatically provide the information and classification regarding activities performed in the environment by learning the data captured through sensor or video stream. The overview of existing research work in the security and surveillance area, which includes traditional, machine learning (ML) and deep learning (DL) algorithms applicable to field, is presented. The comparative analysis of different HAR techniques based on features, input source, public data sets is presented for quick understanding, and it focuses on the recent trends in HAR field. This review paper provides guidelines for the selection of appropriate algorithm, data set, performance metrics when evaluating HAR systems in the context of security and surveillance. Overall, this review aims to provide a comprehensive understanding of HAR in the field of security and surveillance and to serve as a basis for further research and development.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"106 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141254266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automating localized learning for cardinality estimation based on XGBoost 基于 XGBoost 的卡片数量估算本地化自动学习
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-01 DOI: 10.1007/s10115-024-02142-2
Jieming Feng, Zhanhuai Li, Qun Chen, Hailong Liu

For cardinality estimation in DBMS, building multiple local models instead of one global model can usually improve estimation accuracy as well as reducing the effort to label large amounts of training data. Unfortunately, the existing approach of localized learning requires users to explicitly specify which query patterns a local model can handle. Making these decisions is very arduous and error-prone for users; to make things worse, it limits the usability of local models. In this paper, we propose a localized learning solution for cardinality estimation based on XGBoost, which can automatically build an optimal combination of local models given a query workload. It consists of two phases: 1) model initialization; 2) model evolution. In the first phase, it clusters training data into a set of coarse-grained query pattern groups based on pattern similarity and constructs a separate local model for each group. In the second phase, it iteratively merges and splits clusters to identify an optimal combination by reconstructing local models. We formulate the problem of identifying the optimal combination of local models as a combinatorial optimization problem and present an efficient heuristic algorithm, named MMS (Models Merging and Splitting), for its solution due to its exponential complexity. Finally, we validate its performance superiority over the existing learning alternatives by extensive experiments on real datasets.

对于数据库管理系统中的卡入度估计,建立多个局部模型而不是一个全局模型通常可以提高估计精度,并减少标注大量训练数据的工作量。遗憾的是,现有的本地化学习方法要求用户明确指定本地模型可以处理哪些查询模式。对用户来说,做出这些决定非常麻烦,而且容易出错;更糟糕的是,这限制了本地模型的可用性。在本文中,我们提出了一种基于 XGBoost 的卡片度估计本地化学习解决方案,它可以在给定查询工作量的情况下自动构建本地模型的最佳组合。它包括两个阶段:1) 模型初始化;2) 模型演化。在第一阶段,它根据模式相似性将训练数据聚类为一组粗粒度查询模式组,并为每组构建一个单独的本地模型。在第二阶段,它通过重建局部模型,迭代合并和拆分群组,以确定最佳组合。我们将确定局部模型最优组合的问题表述为一个组合优化问题,并提出了一种高效的启发式算法,命名为 MMS(模型合并与拆分),用于解决其指数复杂性问题。最后,我们通过在真实数据集上进行大量实验,验证了该算法优于现有学习方法的性能。
{"title":"Automating localized learning for cardinality estimation based on XGBoost","authors":"Jieming Feng, Zhanhuai Li, Qun Chen, Hailong Liu","doi":"10.1007/s10115-024-02142-2","DOIUrl":"https://doi.org/10.1007/s10115-024-02142-2","url":null,"abstract":"<p>For cardinality estimation in DBMS, building multiple local models instead of one global model can usually improve estimation accuracy as well as reducing the effort to label large amounts of training data. Unfortunately, the existing approach of localized learning requires users to explicitly specify which query patterns a local model can handle. Making these decisions is very arduous and error-prone for users; to make things worse, it limits the usability of local models. In this paper, we propose a localized learning solution for cardinality estimation based on XGBoost, which can automatically build an optimal combination of local models given a query workload. It consists of two phases: 1) model initialization; 2) model evolution. In the first phase, it clusters training data into a set of coarse-grained query pattern groups based on pattern similarity and constructs a separate local model for each group. In the second phase, it iteratively merges and splits clusters to identify an optimal combination by reconstructing local models. We formulate the problem of identifying the optimal combination of local models as a combinatorial optimization problem and present an efficient heuristic algorithm, named <b>MMS</b> (<b>M</b>odels <b>M</b>erging and <b>S</b>plitting), for its solution due to its exponential complexity. Finally, we validate its performance superiority over the existing learning alternatives by extensive experiments on real datasets.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"13 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141193279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The analysis of diversification properties of stablecoins through the Shannon entropy measure 通过香农熵度量分析稳定币的多样化特性
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-05-30 DOI: 10.1007/s10115-024-02133-3
Mohavia Ben Amid Sinon, Jules Clement Mba

The common goal for investors is to minimise the risk and maximise the returns on their investments. This is often achieved through diversification, where investors spread their investments across various assets. This study aims to use the MAD-entropy model to minimise the absolute deviation, maximise the mean return, and maximise the Shannon entropy of the portfolio. The MAD model is used because it is a linear programming model, allowing it to resolve large-scale problems and nonnormally distributed data. Entropy is added to the MAD model because it can better diversify the weight of assets in the portfolios. The analysed portfolios consist of cryptocurrencies, stablecoins, and selected world indices such as the SP500 and FTSE obtained from Yahoo Finance. The models found that stablecoins pegged to the US dollar, followed by stablecoins pegged to gold, are better diversifiers for traditional cryptocurrencies and stocks. These results are probably due to their low volatility compared to the other assets. Findings from this study may assist investors since the MAD-Entropy model outperforms the MAD model by providing more significant portfolio mean returns with minimal risk. Therefore, crypto investors can design a well-diversified portfolio using MAD entropy to reduce unsystematic risk. Further research integrating mad entropy with machine learning techniques may improve accuracy and risk management.

投资者的共同目标是最大限度地降低投资风险,最大限度地提高投资收益。这通常是通过分散投资来实现的,即投资者将投资分散到各种资产上。本研究旨在使用 MAD-熵模型,使投资组合的绝对偏差最小化、平均收益最大化和香农熵最大化。之所以使用 MAD 模型,是因为它是一种线性规划模型,可以解决大规模问题和非正态分布数据。在 MAD 模型中加入熵,是因为它可以更好地分散投资组合中的资产权重。分析的投资组合包括加密货币、稳定币以及从雅虎财经获得的部分世界指数,如 SP500 和 FTSE。模型发现,与美元挂钩的稳定币,其次是与黄金挂钩的稳定币,是传统加密货币和股票更好的分散工具。这些结果可能是由于与其他资产相比,稳定币的波动性较低。这项研究的结果可能会对投资者有所帮助,因为 MAD-Entropy 模型优于 MAD 模型,它能以最低的风险提供更显著的投资组合平均回报。因此,加密货币投资者可以利用 MAD 熵设计一个分散的投资组合,以降低非系统性风险。将疯熵与机器学习技术相结合的进一步研究可能会提高准确性和风险管理。
{"title":"The analysis of diversification properties of stablecoins through the Shannon entropy measure","authors":"Mohavia Ben Amid Sinon, Jules Clement Mba","doi":"10.1007/s10115-024-02133-3","DOIUrl":"https://doi.org/10.1007/s10115-024-02133-3","url":null,"abstract":"<p>The common goal for investors is to minimise the risk and maximise the returns on their investments. This is often achieved through diversification, where investors spread their investments across various assets. This study aims to use the MAD-entropy model to minimise the absolute deviation, maximise the mean return, and maximise the Shannon entropy of the portfolio. The MAD model is used because it is a linear programming model, allowing it to resolve large-scale problems and nonnormally distributed data. Entropy is added to the MAD model because it can better diversify the weight of assets in the portfolios. The analysed portfolios consist of cryptocurrencies, stablecoins, and selected world indices such as the SP500 and FTSE obtained from Yahoo Finance. The models found that stablecoins pegged to the US dollar, followed by stablecoins pegged to gold, are better diversifiers for traditional cryptocurrencies and stocks. These results are probably due to their low volatility compared to the other assets. Findings from this study may assist investors since the MAD-Entropy model outperforms the MAD model by providing more significant portfolio mean returns with minimal risk. Therefore, crypto investors can design a well-diversified portfolio using MAD entropy to reduce unsystematic risk. Further research integrating mad entropy with machine learning techniques may improve accuracy and risk management.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"13 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141193162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Methods for concept analysis and multi-relational data mining: a systematic literature review 概念分析和多关系数据挖掘方法:系统文献综述
IF 2.7 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-05-30 DOI: 10.1007/s10115-024-02139-x
Nicolás Leutwyler, Mario Lezoche, Chiara Franciosi, Hervé Panetto, Laurent Teste, Diego Torres

The Internet of Things massive adoption in many industrial areas in addition to the requirement of modern services is posing huge challenges to the field of data mining. Moreover, the semantic interoperability of systems and enterprises requires to operate between many different formats such as ontologies, knowledge graphs, or relational databases, as well as different contexts such as static, dynamic, or real time. Consequently, supporting this semantic interoperability requires a wide range of knowledge discovery methods with different capabilities that answer to the context of distributed architectures (DA). However, to the best of our knowledge there is no general review in recent time about the state of the art of Concept Analysis (CA) and multi-relational data mining (MRDM) methods regarding knowledge discovery in DA considering semantic interoperability. In this work, a systematic literature review on CA and MRDM is conducted, providing a discussion on the characteristics they have according to the papers reviewed, supported by a clusterization technique based on association rules. Moreover, the review allowed the identification of three research gaps toward a more scalable set of methods in the context of DA and heterogeneous sources.

除了对现代服务的要求之外,物联网在许多工业领域的大规模应用也给数据挖掘领域带来了巨大挑战。此外,系统和企业的语义互操作性要求在本体、知识图谱或关系数据库等多种不同格式以及静态、动态或实时等不同上下文之间进行操作。因此,支持这种语义互操作性需要多种知识发现方法,这些方法具有不同的功能,可满足分布式架构(DA)的要求。然而,据我们所知,最近还没有关于概念分析(CA)和多关系数据挖掘(MRDM)方法在考虑到语义互操作性的 DA 中的知识发现方面的最新进展的综述。在这项工作中,对 CA 和 MRDM 进行了系统的文献综述,根据所综述的论文讨论了它们的特点,并辅以基于关联规则的聚类技术。此外,通过综述还确定了三个研究缺口,以便在数据分析和异构源的背景下,找到一套更具可扩展性的方法。
{"title":"Methods for concept analysis and multi-relational data mining: a systematic literature review","authors":"Nicolás Leutwyler, Mario Lezoche, Chiara Franciosi, Hervé Panetto, Laurent Teste, Diego Torres","doi":"10.1007/s10115-024-02139-x","DOIUrl":"https://doi.org/10.1007/s10115-024-02139-x","url":null,"abstract":"<p>The Internet of Things massive adoption in many industrial areas in addition to the requirement of modern services is posing huge challenges to the field of data mining. Moreover, the semantic interoperability of systems and enterprises requires to operate between many different formats such as ontologies, knowledge graphs, or relational databases, as well as different contexts such as static, dynamic, or real time. Consequently, supporting this semantic interoperability requires a wide range of knowledge discovery methods with different capabilities that answer to the context of <i>distributed architectures</i> (DA). However, to the best of our knowledge there is no general review in recent time about the state of the art of Concept Analysis (CA) and multi-relational data mining (MRDM) methods regarding knowledge discovery in DA considering semantic interoperability. In this work, a systematic literature review on CA and MRDM is conducted, providing a discussion on the characteristics they have according to the papers reviewed, supported by a clusterization technique based on association rules. Moreover, the review allowed the identification of three research gaps toward a more scalable set of methods in the context of DA and heterogeneous sources.</p>","PeriodicalId":54749,"journal":{"name":"Knowledge and Information Systems","volume":"297 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141193750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Knowledge and Information Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1