首页 > 最新文献

2021 IEEE Symposium Series on Computational Intelligence (SSCI)最新文献

英文 中文
Transformer-Based Bidirectional Encoder Representations for Emotion Detection from Text 基于变换的文本情感检测双向编码器表示
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9660152
A. J, E. Cambria, T. Trueman
Social media influences internet users to share their sentiments, feelings, or emotions about entities. In particular, sentiment analysis classifies a text into positive, negative, or neutral. It does not capture the state of mind of an individual like happiness, anger, and fear. Therefore, emotion detection plays an important role in user-generated content for capturing the state of mind. Moreover, researchers adopted traditional machine learning and deep learning models to capture emotions from the text. Recently, transformers-based architectures achieve better results in various natural language processing tasks. Therefore, we propose a transformer-based emotion detection system, which uses context-dependent features and a one-cycle learning rate policy for a better understanding of emotions from the text. We evaluate the proposed emotion detection model using error matrix, learning curve, precision, recall, F1-score, and their micro and macro averages. Our results indicate that the system achieves a 6 % accuracy over existing models.
社交媒体影响互联网用户分享他们对实体的看法、感受或情绪。特别地,情感分析将文本分为积极、消极或中性。它不能捕捉到一个人的精神状态,比如快乐、愤怒和恐惧。因此,情绪检测在用户生成内容中扮演着重要的角色,可以捕捉用户的心理状态。此外,研究人员采用传统的机器学习和深度学习模型从文本中捕捉情感。近年来,基于变压器的体系结构在各种自然语言处理任务中取得了较好的效果。因此,我们提出了一种基于转换器的情感检测系统,该系统使用上下文相关特征和单周期学习率策略来更好地从文本中理解情感。我们使用误差矩阵、学习曲线、精度、召回率、f1分数及其微观和宏观平均值来评估所提出的情绪检测模型。我们的结果表明,该系统达到了6%的精度比现有的模型。
{"title":"Transformer-Based Bidirectional Encoder Representations for Emotion Detection from Text","authors":"A. J, E. Cambria, T. Trueman","doi":"10.1109/SSCI50451.2021.9660152","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9660152","url":null,"abstract":"Social media influences internet users to share their sentiments, feelings, or emotions about entities. In particular, sentiment analysis classifies a text into positive, negative, or neutral. It does not capture the state of mind of an individual like happiness, anger, and fear. Therefore, emotion detection plays an important role in user-generated content for capturing the state of mind. Moreover, researchers adopted traditional machine learning and deep learning models to capture emotions from the text. Recently, transformers-based architectures achieve better results in various natural language processing tasks. Therefore, we propose a transformer-based emotion detection system, which uses context-dependent features and a one-cycle learning rate policy for a better understanding of emotions from the text. We evaluate the proposed emotion detection model using error matrix, learning curve, precision, recall, F1-score, and their micro and macro averages. Our results indicate that the system achieves a 6 % accuracy over existing models.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127930673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A multi-agent knowledge-enhanced model for decision-supporting agroforestry systems 决策支持农林业系统的多智能体知识增强模型
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9660056
Danilo Cavaliere, S. Senatore
Precision Agriculture (PA) and Forest Management (FM) applications require sensor-based environment monitoring to assess the vegetation status of monitored areas. Vegetation Indices (VIs), assessed from satellite-taken spectral images, depict some features (e.g., vegetation vigour, coverage, etc.) but they are not enough to describe vegetation status, hence they need to be contextualized according to the area phenology, latitude and weather for correct vegetation status interpretations. Moreover, heterogeneous data collection can cause data integration and interoperability issues. Additionally, human operators, who have to monitor multiple vast environments in time critical contexts, require brief meaningful reports about occurred situations. In this paper a knowledge-based multi-agent approach is presented to deal with environment monitoring of user-specified Regions of Interest (ROIs) and assess their vegetation status. The approach employs different types of agents to carry out various tasks, including data acquisition and knowledge storing, end-user interaction and vegetation analysis accomplishment. The end-user can request different types of analysis and pass data to the system through an agent-managed GUI, hence vegetation analysis is carried out by using a decision tree-based method to properly query the KB built on VIs and contextual data to consequently build a report about the vegetation status of the ROI. The built report includes a description of other features (soil, weather) that helps depicting the detected vegetation status. Several case studies demonstrate the functioning and efficacy of the approach.
精准农业(PA)和森林管理(FM)应用需要基于传感器的环境监测来评估被监测区域的植被状况。植被指数(VIs)根据卫星拍摄的光谱图像评估,描绘了一些特征(如植被活力、覆盖度等),但它们不足以描述植被状况,因此需要根据地区物候、纬度和天气将它们结合起来,以正确解释植被状况。此外,异构数据收集可能导致数据集成和互操作性问题。此外,操作员必须在时间关键的情况下监控多个大型环境,因此需要有关发生情况的简短有意义的报告。本文提出了一种基于知识的多智能体方法来处理用户指定感兴趣区域的环境监测并评估其植被状况。该方法采用不同类型的agent来完成数据采集和知识存储、终端用户交互和植被分析完成等任务。最终用户可以请求不同类型的分析,并通过代理管理的GUI将数据传递给系统,因此植被分析是通过使用基于决策树的方法来正确查询基于VIs和上下文数据的知识库,从而构建关于ROI植被状态的报告来进行的。构建的报告包括对其他特征(土壤、天气)的描述,有助于描述检测到的植被状态。几个案例研究证明了该方法的功能和有效性。
{"title":"A multi-agent knowledge-enhanced model for decision-supporting agroforestry systems","authors":"Danilo Cavaliere, S. Senatore","doi":"10.1109/SSCI50451.2021.9660056","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9660056","url":null,"abstract":"Precision Agriculture (PA) and Forest Management (FM) applications require sensor-based environment monitoring to assess the vegetation status of monitored areas. Vegetation Indices (VIs), assessed from satellite-taken spectral images, depict some features (e.g., vegetation vigour, coverage, etc.) but they are not enough to describe vegetation status, hence they need to be contextualized according to the area phenology, latitude and weather for correct vegetation status interpretations. Moreover, heterogeneous data collection can cause data integration and interoperability issues. Additionally, human operators, who have to monitor multiple vast environments in time critical contexts, require brief meaningful reports about occurred situations. In this paper a knowledge-based multi-agent approach is presented to deal with environment monitoring of user-specified Regions of Interest (ROIs) and assess their vegetation status. The approach employs different types of agents to carry out various tasks, including data acquisition and knowledge storing, end-user interaction and vegetation analysis accomplishment. The end-user can request different types of analysis and pass data to the system through an agent-managed GUI, hence vegetation analysis is carried out by using a decision tree-based method to properly query the KB built on VIs and contextual data to consequently build a report about the vegetation status of the ROI. The built report includes a description of other features (soil, weather) that helps depicting the detected vegetation status. Several case studies demonstrate the functioning and efficacy of the approach.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133895599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Predicting CMA-ES Operators as Inductive Biases for Shape Optimization Problems 预测CMA-ES算子作为形状优化问题的归纳偏差
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9660001
Stephen Friess, P. Tiňo, S. Menzel, B. Sendhoff, Xin Yao
Domain-dependent expertise knowledge and high-level abstractions to arbitrate between different problem domains can be considered to be essential components of how human problem-solvers build experience and reuse it over the course of their lifetime. However, replicating it from an algorithmic point of view is a less trivial endeavor. Existing knowledge transfer methods in optimization largely fail to provide more specific guidance on specifying the similarity of different optimization problems and the nature of complementary experiences formed on them. A more rigorously grounded approach can be found alternatively in metalearning. This notion neglects any hurdles on characterizing problem similarity in favor of focusing instead on methodology to form domain-dependent inductive biases and mechanisms to arbitrate between them. In principle, we proposed within our previous research methods for constructing inductive biases and predict these from procedural optimization data. However, while we obtained effective methodology, it does not allow the joint construction of predictive components and biases in a cohesive manner. We therefore show in our following study, that improved configurations can be derived for the CMA-ES algorithm which can serve as inductive biases, and that predictors can be trained to recall them. Particularly noteworthy, this scenario allows the construction of predictive component and bias iteratively in a joint manner. We demonstrate the efficacy of this approach in a shape optimization scenario, in which the inductive bias is predicted through an operator configuration in a problem-specific manner during run-time.
领域相关的专业知识和用于在不同问题领域之间进行仲裁的高级抽象可以被认为是人类问题解决者如何构建经验并在其生命周期中重用经验的重要组成部分。然而,从算法的角度复制它是一项不那么微不足道的努力。现有的优化知识转移方法在很大程度上不能对不同优化问题之间的相似性以及在此基础上形成的互补经验的性质提供更具体的指导。另一种更严格的方法是元学习。这个概念忽略了刻画问题相似性的任何障碍,转而关注形成领域相关的归纳偏差和在它们之间进行仲裁的机制的方法。原则上,我们在之前的研究中提出了构建归纳偏差并从程序优化数据中预测这些偏差的方法。然而,虽然我们获得了有效的方法,但它不允许以一种有凝聚力的方式联合构建预测成分和偏差。因此,我们在接下来的研究中表明,可以为CMA-ES算法导出改进的配置,这些配置可以作为归纳偏差,并且可以训练预测器来召回它们。特别值得注意的是,这个场景允许以联合的方式迭代地构建预测组件和偏差。我们在形状优化场景中证明了这种方法的有效性,在该场景中,在运行时,通过操作员配置以特定于问题的方式预测归纳偏置。
{"title":"Predicting CMA-ES Operators as Inductive Biases for Shape Optimization Problems","authors":"Stephen Friess, P. Tiňo, S. Menzel, B. Sendhoff, Xin Yao","doi":"10.1109/SSCI50451.2021.9660001","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9660001","url":null,"abstract":"Domain-dependent expertise knowledge and high-level abstractions to arbitrate between different problem domains can be considered to be essential components of how human problem-solvers build experience and reuse it over the course of their lifetime. However, replicating it from an algorithmic point of view is a less trivial endeavor. Existing knowledge transfer methods in optimization largely fail to provide more specific guidance on specifying the similarity of different optimization problems and the nature of complementary experiences formed on them. A more rigorously grounded approach can be found alternatively in metalearning. This notion neglects any hurdles on characterizing problem similarity in favor of focusing instead on methodology to form domain-dependent inductive biases and mechanisms to arbitrate between them. In principle, we proposed within our previous research methods for constructing inductive biases and predict these from procedural optimization data. However, while we obtained effective methodology, it does not allow the joint construction of predictive components and biases in a cohesive manner. We therefore show in our following study, that improved configurations can be derived for the CMA-ES algorithm which can serve as inductive biases, and that predictors can be trained to recall them. Particularly noteworthy, this scenario allows the construction of predictive component and bias iteratively in a joint manner. We demonstrate the efficacy of this approach in a shape optimization scenario, in which the inductive bias is predicted through an operator configuration in a problem-specific manner during run-time.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131841804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Anomaly Detection on the Rail Lines Using Semantic Segmentation and Self-supervised Learning 基于语义分割和自监督学习的铁路异常检测
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659920
Kanwal Jahan, Jeethesh Pai Umesh, Michael Roth
This paper introduces a novel application of anomaly detection on the rail lines using deep learning methods on camera data. We propose a two-fold approach for identifying irregularities like coal, dirt, and obstacles on the rail tracks. In the first stage, a binary semantic segmentation is performed to extract only the rails from the background. In the second stage, we deploy our proposed autoencoder utilizing the self-supervised learning techniques to address the unavailability of labelled anomalies. The extracted rails from stage one are divided into multiple patches and are fed to the autoencoder, which is trained to reconstruct the non-anomalous data only. Hence, during the inference, the regeneration of images with any abnormalities produces a larger reconstruction error. Applying a predefined threshold to the reconstruction errors can detect an anomaly on a rail track. Stage one, rail extracting network achieves a high value of 52.78% mean Intersection over Union (mIoU). The second stage autoencoder network converges well on the training data. Finally, we evaluate our two-fold approach on real scenario test images, no false positives or false negatives were found in the the detected anomalies on the rail tracks.
本文介绍了一种基于相机数据的深度学习方法在铁路异常检测中的新应用。我们提出了一种双重方法来识别轨道上的煤炭、泥土和障碍物等不规则物。在第一阶段,执行二进制语义分割,仅从背景中提取轨道。在第二阶段,我们利用自监督学习技术部署我们提出的自动编码器来解决标记异常的不可用性。从第一阶段提取的轨道被分割成多个小块并馈送到自编码器,该自编码器只被训练以重建非异常数据。因此,在推理过程中,任何异常图像的再生都会产生较大的重建误差。对重建误差应用预定义的阈值可以检测轨道上的异常。第一阶段,轨道提取网络均值mIoU达到52.78%的高值。第二阶段自动编码器网络对训练数据有很好的收敛性。最后,我们在真实场景测试图像上评估了我们的双重方法,在检测到的轨道异常中没有发现假阳性或假阴性。
{"title":"Anomaly Detection on the Rail Lines Using Semantic Segmentation and Self-supervised Learning","authors":"Kanwal Jahan, Jeethesh Pai Umesh, Michael Roth","doi":"10.1109/SSCI50451.2021.9659920","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659920","url":null,"abstract":"This paper introduces a novel application of anomaly detection on the rail lines using deep learning methods on camera data. We propose a two-fold approach for identifying irregularities like coal, dirt, and obstacles on the rail tracks. In the first stage, a binary semantic segmentation is performed to extract only the rails from the background. In the second stage, we deploy our proposed autoencoder utilizing the self-supervised learning techniques to address the unavailability of labelled anomalies. The extracted rails from stage one are divided into multiple patches and are fed to the autoencoder, which is trained to reconstruct the non-anomalous data only. Hence, during the inference, the regeneration of images with any abnormalities produces a larger reconstruction error. Applying a predefined threshold to the reconstruction errors can detect an anomaly on a rail track. Stage one, rail extracting network achieves a high value of 52.78% mean Intersection over Union (mIoU). The second stage autoencoder network converges well on the training data. Finally, we evaluate our two-fold approach on real scenario test images, no false positives or false negatives were found in the the detected anomalies on the rail tracks.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131889272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Data-Driven Fuzzy Demand Forecasting Models for Resilient Supply Chains 弹性供应链的数据驱动模糊需求预测模型
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659992
A. Thavaneswaran, R. Thulasiram, Md. Erfanul Hoque, S. S. Appadoo
Uncertainty in supply chain leads to what is known as bullwhip effect (BE), which causes multiple inefficiencies such as higher costs of production (of more than what is needed), wastage and logistics. Though there are many studies reported in the literature, the impact of the quality of dynamic forecasts on the BE has not received sufficient coverage. In this paper, a fuzzy data-driven weighted moving average (DDWMA) forecasts of the future demand strategy is proposed for supply chain. Also, data-driven random weighted volatility forecasting model is used to study the fuzzy extended Bollinger bands forecasts of the demand. The main reason of using the fuzzy approach is to provide α-cuts for DDWMA demand forecasts as well as extended Bollinger bands forecasts. The proposed fuzzy extended Bollinger bands forecast is a two steps procedure as it uses optimal weights for both the demand forecasts as well as the volatility forecasts of the demand process. In particular, a novel dynamic fuzzy forecasting algorithm of the demand is proposed which bypasses complexities associated with traditional forecasting steps of fitting any time series model. The proposed data-driven fuzzy forecasting approach focuses on defining a dynamic fuzzy forecasting intervals of the demand as well as the volatility of the demand in supply chain. The performance of proposed approaches is evaluated through numerical experiments using simulated data and weekly demand data. The results show that the proposed methods perform well in terms of narrower fuzzy forecasting bands for demand as well as the volatility of the demand.
供应链的不确定性导致了所谓的牛鞭效应(BE),这导致了多重效率低下,如生产成本(超过需求)、浪费和物流。虽然文献中有许多研究报道,但动态预测质量对BE的影响还没有得到足够的报道。本文提出了一种基于模糊数据驱动的加权移动平均(DDWMA)的供应链未来需求预测策略。利用数据驱动的随机加权波动率预测模型,研究了需求的模糊扩展布林带预测。使用模糊方法的主要原因是为DDWMA需求预测和扩展布林带预测提供α-切值。所提出的模糊扩展布林带预测是一个两步过程,因为它对需求预测和需求过程的波动率预测都使用了最优权重。特别地,提出了一种新的需求动态模糊预测算法,该算法绕过了拟合任何时间序列模型的传统预测步骤所带来的复杂性。提出的数据驱动模糊预测方法侧重于定义需求和供应链中需求波动的动态模糊预测区间。通过模拟数据和周需求数据的数值实验,对所提方法的性能进行了评价。结果表明,所提出的方法在较窄的需求模糊预测范围和需求的波动性方面都有较好的效果。
{"title":"Data-Driven Fuzzy Demand Forecasting Models for Resilient Supply Chains","authors":"A. Thavaneswaran, R. Thulasiram, Md. Erfanul Hoque, S. S. Appadoo","doi":"10.1109/SSCI50451.2021.9659992","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659992","url":null,"abstract":"Uncertainty in supply chain leads to what is known as bullwhip effect (BE), which causes multiple inefficiencies such as higher costs of production (of more than what is needed), wastage and logistics. Though there are many studies reported in the literature, the impact of the quality of dynamic forecasts on the BE has not received sufficient coverage. In this paper, a fuzzy data-driven weighted moving average (DDWMA) forecasts of the future demand strategy is proposed for supply chain. Also, data-driven random weighted volatility forecasting model is used to study the fuzzy extended Bollinger bands forecasts of the demand. The main reason of using the fuzzy approach is to provide α-cuts for DDWMA demand forecasts as well as extended Bollinger bands forecasts. The proposed fuzzy extended Bollinger bands forecast is a two steps procedure as it uses optimal weights for both the demand forecasts as well as the volatility forecasts of the demand process. In particular, a novel dynamic fuzzy forecasting algorithm of the demand is proposed which bypasses complexities associated with traditional forecasting steps of fitting any time series model. The proposed data-driven fuzzy forecasting approach focuses on defining a dynamic fuzzy forecasting intervals of the demand as well as the volatility of the demand in supply chain. The performance of proposed approaches is evaluated through numerical experiments using simulated data and weekly demand data. The results show that the proposed methods perform well in terms of narrower fuzzy forecasting bands for demand as well as the volatility of the demand.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132197570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Space and Time Efficiency Analysis of Data-Driven Methods Applied to Embedded Systems 应用于嵌入式系统的数据驱动方法的时空效率分析
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9660133
Iron Tessaro, R. Z. Freire, V. Mariani, L. Coelho
One of the applications of data-driven methods in the industry is the creation of real-time, embedded measurements, whether to monitor or replace sensor signals. As the number of embedded systems in products raises over time, the energy efficiency of such systems must be considered in the design. The time (processor) efficiency of the embedded software is directly related to the energy efficiency of the embedded system. Therefore, when considering some embedded software solutions, such as data-driven methods, time efficiency must be taken into account to improve energy efficiency. In this work, the energy efficiency of three data-driven methods: the Sparse Identification of Nonlinear Dynamics (SINDy), the Extreme Learning Machine (ELM), and the Random-Vector Functional Link (RVFL) network were assessed by using the creation of a real-time in-cylinder pressure sensor for diesel engines as a task. The three methods were kept with equivalent performances, whereas their relative execution time was tested and classified by their statistical rankings. Additionally, the space (memory) efficiency of the methods was assessed. The contribution of this work is to provide a guide to choose the best data-driven method to be used in an embedded system in terms of efficiency.
数据驱动方法在行业中的应用之一是创建实时嵌入式测量,无论是监控还是替换传感器信号。随着产品中嵌入式系统的数量随着时间的推移而增加,必须在设计中考虑此类系统的能源效率。嵌入式软件的时间(处理器)效率直接关系到嵌入式系统的能源效率。因此,在考虑一些嵌入式软件解决方案时,例如数据驱动方法,必须考虑时间效率,以提高能源效率。在这项工作中,三种数据驱动的方法:非线性动力学稀疏识别(SINDy)、极限学习机(ELM)和随机向量功能链接(RVFL)网络的能源效率通过创建柴油发动机的实时缸内压力传感器作为一项任务来评估。这三种方法保持相同的性能,而它们的相对执行时间通过它们的统计排名进行测试和分类。此外,还评估了这些方法的空间(内存)效率。这项工作的贡献是提供了一个指南,以选择最佳的数据驱动方法,用于嵌入式系统的效率方面。
{"title":"Space and Time Efficiency Analysis of Data-Driven Methods Applied to Embedded Systems","authors":"Iron Tessaro, R. Z. Freire, V. Mariani, L. Coelho","doi":"10.1109/SSCI50451.2021.9660133","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9660133","url":null,"abstract":"One of the applications of data-driven methods in the industry is the creation of real-time, embedded measurements, whether to monitor or replace sensor signals. As the number of embedded systems in products raises over time, the energy efficiency of such systems must be considered in the design. The time (processor) efficiency of the embedded software is directly related to the energy efficiency of the embedded system. Therefore, when considering some embedded software solutions, such as data-driven methods, time efficiency must be taken into account to improve energy efficiency. In this work, the energy efficiency of three data-driven methods: the Sparse Identification of Nonlinear Dynamics (SINDy), the Extreme Learning Machine (ELM), and the Random-Vector Functional Link (RVFL) network were assessed by using the creation of a real-time in-cylinder pressure sensor for diesel engines as a task. The three methods were kept with equivalent performances, whereas their relative execution time was tested and classified by their statistical rankings. Additionally, the space (memory) efficiency of the methods was assessed. The contribution of this work is to provide a guide to choose the best data-driven method to be used in an embedded system in terms of efficiency.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133801415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating Normalized Conformal Regressors 研究归一化共形回归量
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659853
U. Johansson, Henrik Boström, Tuwe Löfström
Conformal prediction can be applied on top of any machine learning predictive regression model, thus turning it into a conformal regressor. Given a significance level $epsilon$, conformal regressors output valid prediction intervals, i.e., the probability that the interval covers the true value is exactly $1-epsilon$. To obtain validity, a calibration set that is not used for training the model must be set aside. In standard inductive conformal regression, the size of the prediction intervals is then determined by the absolute error made by the predictive model on a specific instance in the calibration set, where different significance levels correspond to different instances. In this setting, all prediction intervals will have the same size, making the resulting models very unspecific. When adding a technique called normalization, however, the difficulty of each instance is estimated, and the interval sizes are adjusted accordingly. An integral part of normalized conformal regressors is a parameter called $beta$, which determines the relative importance of the difficulty estimation and the error of the model. In this study, the effects of different underlying models, difficulty estimation functions and $beta$ -values are investigated. The results from a large empirical study, using twenty publicly available data sets, show that better difficulty estimation functions will lead to both tighter and more specific prediction intervals. Furthermore, it is found that the $beta$ -values used strongly affect the conformal regressor. While there is no specific $beta$ -value that will always minimize the interval sizes, lower $beta$ -values lead to more variation in the interval sizes, i.e., more specific models. In addition, the analysis also identifies that the normalization procedure introduces a small but unfortunate bias in the models. More specifically, normalization using low $beta$ -values means that smaller intervals are more likely to be erroneous, while the opposite is true for higher $beta$ -values.
保形预测可以应用于任何机器学习预测回归模型之上,从而将其转化为保形回归量。给定显著性水平$epsilon$,共形回归器输出有效的预测区间,即该区间恰好覆盖真实值的概率为$1-epsilon$。为了获得有效性,必须将不用于训练模型的校准集放在一边。在标准归纳共形回归中,预测区间的大小由预测模型对校准集中特定实例的绝对误差决定,其中不同的显著性水平对应于不同的实例。在此设置中,所有预测间隔将具有相同的大小,从而使结果模型非常不具体。然而,当添加一种称为归一化的技术时,对每个实例的难度进行估计,并相应地调整区间大小。归一化共形回归量的一个组成部分是一个名为$beta$的参数,它决定了难度估计和模型误差的相对重要性。在本研究中,研究了不同的底层模型、难度估计函数和$beta$ -值的影响。使用20个公开数据集的大型实证研究结果表明,更好的难度估计函数将导致更严格和更具体的预测区间。此外,发现$beta$ -值使用强烈影响保形回归量。虽然没有特定的$beta$ -值总是使区间大小最小化,但较低的$beta$ -值会导致区间大小的更多变化,即更具体的模型。此外,分析还指出,归一化过程在模型中引入了一个小但不幸的偏差。更具体地说,使用较低的$beta$ -值进行规范化意味着较小的间隔更有可能出错,而较高的$beta$ -值则相反。
{"title":"Investigating Normalized Conformal Regressors","authors":"U. Johansson, Henrik Boström, Tuwe Löfström","doi":"10.1109/SSCI50451.2021.9659853","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659853","url":null,"abstract":"Conformal prediction can be applied on top of any machine learning predictive regression model, thus turning it into a conformal regressor. Given a significance level $epsilon$, conformal regressors output valid prediction intervals, i.e., the probability that the interval covers the true value is exactly $1-epsilon$. To obtain validity, a calibration set that is not used for training the model must be set aside. In standard inductive conformal regression, the size of the prediction intervals is then determined by the absolute error made by the predictive model on a specific instance in the calibration set, where different significance levels correspond to different instances. In this setting, all prediction intervals will have the same size, making the resulting models very unspecific. When adding a technique called normalization, however, the difficulty of each instance is estimated, and the interval sizes are adjusted accordingly. An integral part of normalized conformal regressors is a parameter called $beta$, which determines the relative importance of the difficulty estimation and the error of the model. In this study, the effects of different underlying models, difficulty estimation functions and $beta$ -values are investigated. The results from a large empirical study, using twenty publicly available data sets, show that better difficulty estimation functions will lead to both tighter and more specific prediction intervals. Furthermore, it is found that the $beta$ -values used strongly affect the conformal regressor. While there is no specific $beta$ -value that will always minimize the interval sizes, lower $beta$ -values lead to more variation in the interval sizes, i.e., more specific models. In addition, the analysis also identifies that the normalization procedure introduces a small but unfortunate bias in the models. More specifically, normalization using low $beta$ -values means that smaller intervals are more likely to be erroneous, while the opposite is true for higher $beta$ -values.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132136875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
While, In General, Uncertainty Quantification (UQ) Is NP-Hard, Many Practical UQ Problems Can Be Made Feasible 一般来说,不确定性量化(UQ)是np困难的,但许多实际的UQ问题是可行的
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659990
Ander Gray, S. Ferson, O. Kosheleva, V. Kreinovich
In general, many general mathematical formulations of uncertainty quantification problems are NP-hard, meaning that (unless it turned out that P = NP) no feasible algorithm is possible that would always solve these problems. In this paper, we argue that if we restrict ourselves to practical problems, then the correspondingly restricted problems become feasible - namely, they can be solved by using linear programming techniques.
一般来说,许多不确定性量化问题的一般数学公式是NP困难的,这意味着(除非P = NP)没有可行的算法可能总是解决这些问题。在本文中,我们认为,如果我们将自己限制在实际问题中,那么相应的限制问题就变得可行-即,它们可以通过使用线性规划技术来解决。
{"title":"While, In General, Uncertainty Quantification (UQ) Is NP-Hard, Many Practical UQ Problems Can Be Made Feasible","authors":"Ander Gray, S. Ferson, O. Kosheleva, V. Kreinovich","doi":"10.1109/SSCI50451.2021.9659990","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659990","url":null,"abstract":"In general, many general mathematical formulations of uncertainty quantification problems are NP-hard, meaning that (unless it turned out that P = NP) no feasible algorithm is possible that would always solve these problems. In this paper, we argue that if we restrict ourselves to practical problems, then the correspondingly restricted problems become feasible - namely, they can be solved by using linear programming techniques.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"360 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132173783","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Automated Person Identification Framework Based on Fingernails and Dorsal Knuckle Patterns 基于指甲和指关节背模式的自动人识别框架
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659850
M. Alghamdi, P. Angelov, Bryan M. Williams
Handimages are of paramount importance within critical domains like security and criminal investigation. They can sometimes be the only available evidence of an offender's identity at a crime scene. Approaches to person identification that consider the human hand as a complex object composed of many components are rare. The approach proposed in this paper fills this gap, making use of knuckle creases and fingernail information. It introduces a framework for automatic person identification that includes localisation of the regions of interest within hand images, recognition of the detected components, segmentation of the region of interest using bounding boxes, and similarity matching between a query image and a library of available images. The following hand components are considered: i) the metacarpohalangeal, commonly known as base knuckle; ii) the proximal interphalangeal joint commonly known as major knuckle; iii) distal interphalangeal joint, commonly known as minor knuckle; iv) the interphalangeal joint, commonly known as thumb's knuckle, and v) the fingernails. A key element of the proposed framework is the similarity matching and an important role for it is played by the feature extraction. In this paper, we exploit end-to-end deep convolutional neural networks to extract discriminative high-level abstract features. We further use Bray-Curtis (BC) similarity for the matching process. We validated the proposed approach on well-known benchmarks, the ‘11k Hands' dataset and the Hong Kong Polytechnic University Contactless Hand Dorsal Images known as ‘PolyU HD’. We found that the results indicate that the knuckle patterns and fingernails play a significant role in the person identification. The results from the 11K dataset indicate that the results for the left hand are better than the results for the right hand. In both datasets, the fingernails produced consistently higher identification results than other hand components, with a rank-1 score of 93.65% on the ring finger of the left hand for the ‘11k Hands' dataset and rank-l score of 93.81% for the thumb from the ‘PolyU HD’ dataset.
在安全和刑事调查等关键领域,图像是至关重要的。它们有时是犯罪现场唯一可用的罪犯身份证据。将人的手视为一个由许多成分组成的复杂物体的人的识别方法是罕见的。本文提出的方法利用指关节折痕和指甲信息填补了这一空白。它引入了一个自动识别人的框架,包括手图像中感兴趣区域的定位,检测组件的识别,使用边界框分割感兴趣区域,以及查询图像和可用图像库之间的相似性匹配。考虑以下手部组件:i)掌指关节,通常称为基础指关节;Ii)指间近端关节,俗称主指节;Iii)指间关节远端,俗称小指节;4)指间关节,通常称为拇指指节,5)指甲。该框架的关键是相似度匹配,其中特征提取起着重要的作用。在本文中,我们利用端到端深度卷积神经网络来提取判别高级抽象特征。我们进一步使用Bray-Curtis (BC)相似度进行匹配过程。我们在著名的基准测试、“11k Hands”数据集和香港理工大学非接触式手背图像(PolyU HD)上验证了建议的方法。研究结果表明,指关节和指甲在人的识别中起着重要的作用。来自11K数据集的结果表明,左手的结果比右手的结果好。在这两个数据集中,指甲的识别结果始终高于其他手部成分,在“11k手”数据集中,左手无名指的rank-1得分为93.65%,而在“理大HD”数据集中,拇指的rank-1得分为93.81%。
{"title":"Automated Person Identification Framework Based on Fingernails and Dorsal Knuckle Patterns","authors":"M. Alghamdi, P. Angelov, Bryan M. Williams","doi":"10.1109/SSCI50451.2021.9659850","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659850","url":null,"abstract":"Handimages are of paramount importance within critical domains like security and criminal investigation. They can sometimes be the only available evidence of an offender's identity at a crime scene. Approaches to person identification that consider the human hand as a complex object composed of many components are rare. The approach proposed in this paper fills this gap, making use of knuckle creases and fingernail information. It introduces a framework for automatic person identification that includes localisation of the regions of interest within hand images, recognition of the detected components, segmentation of the region of interest using bounding boxes, and similarity matching between a query image and a library of available images. The following hand components are considered: i) the metacarpohalangeal, commonly known as base knuckle; ii) the proximal interphalangeal joint commonly known as major knuckle; iii) distal interphalangeal joint, commonly known as minor knuckle; iv) the interphalangeal joint, commonly known as thumb's knuckle, and v) the fingernails. A key element of the proposed framework is the similarity matching and an important role for it is played by the feature extraction. In this paper, we exploit end-to-end deep convolutional neural networks to extract discriminative high-level abstract features. We further use Bray-Curtis (BC) similarity for the matching process. We validated the proposed approach on well-known benchmarks, the ‘11k Hands' dataset and the Hong Kong Polytechnic University Contactless Hand Dorsal Images known as ‘PolyU HD’. We found that the results indicate that the knuckle patterns and fingernails play a significant role in the person identification. The results from the 11K dataset indicate that the results for the left hand are better than the results for the right hand. In both datasets, the fingernails produced consistently higher identification results than other hand components, with a rank-1 score of 93.65% on the ring finger of the left hand for the ‘11k Hands' dataset and rank-l score of 93.81% for the thumb from the ‘PolyU HD’ dataset.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129200345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
A semi-supervised learning approach to study the energy consumption in smart buildings 智能建筑能耗研究的半监督学习方法
Pub Date : 2021-12-05 DOI: 10.1109/SSCI50451.2021.9659911
Carlos Quintero Gull, J. Aguilar, M. Rodríguez-Moreno
In this work, we use the semi-supervised LAMDA-HSCC algorithm for characterizing the energy consumption in smart buildings, which can work with labeled and unlabeled data. Particularly, it uses the LAMDA-RD approach for the clustering problem and the LAMDA-HAD approach for the classification problem. Additionally, this algorithm uses three submodels for merging, partition groups (classes/cluster) and migrating individuals from a group to another. For the performance evaluation, several datasets of energetic consumption are used, with different percent of labeled data, showing very encouraging results according to two metrics in the semi-supervised context.
在这项工作中,我们使用半监督LAMDA-HSCC算法来表征智能建筑中的能耗,该算法可以处理标记和未标记的数据。特别是,它使用lambda - rd方法来解决聚类问题,使用lambda - had方法来解决分类问题。此外,该算法使用三个子模型来合并、划分组(类/簇)和将个体从一个组迁移到另一个组。对于性能评估,使用了几个能量消耗数据集,标记数据的百分比不同,根据半监督环境下的两个指标显示出非常令人鼓舞的结果。
{"title":"A semi-supervised learning approach to study the energy consumption in smart buildings","authors":"Carlos Quintero Gull, J. Aguilar, M. Rodríguez-Moreno","doi":"10.1109/SSCI50451.2021.9659911","DOIUrl":"https://doi.org/10.1109/SSCI50451.2021.9659911","url":null,"abstract":"In this work, we use the semi-supervised LAMDA-HSCC algorithm for characterizing the energy consumption in smart buildings, which can work with labeled and unlabeled data. Particularly, it uses the LAMDA-RD approach for the clustering problem and the LAMDA-HAD approach for the classification problem. Additionally, this algorithm uses three submodels for merging, partition groups (classes/cluster) and migrating individuals from a group to another. For the performance evaluation, several datasets of energetic consumption are used, with different percent of labeled data, showing very encouraging results according to two metrics in the semi-supervised context.","PeriodicalId":255763,"journal":{"name":"2021 IEEE Symposium Series on Computational Intelligence (SSCI)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132298127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2021 IEEE Symposium Series on Computational Intelligence (SSCI)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1