首页 > 最新文献

2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)最新文献

英文 中文
Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm 模态线性回归的核选择:最优核和IRLS算法
Ryoya Yamasaki, Toshiyuki Tanaka
Modal linear regression (MLR) is a method for obtaining a conditional mode predictor as a linear model. We study kernel selection for MLR from two perspectives: "which kernel achieves smaller error?" and "which kernel is computationally efficient?". First, we show that a Biweight kernel is optimal in the sense of minimizing an asymptotic mean squared error of a resulting MLR parameter. This result is derived from our refined analysis of an asymptotic statistical behavior of MLR. Secondly, we provide a kernel class for which iteratively reweighted least-squares algorithm (IRLS) is guaranteed to converge, and especially prove that IRLS with an Epanechnikov kernel terminates in a finite number of iterations. Simulation studies empirically verified that using a Biweight kernel provides good estimation accuracy and that using an Epanechnikov kernel is computationally efficient. Our results improve MLR of which existing studies often stick to a Gaussian kernel and modal EM algorithm specialized for it, by providing guidelines of kernel selection.
模态线性回归(MLR)是一种获得条件模态预测器作为线性模型的方法。我们从“哪个内核误差更小”和“哪个内核计算效率更高”两个角度研究MLR的核选择。首先,我们证明了在最小化结果MLR参数的渐近均方误差的意义上,双权核是最优的。这一结果来源于我们对MLR的渐近统计行为的精细分析。其次,给出了保证迭代重加权最小二乘算法收敛的核类,并特别证明了具有Epanechnikov核的迭代重加权最小二乘算法在有限次迭代中终止。仿真研究经验证明,使用双权核具有较好的估计精度,使用Epanechnikov核具有较高的计算效率。我们的研究结果通过提供核选择指南,改进了现有研究通常坚持使用高斯核和专门针对它的模态EM算法的MLR。
{"title":"Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm","authors":"Ryoya Yamasaki, Toshiyuki Tanaka","doi":"10.1109/ICMLA.2019.00110","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00110","url":null,"abstract":"Modal linear regression (MLR) is a method for obtaining a conditional mode predictor as a linear model. We study kernel selection for MLR from two perspectives: \"which kernel achieves smaller error?\" and \"which kernel is computationally efficient?\". First, we show that a Biweight kernel is optimal in the sense of minimizing an asymptotic mean squared error of a resulting MLR parameter. This result is derived from our refined analysis of an asymptotic statistical behavior of MLR. Secondly, we provide a kernel class for which iteratively reweighted least-squares algorithm (IRLS) is guaranteed to converge, and especially prove that IRLS with an Epanechnikov kernel terminates in a finite number of iterations. Simulation studies empirically verified that using a Biweight kernel provides good estimation accuracy and that using an Epanechnikov kernel is computationally efficient. Our results improve MLR of which existing studies often stick to a Gaussian kernel and modal EM algorithm specialized for it, by providing guidelines of kernel selection.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130355785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Utilising Evolutionary Algorithms to Design Granular Materials for Industrial Applications 利用进化算法设计工业应用的颗粒材料
G. Delaney, D. Howard, K. D. Napoli
Granular materials, such as sands, soils, grains and powders, are ubiquitous in both natural and artificial systems. They are core to many industrial systems from mining and food production to pharmaceuticals and construction. Granular media display unique properties, including their ability to flow like a liquid at low densities and jam in to a solid state at high densities. Granular materials are used functionally in a number of industrial systems, where for example their insulating, energy absorption, filtration or vibration damping properties are variously exploited. A recent emerging industrial application is to utilise the jamming transition of granular matter (transition from a sold to a liquid) to create functional jammed systems such as universal grippers or soft robotic devices with potential broad impact across many industrial sectors. However, controlling the microscopic properties of such systems to elicit bespoke functional granular systems remains challenging due to the complex relationship between the individual particle morphologies and the related emergent behaviour of the bulk state. Here, we investigate the use of evolution to explore the functional landscapes of granular systems. We employ a superellipsoid representation of the particle shape which allows us to smoothly transition between a large variety of particle aspect ratios and angularities, and investigate the use of multi-component systems alongside homogenous granular arrangements. Results show the ability to successfully characterise a sample design space, and represents an important step towards the creation of bespoke jammed systems with a range of practical applications across broad swathes of industry.
颗粒状物质,如沙子、土壤、颗粒和粉末,在自然和人工系统中无处不在。它们是许多工业系统的核心,从采矿和食品生产到制药和建筑。颗粒介质显示出独特的特性,包括它们在低密度时像液体一样流动,在高密度时堵塞成固体状态的能力。颗粒材料在许多工业系统中被功能性地使用,例如它们的绝缘、能量吸收、过滤或振动阻尼特性被不同地利用。最近出现的一种工业应用是利用颗粒物质的阻塞过渡(从液体过渡到液体)来创建功能性阻塞系统,如通用夹具或软机器人设备,在许多工业领域具有潜在的广泛影响。然而,由于单个粒子形态与体态相关涌现行为之间的复杂关系,控制这些系统的微观特性以产生定制的功能颗粒系统仍然具有挑战性。在这里,我们研究了利用进化来探索颗粒系统的功能景观。我们采用超椭球表示粒子形状,这使我们能够在各种各样的粒子长宽比和角度之间顺利过渡,并研究多组分系统与均匀颗粒排列的使用。结果表明,能够成功地表征一个样本设计空间,并代表了一个重要的一步,在广泛的工业领域的实际应用范围内创建定制的堵塞系统。
{"title":"Utilising Evolutionary Algorithms to Design Granular Materials for Industrial Applications","authors":"G. Delaney, D. Howard, K. D. Napoli","doi":"10.1109/ICMLA.2019.00305","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00305","url":null,"abstract":"Granular materials, such as sands, soils, grains and powders, are ubiquitous in both natural and artificial systems. They are core to many industrial systems from mining and food production to pharmaceuticals and construction. Granular media display unique properties, including their ability to flow like a liquid at low densities and jam in to a solid state at high densities. Granular materials are used functionally in a number of industrial systems, where for example their insulating, energy absorption, filtration or vibration damping properties are variously exploited. A recent emerging industrial application is to utilise the jamming transition of granular matter (transition from a sold to a liquid) to create functional jammed systems such as universal grippers or soft robotic devices with potential broad impact across many industrial sectors. However, controlling the microscopic properties of such systems to elicit bespoke functional granular systems remains challenging due to the complex relationship between the individual particle morphologies and the related emergent behaviour of the bulk state. Here, we investigate the use of evolution to explore the functional landscapes of granular systems. We employ a superellipsoid representation of the particle shape which allows us to smoothly transition between a large variety of particle aspect ratios and angularities, and investigate the use of multi-component systems alongside homogenous granular arrangements. Results show the ability to successfully characterise a sample design space, and represents an important step towards the creation of bespoke jammed systems with a range of practical applications across broad swathes of industry.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129538419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Root Cause Detection Among Anomalous Time Series Using Temporal State Alignment 基于时间状态对齐的异常时间序列根本原因检测
Sayan Chakraborty, Smit Shah, Kiumars Soltani, A. Swigart
The recent increase in the scale and complexity of software systems has introduced new challenges to the time series monitoring and anomaly detection process. A major drawback of existing anomaly detection methods is that they lack contextual information to help stakeholders identify the cause of anomalies. This problem, known as root cause detection, is particularly challenging to undertake in today's complex distributed software systems since the metrics under consideration generally have multiple internal and external dependencies. Significant manual analysis and strong domain expertise is required to isolate the correct cause of the problem. In this paper, we propose a method that isolates the root cause of an anomaly by analyzing the patterns in time series fluctuations. Our method considers the time series as observations from an underlying process passing through a sequence of discretized hidden states. The idea is to track the propagation of the effect when a given problem causes unaligned but homogeneous shifts of the underlying states. We evaluate our approach by finding the root cause of anomalies in Zillow's clickstream data by identifying causal patterns among a set of observed fluctuations.
近年来,软件系统的规模和复杂性的增加给时间序列监测和异常检测过程带来了新的挑战。现有异常检测方法的一个主要缺点是它们缺乏上下文信息来帮助涉众识别异常的原因。这个问题被称为根本原因检测,在当今复杂的分布式软件系统中尤其具有挑战性,因为所考虑的度量通常具有多个内部和外部依赖关系。需要大量的手工分析和强大的领域专业知识来隔离问题的正确原因。在本文中,我们提出了一种通过分析时间序列波动模式来分离异常根本原因的方法。我们的方法将时间序列视为通过一系列离散隐藏状态的潜在过程的观测值。其思想是,当一个给定的问题导致底层状态的非对齐但均匀的变化时,跟踪效应的传播。我们通过在一组观察到的波动中识别因果模式,在Zillow的点击流数据中找到异常的根本原因,从而评估我们的方法。
{"title":"Root Cause Detection Among Anomalous Time Series Using Temporal State Alignment","authors":"Sayan Chakraborty, Smit Shah, Kiumars Soltani, A. Swigart","doi":"10.1109/ICMLA.2019.00098","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00098","url":null,"abstract":"The recent increase in the scale and complexity of software systems has introduced new challenges to the time series monitoring and anomaly detection process. A major drawback of existing anomaly detection methods is that they lack contextual information to help stakeholders identify the cause of anomalies. This problem, known as root cause detection, is particularly challenging to undertake in today's complex distributed software systems since the metrics under consideration generally have multiple internal and external dependencies. Significant manual analysis and strong domain expertise is required to isolate the correct cause of the problem. In this paper, we propose a method that isolates the root cause of an anomaly by analyzing the patterns in time series fluctuations. Our method considers the time series as observations from an underlying process passing through a sequence of discretized hidden states. The idea is to track the propagation of the effect when a given problem causes unaligned but homogeneous shifts of the underlying states. We evaluate our approach by finding the root cause of anomalies in Zillow's clickstream data by identifying causal patterns among a set of observed fluctuations.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129698002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
State Summarization of Video Streams for Spatiotemporal Query Matching in Complex Event Processing 复杂事件处理中面向时空查询匹配的视频流状态汇总
Piyush Yadav, D. Das, E. Curry
Modelling complex events in unstructured data like videos not only requires detecting objects but also the spatiotemporal relationships among objects. Complex Event Processing (CEP) systems discretize continuous streams into fixed batches using windows and apply operators over these batches to detect patterns in real-time. To this end, we apply CEP techniques over video streams to identify spatiotemporal patterns by capturing window state. This work introduces a novel problem where an input video stream is converted to a stream of graphs which are aggregated to a single graph over a given state. Incoming video frames are converted to a timestamped Video Event Knowledge Graph (VEKG) [1] that maps objects to nodes and captures spatiotemporal relationships among object nodes. Objects coexist across multiple frames which leads to the creation of redundant nodes and edges at different time instances that results in high memory usage. There is a need for expressive and storage efficient graph model which can summarize graph streams in a single view. We propose Event Aggregated Graph (EAG), a summarized graph representation of VEKG streams over a given state. EAG captures different spatiotemporal relationships among objects using an Event Adjacency Matrix without replicating the nodes and edges across time instances. These enable the CEP system to process multiple continuous queries and perform frequent spatiotemporal pattern matching computations over a single summarised graph. Initial experiments show EAG takes 68.35% and 28.9% less space compared to baseline and state of the art graph summarization method respectively. EAG takes 5X less search time to detect pattern as compare to VEKG stream.
对视频等非结构化数据中的复杂事件进行建模,不仅需要检测对象,还需要检测对象之间的时空关系。复杂事件处理(CEP)系统使用窗口将连续流离散成固定批次,并在这些批次上应用操作符来实时检测模式。为此,我们在视频流上应用CEP技术,通过捕获窗口状态来识别时空模式。这项工作引入了一个新问题,其中输入视频流被转换为图形流,这些图形流在给定状态下聚合为单个图形。传入的视频帧被转换为带有时间戳的视频事件知识图(VEKG)[1],该图将对象映射到节点并捕获对象节点之间的时空关系。对象在多个帧中共存,这会导致在不同的时间实例中创建冗余的节点和边,从而导致高内存使用。需要一种表达能力强、存储效率高的图形模型,将图形流汇总到一个视图中。我们提出了事件聚合图(Event Aggregated Graph, EAG),这是一个给定状态下VEKG流的汇总图表示。EAG使用事件邻接矩阵捕获对象之间的不同时空关系,而无需跨时间实例复制节点和边。这使得CEP系统能够处理多个连续查询,并在单个汇总图上执行频繁的时空模式匹配计算。初步实验表明,与基线和最先进的图形摘要方法相比,EAG分别节省了68.35%和28.9%的空间。与VEKG流相比,EAG检测模式所需的搜索时间减少了5倍。
{"title":"State Summarization of Video Streams for Spatiotemporal Query Matching in Complex Event Processing","authors":"Piyush Yadav, D. Das, E. Curry","doi":"10.1109/ICMLA.2019.00022","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00022","url":null,"abstract":"Modelling complex events in unstructured data like videos not only requires detecting objects but also the spatiotemporal relationships among objects. Complex Event Processing (CEP) systems discretize continuous streams into fixed batches using windows and apply operators over these batches to detect patterns in real-time. To this end, we apply CEP techniques over video streams to identify spatiotemporal patterns by capturing window state. This work introduces a novel problem where an input video stream is converted to a stream of graphs which are aggregated to a single graph over a given state. Incoming video frames are converted to a timestamped Video Event Knowledge Graph (VEKG) [1] that maps objects to nodes and captures spatiotemporal relationships among object nodes. Objects coexist across multiple frames which leads to the creation of redundant nodes and edges at different time instances that results in high memory usage. There is a need for expressive and storage efficient graph model which can summarize graph streams in a single view. We propose Event Aggregated Graph (EAG), a summarized graph representation of VEKG streams over a given state. EAG captures different spatiotemporal relationships among objects using an Event Adjacency Matrix without replicating the nodes and edges across time instances. These enable the CEP system to process multiple continuous queries and perform frequent spatiotemporal pattern matching computations over a single summarised graph. Initial experiments show EAG takes 68.35% and 28.9% less space compared to baseline and state of the art graph summarization method respectively. EAG takes 5X less search time to detect pattern as compare to VEKG stream.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134428951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Regularization Learning for Image Recognition 图像识别的正则化学习
Xinjie Lan, K. Barner
In order to reduce overfitting for the image recognition application, this paper proposes a novel regularization learning algorithm for deep learning. Above all, we propose a novel probabilistic representation for explaining the architecture of Deep Neural Networks (DNNs), which demonstrates that the hidden layers close to the input formulate prior distributions, thus DNNs have an explicit regularization, namely the prior distributions. Furthermore, we show that the backpropagation learning algorithm is the reason for overfitting because it cannot guarantee precisely learning the prior distribution. Based on the proposed theoretical explanation for deep learning, we propose a novel regularization learning algorithm for DNNs. In contrast to most existing regularization methods reducing overfitting by decreasing the training complexity of DNNs, the proposed method reduces overfitting through training the corresponding prior distribution in a more efficient way, thereby deriving a more powerful regularization. Simulations demonstrate the proposed probabilistic representation on a synthetic dataset and validate the proposed regularization on the CIFAR-10 dataset.
为了减少图像识别应用中的过拟合问题,提出了一种新的深度学习正则化学习算法。最重要的是,我们提出了一种新的概率表示来解释深度神经网络(dnn)的结构,它表明靠近输入的隐藏层形成了先验分布,因此dnn具有显式正则化,即先验分布。此外,我们表明反向传播学习算法是过度拟合的原因,因为它不能保证精确地学习先验分布。基于深度学习的理论解释,我们提出了一种新的深度神经网络正则化学习算法。与现有的大多数正则化方法通过降低dnn的训练复杂度来减少过拟合相比,本文方法通过更有效地训练相应的先验分布来减少过拟合,从而得到更强大的正则化。仿真在一个合成数据集上验证了所提出的概率表示,并在CIFAR-10数据集上验证了所提出的正则化方法。
{"title":"Regularization Learning for Image Recognition","authors":"Xinjie Lan, K. Barner","doi":"10.1109/ICMLA.2019.00010","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00010","url":null,"abstract":"In order to reduce overfitting for the image recognition application, this paper proposes a novel regularization learning algorithm for deep learning. Above all, we propose a novel probabilistic representation for explaining the architecture of Deep Neural Networks (DNNs), which demonstrates that the hidden layers close to the input formulate prior distributions, thus DNNs have an explicit regularization, namely the prior distributions. Furthermore, we show that the backpropagation learning algorithm is the reason for overfitting because it cannot guarantee precisely learning the prior distribution. Based on the proposed theoretical explanation for deep learning, we propose a novel regularization learning algorithm for DNNs. In contrast to most existing regularization methods reducing overfitting by decreasing the training complexity of DNNs, the proposed method reduces overfitting through training the corresponding prior distribution in a more efficient way, thereby deriving a more powerful regularization. Simulations demonstrate the proposed probabilistic representation on a synthetic dataset and validate the proposed regularization on the CIFAR-10 dataset.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134555506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Looking for the Best Fit of a Function over Circadian Rhythm Data 在昼夜节律数据上寻找函数的最佳拟合
Fabian Fallas-Moya, Manfred Gonzalez-Hernandez, L. Barboza-Barquero, Kenneth Obando, Ovidio Valerio, Andrea Holst, Ronald Arias
Circadian rhythm regulates many biological processes. In plants, it controls the expression of genes related to growth and development. Recently, the usage of digital image analysis allows monitoring the circadian rhythm in plants, since the circadian rhythm can be observed by the movement of the leaves of a plant during the day. This is important because it can be used as a growth marker to select plants in plant breeding processes and to conduct fundamental science on this topic. In this work, a new algorithm is proposed to classify sets of coordinates to indicate if they show a circadian rhythm movement. Most algorithms take a set of coordinates and produce plots of the circadian movement, however, some databases have sets of coordinates that must be classified before the movement plots. This research presents an algorithm that determines if a set corresponds to a circadian rhythm movement using statistical analysis of polynomial regressions. Results showed that the proposed algorithm is significantly better compared with a Lagrange interpolation and with a fixed degree approaches. The obtained results suggest that using statistical information from the polynomial regressions can improve results in a classification task of circadian rhythm data.
昼夜节律调节着许多生物过程。在植物中,它控制着与生长发育有关的基因的表达。最近,数字图像分析的使用允许监测植物的昼夜节律,因为昼夜节律可以通过植物叶片在白天的运动来观察。这一点很重要,因为它可以作为植物育种过程中选择植物的生长标记,并对这一主题进行基础科学研究。在这项工作中,提出了一种新的算法来对坐标集进行分类,以指示它们是否显示昼夜节律运动。大多数算法采用一组坐标并生成昼夜节律运动图,然而,一些数据库必须在运动图之前对一组坐标进行分类。本研究提出了一种算法,该算法使用多项式回归的统计分析来确定一组是否对应于昼夜节律运动。结果表明,该算法与拉格朗日插值法和固定度插值法相比,具有明显的优越性。所得结果表明,利用多项式回归的统计信息可以改善昼夜节律数据分类任务的结果。
{"title":"Looking for the Best Fit of a Function over Circadian Rhythm Data","authors":"Fabian Fallas-Moya, Manfred Gonzalez-Hernandez, L. Barboza-Barquero, Kenneth Obando, Ovidio Valerio, Andrea Holst, Ronald Arias","doi":"10.1109/ICMLA.2019.00313","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00313","url":null,"abstract":"Circadian rhythm regulates many biological processes. In plants, it controls the expression of genes related to growth and development. Recently, the usage of digital image analysis allows monitoring the circadian rhythm in plants, since the circadian rhythm can be observed by the movement of the leaves of a plant during the day. This is important because it can be used as a growth marker to select plants in plant breeding processes and to conduct fundamental science on this topic. In this work, a new algorithm is proposed to classify sets of coordinates to indicate if they show a circadian rhythm movement. Most algorithms take a set of coordinates and produce plots of the circadian movement, however, some databases have sets of coordinates that must be classified before the movement plots. This research presents an algorithm that determines if a set corresponds to a circadian rhythm movement using statistical analysis of polynomial regressions. Results showed that the proposed algorithm is significantly better compared with a Lagrange interpolation and with a fixed degree approaches. The obtained results suggest that using statistical information from the polynomial regressions can improve results in a classification task of circadian rhythm data.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"248 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132620947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Scalable Deep Learning for Stress and Affect Detection on Resource-Constrained Devices 资源受限设备上压力和影响检测的可扩展深度学习
Abhijith Ragav, N. H. Krishna, Naveen Narayanan, Kevin Thelly, Vineeth Vijayaraghavan
Psychological stress in human beings has been on a meteoric rise over the last few years. Chronic stress can have fatal consequences such as heart disease, cancer, suicide and so on. It is thus imperative to detect stress early on to prevent health risks. In this work, we discuss efficient and accurate stress and affect detection using scalable Deep Learning methods, that can be used to monitor stress real-time on resource-constrained devices such as low-cost wearables. By making inferences on-device, we solve the issues of high latency and lack of privacy which are prevalent in cloud-based computation. Using the concept of Early Stopping - Multiple Instance Learning, we build specialized models for stress and affect detection for 3 popular datasets in the domain, that have very low inference times but high accuracy. We introduce a metric ηcomp to measure the computational savings from the use of these models. On average, our models show an absolute increase of 10% in overall accuracy over the benchmarks, computational savings of 95.39%, and an 18x reduction in inference times on a Raspberry Pi 3 Model B. This allows for efficient and accurate real-time monitoring of stress on low-cost resource-constrained devices.
在过去的几年里,人类的心理压力一直在迅速上升。慢性压力会导致致命的后果,比如心脏病、癌症、自杀等等。因此,必须及早发现压力,以预防健康风险。在这项工作中,我们讨论了使用可扩展的深度学习方法进行有效和准确的压力和影响检测,该方法可用于实时监测资源受限设备(如低成本可穿戴设备)的压力。通过在设备上进行推断,我们解决了在基于云的计算中普遍存在的高延迟和缺乏隐私的问题。利用早期停止-多实例学习的概念,我们为该领域的3个流行数据集建立了专门的压力和影响检测模型,这些模型具有非常低的推理时间但精度很高。我们引入了一个度量η比较来衡量使用这些模型所节省的计算量。平均而言,我们的模型显示,与基准测试相比,总体精度绝对提高了10%,计算节省了95.39%,在Raspberry Pi 3 Model b上的推理时间减少了18倍。这允许在低成本资源受限的设备上高效、准确地实时监测压力。
{"title":"Scalable Deep Learning for Stress and Affect Detection on Resource-Constrained Devices","authors":"Abhijith Ragav, N. H. Krishna, Naveen Narayanan, Kevin Thelly, Vineeth Vijayaraghavan","doi":"10.1109/ICMLA.2019.00261","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00261","url":null,"abstract":"Psychological stress in human beings has been on a meteoric rise over the last few years. Chronic stress can have fatal consequences such as heart disease, cancer, suicide and so on. It is thus imperative to detect stress early on to prevent health risks. In this work, we discuss efficient and accurate stress and affect detection using scalable Deep Learning methods, that can be used to monitor stress real-time on resource-constrained devices such as low-cost wearables. By making inferences on-device, we solve the issues of high latency and lack of privacy which are prevalent in cloud-based computation. Using the concept of Early Stopping - Multiple Instance Learning, we build specialized models for stress and affect detection for 3 popular datasets in the domain, that have very low inference times but high accuracy. We introduce a metric ηcomp to measure the computational savings from the use of these models. On average, our models show an absolute increase of 10% in overall accuracy over the benchmarks, computational savings of 95.39%, and an 18x reduction in inference times on a Raspberry Pi 3 Model B. This allows for efficient and accurate real-time monitoring of stress on low-cost resource-constrained devices.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115168102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Identifying Laguerre-Gaussian Modes using Convolutional Neural Network 利用卷积神经网络识别拉盖尔-高斯模式
S. Sharifi, Sofia Brown, I. Novikova, E. Mikhailov, G. Veronis, J. Dowling, Y. Banadaki, Elisha Siddiqui, Savannah Cuzzo, N. Bhusal, L. Cohen, Austin T. Kalasky, N. Prajapati, Rachel Soto-Garcia
An automated determination of Laguerre-Gaussian (LG) modes benefits cavity tuning and optical communication. In this paper, we employ machine learning techniques to automatically detect the lowest sixteen LG modes of a laser beam. Convolutional neural networks (CNN) are trained by collecting the experimental and simulated datasets of LG modes that relies only on the intensity images of their unique patterns. We demonstrate that the trained CNN model can detect LG modes with the maximum accuracy greater than 96% after 60 epochs. The study evaluates the CNN's ability to generalize to new data and adapt to experimental conditions.
自动确定拉盖尔-高斯(LG)模式有利于腔调谐和光通信。在本文中,我们采用机器学习技术来自动检测激光束的最低16个LG模式。卷积神经网络(CNN)通过收集LG模式的实验和模拟数据集来训练,这些数据集仅依赖于其独特模式的强度图像。结果表明,经过60次epoch后,训练后的CNN模型可以检测LG模式,最大准确率大于96%。该研究评估了CNN泛化新数据和适应实验条件的能力。
{"title":"Identifying Laguerre-Gaussian Modes using Convolutional Neural Network","authors":"S. Sharifi, Sofia Brown, I. Novikova, E. Mikhailov, G. Veronis, J. Dowling, Y. Banadaki, Elisha Siddiqui, Savannah Cuzzo, N. Bhusal, L. Cohen, Austin T. Kalasky, N. Prajapati, Rachel Soto-Garcia","doi":"10.1109/ICMLA.2019.00088","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00088","url":null,"abstract":"An automated determination of Laguerre-Gaussian (LG) modes benefits cavity tuning and optical communication. In this paper, we employ machine learning techniques to automatically detect the lowest sixteen LG modes of a laser beam. Convolutional neural networks (CNN) are trained by collecting the experimental and simulated datasets of LG modes that relies only on the intensity images of their unique patterns. We demonstrate that the trained CNN model can detect LG modes with the maximum accuracy greater than 96% after 60 epochs. The study evaluates the CNN's ability to generalize to new data and adapt to experimental conditions.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114768197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Classifying, Detecting, and Predicting Infestation Patterns of the Brown Planthopper in Rice Paddies 稻田褐飞虱侵染模式的分类、检测与预测
Christopher G. Harris, Y. Trisyono
The brown planthopper (BPH), Nilaparvata lugens (Stål), is a pest responsible for widespread damage to rice plants throughout South, Southeast, and East Asia. It is estimated that 10-30% of yield loss in rice crops is attributable to the BPH. In this paper, we develop a method to detect and classify the forms of BPH using CNNs and then model the infestation migration patterns of BPH in several rice-growing regions by using a CNN-LSTMs learning model. This prediction model considers inputs such as wind speed and direction, humidity, ambient temperature, the use of pesticides, the form of BPH, strain of rice, and spacing between rice seedlings to make predictions on the spread of BPH infestations over time. The detection and classification model outperformed other known BPH classification models, providing accuracy rates of 89.33%. Our prediction model accurately modeled the BPH-affected area 82.65% of the time (as determined by lamp trap counts). These models can help detect, classify, and model the infestations of other agricultural pests, improving food security for rice, the staple crop that 900 million of the world's poor depend on for most of their calorie intake.
褐飞虱(Nilaparvata lugens)是一种对南亚、东南亚和东亚的水稻植物造成广泛损害的害虫。据估计,水稻作物产量损失的10-30%可归因于BPH。在本文中,我们开发了一种使用cnn检测和分类BPH形式的方法,然后使用CNN-LSTMs学习模型对BPH在几个水稻种植区的侵染迁移模式进行建模。该预测模型考虑了风速和风向、湿度、环境温度、杀虫剂的使用、BPH的形式、水稻品系和水稻幼苗间距等输入,以预测BPH虫害随时间的传播。检测和分类模型优于其他已知的BPH分类模型,准确率为89.33%。我们的预测模型在82.65%的时间内准确地模拟了受生物污染影响的区域(由灯陷阱计数确定)。这些模型可以帮助检测、分类和模拟其他农业害虫的侵害,从而改善大米的粮食安全。世界上9亿贫困人口的大部分热量摄入都依赖于大米这种主要作物。
{"title":"Classifying, Detecting, and Predicting Infestation Patterns of the Brown Planthopper in Rice Paddies","authors":"Christopher G. Harris, Y. Trisyono","doi":"10.1109/ICMLA.2019.00046","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00046","url":null,"abstract":"The brown planthopper (BPH), Nilaparvata lugens (Stål), is a pest responsible for widespread damage to rice plants throughout South, Southeast, and East Asia. It is estimated that 10-30% of yield loss in rice crops is attributable to the BPH. In this paper, we develop a method to detect and classify the forms of BPH using CNNs and then model the infestation migration patterns of BPH in several rice-growing regions by using a CNN-LSTMs learning model. This prediction model considers inputs such as wind speed and direction, humidity, ambient temperature, the use of pesticides, the form of BPH, strain of rice, and spacing between rice seedlings to make predictions on the spread of BPH infestations over time. The detection and classification model outperformed other known BPH classification models, providing accuracy rates of 89.33%. Our prediction model accurately modeled the BPH-affected area 82.65% of the time (as determined by lamp trap counts). These models can help detect, classify, and model the infestations of other agricultural pests, improving food security for rice, the staple crop that 900 million of the world's poor depend on for most of their calorie intake.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134314860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
CausalConvLSTM: Semi-Supervised Log Anomaly Detection Through Sequence Modeling CausalConvLSTM:基于序列建模的半监督日志异常检测
Steven Yen, M. Moh, Teng-Sheng Moh
Computer systems utilize logging to record events of interest. These logs are a rich source of information, and can be analyzed to detect attacks, failures, and many other issues. Due to the automated generation of logs by computer processes, the volume and throughput of logs can be extremely large, limiting the effectiveness of manual analysis. Rule-based systems were introduced to automatically detect issues based on rules written by experts. However, these systems can only detect known issues for which related rules exist in the rule-set. On the other hand, anomaly detection (AD) approaches can detect unknown issues. This is achieved by looking for unusual behaviors significantly different from the norm. In this paper, we target the problem of semi-supervised log anomaly detection, where the only training data available are normal logs from a baseline period. We propose a novel hybrid model called "CausalConvLSTM" for modeling log sequences that takes advantage of Convolutional Neural Network's (CNN) ability to efficiently extract spatial features in a parallel fashion, and Long Short-Term Memory (LSTM) network's superior ability to capture sequential relationships. Another major challenge faced by anomaly detection systems is concept drift, which is the change in normal system behavior over time. We proposed and evaluated concrete strategies for retraining neural-network (NN) anomaly detection systems to adapt to concept drift.
计算机系统利用日志记录感兴趣的事件。这些日志是丰富的信息源,可以对其进行分析以检测攻击、故障和许多其他问题。由于计算机过程自动生成日志,日志的容量和吞吐量可能非常大,从而限制了手动分析的有效性。引入基于规则的系统,根据专家编写的规则自动检测问题。但是,这些系统只能检测规则集中存在相关规则的已知问题。另一方面,异常检测(AD)方法可以检测未知问题。这是通过寻找与规范明显不同的不寻常行为来实现的。在本文中,我们的目标是半监督日志异常检测问题,其中唯一可用的训练数据是来自基线时期的正常日志。我们提出了一种名为“CausalConvLSTM”的新型混合模型,用于对数序列建模,该模型利用了卷积神经网络(CNN)以并行方式有效提取空间特征的能力,以及长短期记忆(LSTM)网络捕获序列关系的优越能力。异常检测系统面临的另一个主要挑战是概念漂移,即正常系统行为随时间的变化。我们提出并评估了再训练神经网络(NN)异常检测系统以适应概念漂移的具体策略。
{"title":"CausalConvLSTM: Semi-Supervised Log Anomaly Detection Through Sequence Modeling","authors":"Steven Yen, M. Moh, Teng-Sheng Moh","doi":"10.1109/ICMLA.2019.00217","DOIUrl":"https://doi.org/10.1109/ICMLA.2019.00217","url":null,"abstract":"Computer systems utilize logging to record events of interest. These logs are a rich source of information, and can be analyzed to detect attacks, failures, and many other issues. Due to the automated generation of logs by computer processes, the volume and throughput of logs can be extremely large, limiting the effectiveness of manual analysis. Rule-based systems were introduced to automatically detect issues based on rules written by experts. However, these systems can only detect known issues for which related rules exist in the rule-set. On the other hand, anomaly detection (AD) approaches can detect unknown issues. This is achieved by looking for unusual behaviors significantly different from the norm. In this paper, we target the problem of semi-supervised log anomaly detection, where the only training data available are normal logs from a baseline period. We propose a novel hybrid model called \"CausalConvLSTM\" for modeling log sequences that takes advantage of Convolutional Neural Network's (CNN) ability to efficiently extract spatial features in a parallel fashion, and Long Short-Term Memory (LSTM) network's superior ability to capture sequential relationships. Another major challenge faced by anomaly detection systems is concept drift, which is the change in normal system behavior over time. We proposed and evaluated concrete strategies for retraining neural-network (NN) anomaly detection systems to adapt to concept drift.","PeriodicalId":436714,"journal":{"name":"2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134318776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
期刊
2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1