首页 > 最新文献

2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)最新文献

英文 中文
Cybersecurity Automated Information Extraction Techniques: Drawbacks of Current Methods, and Enhanced Extractors 网络安全自动信息提取技术:现有方法的缺点,以及增强的提取器
R. A. Bridges, Kelly M. T. Huffer, Corinne L. Jones, Michael D. Iannacone, J. Goodall
We address a crucial element of applied information extraction—accurate identification of basic security entities in text-—by evaluating previous methods and presenting new labelers. Our survey reveals that the previous efforts have not been tested on documents similar to the targeted sources (news articles, blogs, tweets, etc.) and that no sufficiently large publicly available annotated corpus of these documents exists. By assembling a representative test corpus, we perform a quantitative evaluation of previous methods in a realistic setting, revealing an overall lack of recall, and giving insight to the models' beneficial and inhibiting elements. In particular, our results show that many previous efforts overfit to the non-representative test corpora in this domain. Informed by this evaluation, we present three novel cyber entity extractors, which seek to leverage the available labeled data but remain worthwhile on the more diverse documents encountered in the wild. Each new model increases the state of the art in recall, with maximal or near maximal F1 score. Our results establish that the state of the art in cyber entity tagging is characterized by F1 = 0.61.
我们通过评估以前的方法和提出新的标签来解决应用信息提取的一个关键因素-文本中基本安全实体的准确识别。我们的调查显示,之前的努力还没有在与目标来源(新闻文章、博客、tweet等)相似的文档上进行测试,并且没有足够大的公开可用的这些文档的注释语料库。通过组装一个有代表性的测试语料库,我们在一个现实的环境中对以前的方法进行了定量评估,揭示了召回的总体缺乏,并深入了解了模型的有益和抑制因素。特别是,我们的结果表明,许多以前的努力过拟合非代表性的测试语料库在这个领域。根据这一评估,我们提出了三种新的网络实体提取器,它们寻求利用可用的标记数据,但在野外遇到的更多样化的文档上仍然有价值。每个新模型都增加了召回的艺术状态,具有最大或接近最大的F1分数。我们的结果表明,网络实体标签的最新状态的特征是F1 = 0.61。
{"title":"Cybersecurity Automated Information Extraction Techniques: Drawbacks of Current Methods, and Enhanced Extractors","authors":"R. A. Bridges, Kelly M. T. Huffer, Corinne L. Jones, Michael D. Iannacone, J. Goodall","doi":"10.1109/ICMLA.2017.0-122","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-122","url":null,"abstract":"We address a crucial element of applied information extraction—accurate identification of basic security entities in text-—by evaluating previous methods and presenting new labelers. Our survey reveals that the previous efforts have not been tested on documents similar to the targeted sources (news articles, blogs, tweets, etc.) and that no sufficiently large publicly available annotated corpus of these documents exists. By assembling a representative test corpus, we perform a quantitative evaluation of previous methods in a realistic setting, revealing an overall lack of recall, and giving insight to the models' beneficial and inhibiting elements. In particular, our results show that many previous efforts overfit to the non-representative test corpora in this domain. Informed by this evaluation, we present three novel cyber entity extractors, which seek to leverage the available labeled data but remain worthwhile on the more diverse documents encountered in the wild. Each new model increases the state of the art in recall, with maximal or near maximal F1 score. Our results establish that the state of the art in cyber entity tagging is characterized by F1 = 0.61.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"126 1","pages":"437-442"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73727840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
A Novel Application of Naive Bayes Classifier in Photovoltaic Energy Prediction 朴素贝叶斯分类器在光伏能量预测中的新应用
R. Bayindir, M. Yesilbudak, Medine Colak, N. Genç
Solar energy is one of the most affordable and clean renewable energy source in the world. Hence, the solar energy prediction is an inevitable requirement in order to get the maximum solar energy during the day time and to increase the efficiency of solar energy systems. For this purpose, this paper predicts the daily total energy generation of an installed photovoltaic system using the Naïve Bayes classifier. In the prediction process, one-year historical dataset including daily average temperature, daily total sunshine duration, daily total global solar radiation and daily total photovoltaic energy generation parameters are used as the categorical-valued attributes. By means of the Naïve Bayes application, the sensitivity and the accuracy measures are improved for the photovoltaic energy prediction and the effects of other solar attributes on the photovoltaic energy generation are evaluated.
太阳能是世界上最经济、最清洁的可再生能源之一。因此,为了在白天获得最大的太阳能,提高太阳能系统的效率,对太阳能进行预测是必然的要求。为此,本文采用Naïve贝叶斯分类器对已安装光伏系统的日总发电量进行预测。在预测过程中,使用包括日平均气温、日总日照时数、日全球太阳总辐射和日光伏发电总量参数在内的一年历史数据作为分类值属性。通过Naïve贝叶斯应用,提高了光伏能源预测的灵敏度和准确性,并评价了其他太阳能属性对光伏发电的影响。
{"title":"A Novel Application of Naive Bayes Classifier in Photovoltaic Energy Prediction","authors":"R. Bayindir, M. Yesilbudak, Medine Colak, N. Genç","doi":"10.1109/ICMLA.2017.0-108","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-108","url":null,"abstract":"Solar energy is one of the most affordable and clean renewable energy source in the world. Hence, the solar energy prediction is an inevitable requirement in order to get the maximum solar energy during the day time and to increase the efficiency of solar energy systems. For this purpose, this paper predicts the daily total energy generation of an installed photovoltaic system using the Naïve Bayes classifier. In the prediction process, one-year historical dataset including daily average temperature, daily total sunshine duration, daily total global solar radiation and daily total photovoltaic energy generation parameters are used as the categorical-valued attributes. By means of the Naïve Bayes application, the sensitivity and the accuracy measures are improved for the photovoltaic energy prediction and the effects of other solar attributes on the photovoltaic energy generation are evaluated.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"20 1","pages":"523-527"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75157623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Computable Expert Knowledge in Computer Games 计算机游戏中的可计算专家知识
K. Fujii, F. Hsieh, Cho-Jui Hsieh
We algorithmically compute and demonstrate multi-scale expert knowledge of computer gaming through pattern compositions on two levels of heterogeneity. Hierarchical clustering (HC) is applied to construct block-based heatmaps: colored matrices framed by two hierarchical trees imposed upon row and column axes. The computed heterogeneity is seen to induce different collections of viable gaming features pertaining to different map-clusters. On the game level, the map-dependent heterogeneity is seen to reveal which gaming-feature-pattern compositions are indeed viable for wins or losses with near-certainty, and which correspond to 50-50 uncertainty in outcome. Hence, such pattern compositions become the critical knowledge bases for pre-game prediction as well as ongoing-gaming strategy. The computer game, TagPro: Capture the Flag, is used as an illustrating example throughout the development of this paper.
我们通过算法计算和演示计算机游戏的多尺度专家知识,通过在两个异质性水平上的模式组合。分层聚类(HC)用于构建基于块的热图:由行轴和列轴上施加的两个分层树构成的彩色矩阵。计算出的异质性可以诱导出与不同地图集群相关的可行游戏功能的不同集合。在游戏层面上,地图依赖的异质性揭示了哪些游戏特征模式构成确实具有近乎确定性的获胜或失败,哪些对应于50% - 50%的结果不确定性。因此,这种模式组合成为游戏前预测和游戏中策略的关键知识基础。电脑游戏TagPro: Capture The Flag,在整个论文的开发过程中被用作一个说明例子。
{"title":"Computable Expert Knowledge in Computer Games","authors":"K. Fujii, F. Hsieh, Cho-Jui Hsieh","doi":"10.1109/ICMLA.2017.00-69","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.00-69","url":null,"abstract":"We algorithmically compute and demonstrate multi-scale expert knowledge of computer gaming through pattern compositions on two levels of heterogeneity. Hierarchical clustering (HC) is applied to construct block-based heatmaps: colored matrices framed by two hierarchical trees imposed upon row and column axes. The computed heterogeneity is seen to induce different collections of viable gaming features pertaining to different map-clusters. On the game level, the map-dependent heterogeneity is seen to reveal which gaming-feature-pattern compositions are indeed viable for wins or losses with near-certainty, and which correspond to 50-50 uncertainty in outcome. Hence, such pattern compositions become the critical knowledge bases for pre-game prediction as well as ongoing-gaming strategy. The computer game, TagPro: Capture the Flag, is used as an illustrating example throughout the development of this paper.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"99 1","pages":"749-754"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76780777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detection of Exfiltration and Tunneling over DNS DNS的泄漏和隧道检测
Anirban Das, Min-Yi Shen, M. Shashanka, Jisheng Wang
This paper proposes a method to detect two primary means of using the Domain Name System (DNS) for malicious purposes. We develop machine learning models to detect information exfiltration from compromised machines and the establishment of command & control (C&C) servers via tunneling. We validate our approach by experiments where we successfully detect a malware used in several recent Advanced Persistent Threat (APT) attacks [1]. The novelty of our method is its robustness, simplicity, scalability, and ease of deployment in a production environment.
本文提出了一种检测恶意使用域名系统(DNS)的两种主要方式的方法。我们开发了机器学习模型来检测受感染机器的信息泄露,并通过隧道建立命令与控制(C&C)服务器。我们通过实验验证了我们的方法,我们成功检测了最近几次高级持续威胁(APT)攻击b[1]中使用的恶意软件。我们方法的新颖之处在于它的健壮性、简单性、可伸缩性和易于在生产环境中部署。
{"title":"Detection of Exfiltration and Tunneling over DNS","authors":"Anirban Das, Min-Yi Shen, M. Shashanka, Jisheng Wang","doi":"10.1109/ICMLA.2017.00-71","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.00-71","url":null,"abstract":"This paper proposes a method to detect two primary means of using the Domain Name System (DNS) for malicious purposes. We develop machine learning models to detect information exfiltration from compromised machines and the establishment of command & control (C&C) servers via tunneling. We validate our approach by experiments where we successfully detect a malware used in several recent Advanced Persistent Threat (APT) attacks [1]. The novelty of our method is its robustness, simplicity, scalability, and ease of deployment in a production environment.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"33 1","pages":"737-742"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75809124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
Mitigating IoT-based Cyberattacks on the Smart Grid 缓解基于物联网的智能电网网络攻击
Y. Yilmaz, S. Uludag
The impact of cybersecurity attacks on the Smart Grid may cause cyber as well as physical damages, as clearly shown in the recent attacks on the power grid in Ukraine where consumers were left without power. A set of recent successful Distributed Denial-of-Service (DDoS) attacks on the Internet, facilitated by the proliferation of the Internet-of-Things powered botnets, shows that it is just a matter of time before the Smart Grid, as one of the most attractive critical infrastructure systems, becomes the target and likely victim of similar attacks, potentially leaving catastrophic disruption of power service to millions of people. It is in this context that we propose a scalable mitigation approach, referred to as Minimally Invasive Attack Mitigation via Detection Isolation and Localization (MIAMI-DIL), under a hierarchical data collection infrastructure. We provide a proofof- concept by means of simulations which show the efficacy and scalability of the proposed approach.
网络安全攻击对智能电网的影响可能会造成网络和物理损害,最近乌克兰电网遭受的攻击清楚地表明了这一点,消费者无法用电。最近互联网上一系列成功的分布式拒绝服务(DDoS)攻击,由物联网驱动的僵尸网络的扩散推动,表明智能电网作为最具吸引力的关键基础设施系统之一,成为类似攻击的目标和可能的受害者只是时间问题,可能给数百万人的电力服务造成灾难性的中断。正是在这种背景下,我们提出了一种可扩展的缓解方法,称为通过检测隔离和定位的微创攻击缓解(MIAMI-DIL),在分层数据收集基础设施下。通过仿真验证了该方法的有效性和可扩展性。
{"title":"Mitigating IoT-based Cyberattacks on the Smart Grid","authors":"Y. Yilmaz, S. Uludag","doi":"10.1109/ICMLA.2017.0-109","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-109","url":null,"abstract":"The impact of cybersecurity attacks on the Smart Grid may cause cyber as well as physical damages, as clearly shown in the recent attacks on the power grid in Ukraine where consumers were left without power. A set of recent successful Distributed Denial-of-Service (DDoS) attacks on the Internet, facilitated by the proliferation of the Internet-of-Things powered botnets, shows that it is just a matter of time before the Smart Grid, as one of the most attractive critical infrastructure systems, becomes the target and likely victim of similar attacks, potentially leaving catastrophic disruption of power service to millions of people. It is in this context that we propose a scalable mitigation approach, referred to as Minimally Invasive Attack Mitigation via Detection Isolation and Localization (MIAMI-DIL), under a hierarchical data collection infrastructure. We provide a proofof- concept by means of simulations which show the efficacy and scalability of the proposed approach.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"61 1","pages":"517-522"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76811393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Anomaly Detection in Earth Dam and Levee Passive Seismic Data Using Multivariate Gaussian 基于多元高斯分布的土坝、堤被动地震数据异常检测
W. Fisher, B. Jackson, T. Camp, V. Krzhizhanovskaya
As earth dams and levees (EDLs) across the United States reach the end of their design lives, effectively monitoring their structural integrity is of critical importance. This paper investigates automatic detection of anomalous events in passive seismic data as a step towards continuous real-time monitoring of EDL health. We use a multivariate Gaussian machine-learning model to identify anomalies in experimental data from two different laboratory earth embankments. Additionally, we explore five wavelet transform methods for signal denoising; removing different signal components. The best performance is achieved with the Haar wavelets (removing the Level 3 component). We achieve up to 97.3% overall accuracy and less than 1.4% false negatives in anomaly detection. These promising approaches could eventually provide a means for identifying internal erosion events in aging EDLs earlier than is currently possible, thereby allowing more time to prevent or mitigate catastrophic failures.
随着美国各地的土坝和土堤(edl)达到其设计寿命,有效监测其结构完整性至关重要。本文研究了被动地震资料中异常事件的自动检测,作为连续实时监测EDL健康的一步。我们使用多元高斯机器学习模型来识别来自两个不同实验室土堤防的实验数据中的异常。此外,我们还探索了五种小波变换的信号去噪方法;去除不同的信号成分。Haar小波(去除3级分量)实现了最佳性能。在异常检测中,我们达到了97.3%的总体准确率和不到1.4%的假阴性。这些有希望的方法最终可以提供一种方法,可以比目前更早地识别老化edl中的内部侵蚀事件,从而有更多的时间来预防或减轻灾难性故障。
{"title":"Anomaly Detection in Earth Dam and Levee Passive Seismic Data Using Multivariate Gaussian","authors":"W. Fisher, B. Jackson, T. Camp, V. Krzhizhanovskaya","doi":"10.1109/ICMLA.2017.00-81","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.00-81","url":null,"abstract":"As earth dams and levees (EDLs) across the United States reach the end of their design lives, effectively monitoring their structural integrity is of critical importance. This paper investigates automatic detection of anomalous events in passive seismic data as a step towards continuous real-time monitoring of EDL health. We use a multivariate Gaussian machine-learning model to identify anomalies in experimental data from two different laboratory earth embankments. Additionally, we explore five wavelet transform methods for signal denoising; removing different signal components. The best performance is achieved with the Haar wavelets (removing the Level 3 component). We achieve up to 97.3% overall accuracy and less than 1.4% false negatives in anomaly detection. These promising approaches could eventually provide a means for identifying internal erosion events in aging EDLs earlier than is currently possible, thereby allowing more time to prevent or mitigate catastrophic failures.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"41 1","pages":"685-690"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75722328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Multidisciplinary Optimization in Decentralized Reinforcement Learning 分散强化学习中的多学科优化
T. Nguyen, S. Mukhopadhyay
Multidisciplinary Optimization (MDO) is one of the most popular techniques in aerospace engineering, where the system is complex and includes the knowledge from multiple fields. However, according to the best of our knowledge, MDO has not been widely applied in decentralized reinforcement learning (RL) due to the ‘unknown’ nature of the RL problems. In this work, we apply the MDO in decentralized RL. In our MDO design, each learning agent uses system identification to closely approximate the environment and tackle the ‘unknown’ nature of the RL. Then, the agents apply the MDO principles to compute the control solution using Monte Carlo and Markov Decision Process techniques. We examined two options of MDO designs: the multidisciplinary feasible and the individual discipline feasible options, which are suitable for multi-agent learning. Our results show that the MDO individual discipline feasible option could successfully learn how to control the system. The MDO approach shows better performance than the completely decentralization and centralization approaches.
多学科优化(MDO)是航空航天工程中最受欢迎的技术之一,其系统复杂,涉及多个领域的知识。然而,据我们所知,由于RL问题的“未知”性质,MDO尚未广泛应用于分散强化学习(RL)。在这项工作中,我们将MDO应用于去中心化强化学习。在我们的MDO设计中,每个学习代理都使用系统识别来接近环境并解决RL的“未知”性质。然后,智能体应用MDO原理,使用蒙特卡罗和马尔可夫决策过程技术计算控制解。我们考察了适合多智能体学习的两种多学科可行方案和单个学科可行方案。我们的研究结果表明,MDO个体学科可行选项可以成功地学习如何控制系统。MDO方法比完全去中心化和集中化方法表现出更好的性能。
{"title":"Multidisciplinary Optimization in Decentralized Reinforcement Learning","authors":"T. Nguyen, S. Mukhopadhyay","doi":"10.1109/ICMLA.2017.00-63","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.00-63","url":null,"abstract":"Multidisciplinary Optimization (MDO) is one of the most popular techniques in aerospace engineering, where the system is complex and includes the knowledge from multiple fields. However, according to the best of our knowledge, MDO has not been widely applied in decentralized reinforcement learning (RL) due to the ‘unknown’ nature of the RL problems. In this work, we apply the MDO in decentralized RL. In our MDO design, each learning agent uses system identification to closely approximate the environment and tackle the ‘unknown’ nature of the RL. Then, the agents apply the MDO principles to compute the control solution using Monte Carlo and Markov Decision Process techniques. We examined two options of MDO designs: the multidisciplinary feasible and the individual discipline feasible options, which are suitable for multi-agent learning. Our results show that the MDO individual discipline feasible option could successfully learn how to control the system. The MDO approach shows better performance than the completely decentralization and centralization approaches.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"41 1","pages":"779-784"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79898904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recognition of Acoustic Events Using Masked Conditional Neural Networks 基于掩模条件神经网络的声事件识别
Fady Medhat, D. Chesmore, John A. Robinson
Automatic feature extraction using neural networks has accomplished remarkable success for images, but for sound recognition, these models are usually modified to fit the nature of the multi-dimensional temporal representation of the audio signal in spectrograms. This may not efficiently harness the time-frequency representation of the signal. The ConditionaL Neural Network (CLNN) takes into consideration the interrelation between the temporal frames, and the Masked ConditionaL Neural Network (MCLNN) extends upon the CLNN by forcing a systematic sparseness over the network’s weights using a binary mask. The masking allows the network to learn about frequency bands rather than bins, mimicking a filterbank used in signal transformations such as MFCC. Additionally, the Mask is designed to consider various combinations of features, which automates the feature hand-crafting process. We applied the MCLNN for the Environmental Sound Recognition problem using the Urbansound8k, YorNoise, ESC-10 and ESC-50 datasets. The MCLNN have achieved competitive performance compared to state-of-the-art Convolutional Neural Networks and hand-crafted attempts.
使用神经网络的自动特征提取在图像识别方面取得了显著的成功,但对于声音识别,这些模型通常需要修改以适应频谱图中音频信号的多维时间表征的性质。这可能不能有效地利用信号的时频表示。条件神经网络(CLNN)考虑了时间帧之间的相互关系,而掩码条件神经网络(MCLNN)在CLNN的基础上进行了扩展,通过使用二进制掩码强制网络权重的系统稀疏性。屏蔽允许网络学习频带而不是桶,模仿信号转换中使用的滤波器组,如MFCC。此外,掩模的设计考虑了各种特征的组合,使特征手工制作过程自动化。我们使用Urbansound8k, YorNoise, ESC-10和ESC-50数据集将MCLNN应用于环境声音识别问题。与最先进的卷积神经网络和手工制作的尝试相比,MCLNN已经取得了具有竞争力的性能。
{"title":"Recognition of Acoustic Events Using Masked Conditional Neural Networks","authors":"Fady Medhat, D. Chesmore, John A. Robinson","doi":"10.1109/ICMLA.2017.0-158","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-158","url":null,"abstract":"Automatic feature extraction using neural networks has accomplished remarkable success for images, but for sound recognition, these models are usually modified to fit the nature of the multi-dimensional temporal representation of the audio signal in spectrograms. This may not efficiently harness the time-frequency representation of the signal. The ConditionaL Neural Network (CLNN) takes into consideration the interrelation between the temporal frames, and the Masked ConditionaL Neural Network (MCLNN) extends upon the CLNN by forcing a systematic sparseness over the network’s weights using a binary mask. The masking allows the network to learn about frequency bands rather than bins, mimicking a filterbank used in signal transformations such as MFCC. Additionally, the Mask is designed to consider various combinations of features, which automates the feature hand-crafting process. We applied the MCLNN for the Environmental Sound Recognition problem using the Urbansound8k, YorNoise, ESC-10 and ESC-50 datasets. The MCLNN have achieved competitive performance compared to state-of-the-art Convolutional Neural Networks and hand-crafted attempts.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"43 1","pages":"199-206"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80555502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Application of Decision Trees for Detection of Student Dropout Profiles 决策树在学生辍学档案检测中的应用
R. T. Pereira, Javier Caicedo Zambrano
The results of the research project that aims to identify patterns of student dropout from socioeconomic, academic, disciplinary and institutional data of students from undergraduate programs at the University of Nariño from Pasto city (Colombia), using data mining techniques are presented. Built a data repository with the records of students who were admitted in the period from the first half of 2004 and the second semester of 2006. Three complete cohorts were analyzed with an observation period of six years until 2011. Socioeconomic and academic student dropout profiles were discovered using classification technique based on decision trees. The knowledge generated will support effective decision-making of university staff focused to develop policies and strategies related to student retention programs that are currently set.
该研究项目旨在利用数据挖掘技术,从哥伦比亚帕斯托市Nariño大学本科专业学生的社会经济、学术、学科和机构数据中确定学生退学模式。建立了从2004年上半年到2006年下半年录取的学生的数据存储库。三个完整的队列进行了分析,观察期为6年,直到2011年。使用基于决策树的分类技术发现社会经济和学术学生退学档案。所产生的知识将支持大学工作人员有效的决策,专注于制定与当前设置的学生保留计划相关的政策和战略。
{"title":"Application of Decision Trees for Detection of Student Dropout Profiles","authors":"R. T. Pereira, Javier Caicedo Zambrano","doi":"10.1109/ICMLA.2017.0-107","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-107","url":null,"abstract":"The results of the research project that aims to identify patterns of student dropout from socioeconomic, academic, disciplinary and institutional data of students from undergraduate programs at the University of Nariño from Pasto city (Colombia), using data mining techniques are presented. Built a data repository with the records of students who were admitted in the period from the first half of 2004 and the second semester of 2006. Three complete cohorts were analyzed with an observation period of six years until 2011. Socioeconomic and academic student dropout profiles were discovered using classification technique based on decision trees. The knowledge generated will support effective decision-making of university staff focused to develop policies and strategies related to student retention programs that are currently set.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"20 1","pages":"528-531"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87448704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Modelling of Fuzzy Logic Controller of a Maximum Power Point Tracker Based on Artificial Neural Network 基于人工神经网络的最大功率跟踪器模糊控制器建模
R. Benkercha, S. Moulahoum, I. Colak
The Grid Connected Photovoltaic System (GCPV) has become more used system in renewable energy. Several researches have been carried out to improve the efficiency and the decrease of energy losses. One of the important components used to increase the efficiency is the DC/DC boost converter. In this paper, a new hybrid model is proposed to control the DC/DC converter, this new controller is built on the fuzzy logic controller (FLC) and artificial neural network (ANN). The pathway taken to build the model is divided into three steps, the first step is to generate a data based on the FLC, the next step is to choose an ANN structure for modeling the FLC and the last step is the test and the validation of the obtained model. The phase of building an ANN is achieved by supervised learning based on back-propagation algorithm. This algorithm is used to train the ANN model by searching of the optimal weights and thresholds that has been a minimal root mean square error between the FLC output and the ANN model. The validation test was performed with various irradiation values between the both intelligent controllers and classical P&O algorithm simultaneously.
并网光伏发电系统(GCPV)已成为可再生能源领域应用较多的系统。为了提高效率和减少能量损失,进行了一些研究。用于提高效率的重要部件之一是DC/DC升压转换器。本文提出了一种基于模糊逻辑控制器(FLC)和人工神经网络(ANN)的新型DC/DC变换器混合控制模型。构建模型的途径分为三步,第一步是基于FLC生成数据,第二步是选择人工神经网络结构对FLC建模,最后一步是对得到的模型进行测试和验证。构建人工神经网络的阶段是通过基于反向传播算法的监督学习来实现的。该算法通过搜索FLC输出与人工神经网络模型之间的均方根误差最小的最优权值和阈值来训练人工神经网络模型。在智能控制器和经典P&O算法之间同时进行不同辐照值的验证试验。
{"title":"Modelling of Fuzzy Logic Controller of a Maximum Power Point Tracker Based on Artificial Neural Network","authors":"R. Benkercha, S. Moulahoum, I. Colak","doi":"10.1109/ICMLA.2017.0-114","DOIUrl":"https://doi.org/10.1109/ICMLA.2017.0-114","url":null,"abstract":"The Grid Connected Photovoltaic System (GCPV) has become more used system in renewable energy. Several researches have been carried out to improve the efficiency and the decrease of energy losses. One of the important components used to increase the efficiency is the DC/DC boost converter. In this paper, a new hybrid model is proposed to control the DC/DC converter, this new controller is built on the fuzzy logic controller (FLC) and artificial neural network (ANN). The pathway taken to build the model is divided into three steps, the first step is to generate a data based on the FLC, the next step is to choose an ANN structure for modeling the FLC and the last step is the test and the validation of the obtained model. The phase of building an ANN is achieved by supervised learning based on back-propagation algorithm. This algorithm is used to train the ANN model by searching of the optimal weights and thresholds that has been a minimal root mean square error between the FLC output and the ANN model. The validation test was performed with various irradiation values between the both intelligent controllers and classical P&O algorithm simultaneously.","PeriodicalId":6636,"journal":{"name":"2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"68 1","pages":"485-492"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78644867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
期刊
2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1