异常检测使用自动编码器与网络分析功能

ORiON Pub Date : 2023-01-01 DOI:10.5784/39-1-711
Richard Ball, L. Drevin
{"title":"异常检测使用自动编码器与网络分析功能","authors":"Richard Ball, L. Drevin","doi":"10.5784/39-1-711","DOIUrl":null,"url":null,"abstract":"Fraudulent activity within a financial ecosystem often involves the coordinated efforts of several bad actors. Expressing the interactions between participants in a system as a mathematical graph allows researchers to apply social network analysis to understand the nature of these relationships better. This article proposes and extends a unified approach using an autoencoder to detect anomalies in a transactional setting. The methodology begins with a neural architecture search to determine a best autoencoder model architecture configuration. This is followed by a threshold optimisation process to find a reconstruction error that best discriminates between normal and anomalous classes. Gaussian scaling is applied to the raw anomaly scores in order to represent the output in an interpretable and universally transferable form. The unified approach is extended by selecting and including network metrics as features, for the purposes of producing a model that can detect anomalies from both standard transactional data and network data representing the relationships between users within a financial system. Applying SHAP on the model output highlighted the strongest contributing or offsetting network metric features for all anomalies detected. The PageRank and degree centrality network metrics were most significant in detecting anomalous instances within the data. Including network metrics in the feature space generated encouraging model performance results, leading to a potential low operational cost of fraud.","PeriodicalId":30587,"journal":{"name":"ORiON","volume":"41 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Anomaly detection using autoencoders with network analysis features\",\"authors\":\"Richard Ball, L. Drevin\",\"doi\":\"10.5784/39-1-711\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Fraudulent activity within a financial ecosystem often involves the coordinated efforts of several bad actors. Expressing the interactions between participants in a system as a mathematical graph allows researchers to apply social network analysis to understand the nature of these relationships better. This article proposes and extends a unified approach using an autoencoder to detect anomalies in a transactional setting. The methodology begins with a neural architecture search to determine a best autoencoder model architecture configuration. This is followed by a threshold optimisation process to find a reconstruction error that best discriminates between normal and anomalous classes. Gaussian scaling is applied to the raw anomaly scores in order to represent the output in an interpretable and universally transferable form. The unified approach is extended by selecting and including network metrics as features, for the purposes of producing a model that can detect anomalies from both standard transactional data and network data representing the relationships between users within a financial system. Applying SHAP on the model output highlighted the strongest contributing or offsetting network metric features for all anomalies detected. The PageRank and degree centrality network metrics were most significant in detecting anomalous instances within the data. Including network metrics in the feature space generated encouraging model performance results, leading to a potential low operational cost of fraud.\",\"PeriodicalId\":30587,\"journal\":{\"name\":\"ORiON\",\"volume\":\"41 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ORiON\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5784/39-1-711\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ORiON","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5784/39-1-711","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

金融生态系统中的欺诈活动通常涉及几个不良行为者的协调努力。将系统中参与者之间的相互作用表达为数学图,使研究人员能够应用社会网络分析来更好地理解这些关系的本质。本文提出并扩展了一种使用自动编码器检测事务设置中的异常的统一方法。该方法从神经结构搜索开始,以确定最佳的自编码器模型结构配置。接下来是阈值优化过程,以找到最能区分正常和异常类的重建错误。为了以一种可解释和普遍可转移的形式表示输出,对原始异常分数应用高斯缩放。通过选择和包括网络度量作为特征来扩展统一的方法,以便生成一个模型,该模型可以从表示金融系统内用户之间关系的标准事务数据和网络数据中检测异常情况。在模型输出上应用SHAP,突出了所有检测到的异常的最强贡献或抵消网络度量特征。PageRank和度中心性网络指标在检测数据中的异常实例方面最为显著。在特征空间中包含网络指标会产生令人鼓舞的模型性能结果,从而导致潜在的低操作成本欺诈。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Anomaly detection using autoencoders with network analysis features
Fraudulent activity within a financial ecosystem often involves the coordinated efforts of several bad actors. Expressing the interactions between participants in a system as a mathematical graph allows researchers to apply social network analysis to understand the nature of these relationships better. This article proposes and extends a unified approach using an autoencoder to detect anomalies in a transactional setting. The methodology begins with a neural architecture search to determine a best autoencoder model architecture configuration. This is followed by a threshold optimisation process to find a reconstruction error that best discriminates between normal and anomalous classes. Gaussian scaling is applied to the raw anomaly scores in order to represent the output in an interpretable and universally transferable form. The unified approach is extended by selecting and including network metrics as features, for the purposes of producing a model that can detect anomalies from both standard transactional data and network data representing the relationships between users within a financial system. Applying SHAP on the model output highlighted the strongest contributing or offsetting network metric features for all anomalies detected. The PageRank and degree centrality network metrics were most significant in detecting anomalous instances within the data. Including network metrics in the feature space generated encouraging model performance results, leading to a potential low operational cost of fraud.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
11
期刊最新文献
Route overlap metrics to batch orders Anomaly detection using autoencoders with network analysis features On the calibration of stochastic volatility models to estimate the real-world measure used in option pricing Celebrating 50-years of OR in South Africa – a Bibliometric Analysis of contributions to International OR Literature Comments: Development of an early career academic supervisor in Statistics - a discussion on a guiding rubric
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1