首页 > 最新文献

CompSciRN: Other Machine Learning (Topic)最新文献

英文 中文
Machine Learning, Market Manipulation and Collusion on Capital Markets: Why the 'Black Box' matters 机器学习,市场操纵和资本市场的勾结:为什么“黑匣子”很重要
Pub Date : 2021-02-19 DOI: 10.2139/ssrn.3788872
Alessio Azzutti, W. Ringe, H. Siegfried Stiehl
This paper offers a novel perspective on the implications of increasingly autonomous and “black box” algorithms, within the ramification of algorithmic trading, for the integrity of capital markets. Artificial intelligence (AI) and particularly its subfield of machine learning (ML) methods have gained immense popularity among the great public and achieved tremendous success in many real-life applications by leading to vast efficiency gains. In the financial trading domain, ML can augment human capabilities in both price prediction, dynamic portfolio optimization, and other financial decision-making tasks. However, thanks to constant progress in the ML technology, the prospect of increasingly capable and autonomous agents to delegate operational tasks and even decision-making is now beyond mere imagination, thus opening up the possibility for approximating (truly) autonomous trading agents anytime soon. Given these spectacular developments, this paper argues that such autonomous algorithmic traders may involve significant risks to market integrity, independent from their human experts, thanks to self-learning capabilities offered by state-of-the-art and innovative ML methods. Using the proprietary trading industry as a case study, we explore emerging threats to the application of established market abuse laws in the event of algorithmic market abuse, by taking an interdisciplinary stance between financial regulation, law & economics, and computational finance. Specifically, our analysis focuses on two emerging market abuse risks by autonomous algorithms: market manipulation and “tacit” collusion. We explore their likelihood to arise on global capital markets and evaluate related social harm as forms of market failures. With these new risks in mind, this paper questions the adequacy of existing regulatory frameworks and enforcement mechanisms, as well as current legal rules on the governance of algorithmic trading, to cope with increasingly autonomous and ubiquitous algorithmic trading systems. It shows how the “black box” nature of specific ML-powered algorithmic trading strategies can subvert existing market abuse laws, which are based upon traditional liability concepts and tests (such as “intent” and “causation”). In concluding, by addressing the shortcomings of the present legal framework, we develop a number of guiding principles to assist legal and policy reform in the spirit of promoting and safeguarding market integrity and safety.
本文提供了一个新的视角,探讨在算法交易的分支范围内,日益自治和“黑箱”算法对资本市场完整性的影响。人工智能(AI),特别是其机器学习(ML)方法的子领域,在公众中获得了极大的普及,并在许多现实生活中的应用中取得了巨大的成功,带来了巨大的效率提升。在金融交易领域,机器学习可以增强人类在价格预测、动态投资组合优化和其他金融决策任务方面的能力。然而,由于机器学习技术的不断进步,越来越有能力和自主的代理来委托操作任务甚至决策的前景现在已经超出了想象,从而开辟了在不久的将来接近(真正的)自主交易代理的可能性。鉴于这些惊人的发展,本文认为,由于最先进和创新的机器学习方法提供的自我学习能力,这种自主算法交易者可能会独立于人类专家,对市场诚信构成重大风险。以自营交易行业为例,我们通过在金融监管、法律与经济学和计算金融之间采取跨学科立场,探讨在算法市场滥用的情况下,对既定市场滥用法律应用的新威胁。具体而言,我们的分析侧重于两种新兴市场滥用风险:市场操纵和“隐性”勾结。我们将探讨它们在全球资本市场上出现的可能性,并评估作为市场失灵形式的相关社会危害。考虑到这些新的风险,本文质疑现有监管框架和执行机制的充分性,以及当前关于算法交易治理的法律规则,以应对日益自治和无处不在的算法交易系统。它展示了特定机器学习驱动的算法交易策略的“黑匣子”性质如何颠覆现有的市场滥用法律,这些法律基于传统的责任概念和测试(如“意图”和“因果关系”)。总之,通过解决现行法律框架的缺陷,我们制定了一些指导原则,以促进和维护市场诚信和安全的精神,协助法律和政策改革。
{"title":"Machine Learning, Market Manipulation and Collusion on Capital Markets: Why the 'Black Box' matters","authors":"Alessio Azzutti, W. Ringe, H. Siegfried Stiehl","doi":"10.2139/ssrn.3788872","DOIUrl":"https://doi.org/10.2139/ssrn.3788872","url":null,"abstract":"This paper offers a novel perspective on the implications of increasingly autonomous and “black box” algorithms, within the ramification of algorithmic trading, for the integrity of capital markets. Artificial intelligence (AI) and particularly its subfield of machine learning (ML) methods have gained immense popularity among the great public and achieved tremendous success in many real-life applications by leading to vast efficiency gains. In the financial trading domain, ML can augment human capabilities in both price prediction, dynamic portfolio optimization, and other financial decision-making tasks. However, thanks to constant progress in the ML technology, the prospect of increasingly capable and autonomous agents to delegate operational tasks and even decision-making is now beyond mere imagination, thus opening up the possibility for approximating (truly) autonomous trading agents anytime soon. \u0000 \u0000Given these spectacular developments, this paper argues that such autonomous algorithmic traders may involve significant risks to market integrity, independent from their human experts, thanks to self-learning capabilities offered by state-of-the-art and innovative ML methods. Using the proprietary trading industry as a case study, we explore emerging threats to the application of established market abuse laws in the event of algorithmic market abuse, by taking an interdisciplinary stance between financial regulation, law & economics, and computational finance. Specifically, our analysis focuses on two emerging market abuse risks by autonomous algorithms: market manipulation and “tacit” collusion. We explore their likelihood to arise on global capital markets and evaluate related social harm as forms of market failures. \u0000 \u0000With these new risks in mind, this paper questions the adequacy of existing regulatory frameworks and enforcement mechanisms, as well as current legal rules on the governance of algorithmic trading, to cope with increasingly autonomous and ubiquitous algorithmic trading systems. It shows how the “black box” nature of specific ML-powered algorithmic trading strategies can subvert existing market abuse laws, which are based upon traditional liability concepts and tests (such as “intent” and “causation”). In concluding, by addressing the shortcomings of the present legal framework, we develop a number of guiding principles to assist legal and policy reform in the spirit of promoting and safeguarding market integrity and safety.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116103962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Nowcasting and Forecasting GDP Growth with Machine-Learning Sentiment Indicators 用机器学习情绪指标预测GDP增长
Pub Date : 2021-02-17 DOI: 10.2139/ssrn.3787570
Oscar Claveria, E. Monte, Salvador Torra
We apply the two-step machine-learning method proposed by Claveria et al. (2021) to generate country-specific sentiment indicators that provide estimates of year-on-year GDP growth rates. In the first step, by means of genetic programming, business and consumer expectations are evolved to derive sentiment indicators for 19 European economies. In the second step, the sentiment indicators are iteratively re-computed and combined each period to forecast yearly growth rates. To assess the performance of the proposed approach, we have designed two out-of-sample experiments: a nowcasting exercise in which we recursively generate estimates of GDP at the end of each quarter using the latest survey data available, and an iterative forecasting exercise for different forecast horizons We found that forecasts generated with the sentiment indicators outperform those obtained with time series models. These results show the potential of the methodology as a predictive tool.
我们应用Claveria等人(2021)提出的两步机器学习方法来生成特定国家的情绪指标,这些指标提供了对年度GDP增长率的估计。第一步,通过遗传编程,企业和消费者的期望得到19个欧洲经济体的情绪指标。在第二步,情绪指标迭代地重新计算,并结合每个时期预测年增长率。为了评估所提出的方法的性能,我们设计了两个样本外实验:一个是临近预测练习,其中我们使用最新的调查数据在每个季度末递归地生成GDP估计值,另一个是不同预测范围的迭代预测练习。我们发现,用情绪指标生成的预测优于用时间序列模型获得的预测。这些结果显示了该方法作为预测工具的潜力。
{"title":"Nowcasting and Forecasting GDP Growth with Machine-Learning Sentiment Indicators","authors":"Oscar Claveria, E. Monte, Salvador Torra","doi":"10.2139/ssrn.3787570","DOIUrl":"https://doi.org/10.2139/ssrn.3787570","url":null,"abstract":"We apply the two-step machine-learning method proposed by Claveria et al. (2021) to generate country-specific sentiment indicators that provide estimates of year-on-year GDP growth rates. In the first step, by means of genetic programming, business and consumer expectations are evolved to derive sentiment indicators for 19 European economies. In the second step, the sentiment indicators are iteratively re-computed and combined each period to forecast yearly growth rates. To assess the performance of the proposed approach, we have designed two out-of-sample experiments: a nowcasting exercise in which we recursively generate estimates of GDP at the end of each quarter using the latest survey data available, and an iterative forecasting exercise for different forecast horizons We found that forecasts generated with the sentiment indicators outperform those obtained with time series models. These results show the potential of the methodology as a predictive tool.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132081113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning for Equity Time Series Prediction 股票时间序列预测的深度学习
Pub Date : 2020-11-23 DOI: 10.2139/ssrn.3735940
Miquel Noguer i Alonso, G. Batres-Estrada, Aymeric Moulin
We examine the performance of Deep Learning methods applied to equity financial time series. Predicting equity time series is a crucial topic in Finance. To form equity portfolios and do asset allocation, we need to predict returns, compute their risk, and optimize market impact. One of the modeling benefits of Deep Learning architectures is the ability to model non-linear highly dimensional problems. The lack of transparency and a rigorous mathematical theory could be considered less positive sides. The fact that most progress in Deep Learning has been made by trial and error is also cumbersome. Equity financial time series is a challenging domain with some stylized facts: weak stationarity, fat tails in return distributions, small data sets compared to other areas of Artificial Intelligence (AI), slow decay of autocorrelation in returns, and volatility clustering, to name the most important ones. We perform a comparative study between Long ShortTerm Memory Networks (LSTM), Recurrent Neural Networks (RNN), Deep Feed-Forward neural networks (DNN), and Gated Recurrent Unit Networks (GRU). We perform two types of studies. The first focused on a univariate test, and the second a multivariate test. Our tests show that the LSTM performs the best compared to other Deep Learning and classical machine learning models. In terms of performance metrics, the LSTM is better than the baseline model. We also show that the predictions are better than chance. There is enough evidence thatRNN and LSTM can deal with stationary time series and learn the data generating process. Nevertheless, predicting equity non-stationary time series, with market developments like the one caused by the COVID-19 pandemic in 2020, is challenging.
我们研究了应用于股票金融时间序列的深度学习方法的性能。股票时间序列预测是金融学中的一个重要课题。为了形成股权投资组合,进行资产配置,我们需要预测收益,计算风险,优化市场影响。深度学习架构的建模优势之一是能够对非线性高维问题进行建模。缺乏透明度和严格的数学理论可以被认为是不太积极的方面。事实上,深度学习的大部分进展都是通过反复试验取得的,这也很麻烦。股票金融时间序列是一个具有挑战性的领域,具有一些程式化的事实:弱平稳性、回报分布的粗尾、与人工智能(AI)的其他领域相比,数据集较小、回报自相关的缓慢衰减、波动性聚类,这些都是最重要的。我们对长短期记忆网络(LSTM)、循环神经网络(RNN)、深度前馈神经网络(DNN)和门控循环单元网络(GRU)进行了比较研究。我们进行两种类型的研究。第一个是单变量测试,第二个是多变量测试。我们的测试表明,与其他深度学习和经典机器学习模型相比,LSTM表现最好。就性能指标而言,LSTM比基线模型更好。我们还表明,预测比机会更好。有足够的证据表明,rnn和LSTM可以处理平稳时间序列并学习数据生成过程。然而,在2020年COVID-19大流行造成的市场发展情况下,预测股票非平稳时间序列是具有挑战性的。
{"title":"Deep Learning for Equity Time Series Prediction","authors":"Miquel Noguer i Alonso, G. Batres-Estrada, Aymeric Moulin","doi":"10.2139/ssrn.3735940","DOIUrl":"https://doi.org/10.2139/ssrn.3735940","url":null,"abstract":"We examine the performance of Deep Learning methods applied to equity financial time series. Predicting equity time series is a crucial topic in Finance. To form equity portfolios and do asset allocation, we need to predict returns, compute their risk, and optimize market impact. One of the modeling benefits of Deep Learning architectures is the ability to model non-linear highly dimensional problems. The lack of transparency and a rigorous mathematical theory could be considered less positive sides. The fact that most progress in Deep Learning has been made by trial and error is also cumbersome. Equity financial time series is a challenging domain with some stylized facts: weak stationarity, fat tails in return distributions, small data sets compared to other areas of Artificial Intelligence (AI), slow decay of autocorrelation in returns, and volatility clustering, to name the most important ones. We perform a comparative study between Long ShortTerm Memory Networks (LSTM), Recurrent Neural Networks (RNN), Deep Feed-Forward neural networks (DNN), and Gated Recurrent Unit Networks (GRU). We perform two types of studies. The first focused on a univariate test, and the second a multivariate test. Our tests show that the LSTM performs the best compared to other Deep Learning and classical machine learning models. In terms of performance metrics, the LSTM is better than the baseline model. We also show that the predictions are better than chance. There is enough evidence thatRNN and LSTM can deal with stationary time series and learn the data generating process. Nevertheless, predicting equity non-stationary time series, with market developments like the one caused by the COVID-19 pandemic in 2020, is challenging.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129745815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
An Exploratory Study in SME’s for Software Defect Prediction 中小企业软件缺陷预测的探索性研究
Pub Date : 2020-11-21 DOI: 10.2139/ssrn.3734911
S. Gollagi, P. Pareek
Software defect prediction is a process of constructing machine learning classifiers to predict defective code snippets, using historical information in software repositories such as code complexity and change records to design software defect metrics , In this research article we have tried to understand the relationships between various variables which are important for IT SME’s ,The study is carried out with the help of a well structured questionnaire using IBM SPSS tool for data analysis and interpretation.
软件缺陷预测是构建机器学习分类器来预测有缺陷的代码片段的过程,使用软件存储库中的历史信息(如代码复杂性和更改记录)来设计软件缺陷度量,在这篇研究文章中,我们试图了解对IT中小企业很重要的各种变量之间的关系,该研究是在使用IBM SPSS工具进行数据分析和解释的结构化问卷的帮助下进行的。
{"title":"An Exploratory Study in SME’s for Software Defect Prediction","authors":"S. Gollagi, P. Pareek","doi":"10.2139/ssrn.3734911","DOIUrl":"https://doi.org/10.2139/ssrn.3734911","url":null,"abstract":"Software defect prediction is a process of constructing machine learning classifiers to predict defective code snippets, using historical information in software repositories such as code complexity and change records to design software defect metrics , In this research article we have tried to understand the relationships between various variables which are important for IT SME’s ,The study is carried out with the help of a well structured questionnaire using IBM SPSS tool for data analysis and interpretation.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"114 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123360575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Asset Allocation via Machine Learning and Applications to Equity Portfolio Management 机器学习的资产配置及其在股票投资组合管理中的应用
Pub Date : 2020-11-01 DOI: 10.2139/ssrn.3722621
Qing Yang, Zhenning Hong, Ruyan Tian, Tingting Ye, Liangliang Zhang
In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology overcomes many major difficulties arising in current optimization schemes. For example, we no longer need to compute the covariance matrix and its inverse for mean-variance optimization, therefore the method is immune from the estimation error on this quantity. Moreover, no explicit calls of optimization routines are needed. Applications to a bottom-up mean-variance-skewness-kurtosis or CRRA (Constant Relative Risk Aversion) optimization with short-sale portfolio constraints in both simulation and real market (China A-shares and U.S. equity markets) environments are studied and shown to perform very well.
在本文中,我们记录了一种新的基于机器学习的自下而上的方法,用于潜在的大量资产的静态和动态投资组合优化。该方法克服了当前优化方案中出现的许多主要困难。例如,我们不再需要计算协方差矩阵及其逆进行均值方差优化,因此该方法不受该量的估计误差的影响。此外,不需要显式调用优化例程。本文研究了在模拟和真实市场(中国a股和美国股票市场)环境下,具有卖空组合约束的自下而上均值-方差-偏度-峰度优化或CRRA(恒定相对风险厌恶)优化的应用,并证明其表现非常好。
{"title":"Asset Allocation via Machine Learning and Applications to Equity Portfolio Management","authors":"Qing Yang, Zhenning Hong, Ruyan Tian, Tingting Ye, Liangliang Zhang","doi":"10.2139/ssrn.3722621","DOIUrl":"https://doi.org/10.2139/ssrn.3722621","url":null,"abstract":"In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology overcomes many major difficulties arising in current optimization schemes. For example, we no longer need to compute the covariance matrix and its inverse for mean-variance optimization, therefore the method is immune from the estimation error on this quantity. Moreover, no explicit calls of optimization routines are needed. Applications to a bottom-up mean-variance-skewness-kurtosis or CRRA (Constant Relative Risk Aversion) optimization with short-sale portfolio constraints in both simulation and real market (China A-shares and U.S. equity markets) environments are studied and shown to perform very well.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124885871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Man(ager Heuristics) vs. Machine (Learning): Automation for Prediction of Customer Value for Brick-and-Mortar Retailers 人(经理启发式)vs.机器(学习):实体零售商客户价值预测的自动化
Pub Date : 2020-10-27 DOI: 10.2139/ssrn.3772725
Emelie Fröberg, S. Rosengren
Technological development has led to rich datasets, fast processing capabilities, and a large body of literature on accurate yet complex models. However, although managers see potential in becoming data-driven, few successfully apply contemporary analytics. In retailing, some of the hurdles are that (a) most applications are for online settings, while most retailing is still conducted in brick-and-mortar settings, (b) predictions of customer lifetime values are less relevant for rapid (automated) actions in real-time, and (c) there is skepticism due to the lack of empirical testing beyond large international firms, tech start-ups, and digital natives. In this study, we attempt to bridge this gap by exploring the potential benefits of automated machine learning compared to manager heuristics in predicting immediate future customer value in real-time, as applied on 338,184 grocery receipts, 179,568 beauty receipts, and 111,289 non-prescription pharmacy receipts. Our results from different retailing industries with various product characteristics in brick-and-mortar contexts show that automated machine learning provides great benefits in predicting immediate future customer value. This suggests that, even with limited know-how, brick-and-mortar retailers can implement contemporary analytics for better customer prioritization in real-time.
技术的发展带来了丰富的数据集,快速的处理能力,以及大量关于精确但复杂模型的文献。然而,尽管管理人员看到了数据驱动的潜力,但很少有人成功应用当代分析。在零售业,一些障碍是:(a)大多数应用程序是在线设置的,而大多数零售仍然在实体店环境中进行;(b)客户生命周期价值的预测与实时快速(自动化)操作的相关性较低;(c)由于缺乏大型国际公司、科技初创企业和数字原住民之外的经验测试,因此存在怀疑。在这项研究中,我们试图通过探索自动化机器学习的潜在优势来弥补这一差距,将其与经理启发式方法进行比较,实时预测未来的客户价值,应用于338,184张杂货收据,179,568张美容收据和111,289张非处方药房收据。我们对实体环境中具有不同产品特征的不同零售行业的研究结果表明,自动化机器学习在预测未来客户价值方面提供了巨大的好处。这表明,即使技术有限,实体零售商也可以实施现代分析,以更好地实时优化客户优先级。
{"title":"Man(ager Heuristics) vs. Machine (Learning): Automation for Prediction of Customer Value for Brick-and-Mortar Retailers","authors":"Emelie Fröberg, S. Rosengren","doi":"10.2139/ssrn.3772725","DOIUrl":"https://doi.org/10.2139/ssrn.3772725","url":null,"abstract":"Technological development has led to rich datasets, fast processing capabilities, and a large body of literature on accurate yet complex models. However, although managers see potential in becoming data-driven, few successfully apply contemporary analytics. In retailing, some of the hurdles are that (a) most applications are for online settings, while most retailing is still conducted in brick-and-mortar settings, (b) predictions of customer lifetime values are less relevant for rapid (automated) actions in real-time, and (c) there is skepticism due to the lack of empirical testing beyond large international firms, tech start-ups, and digital natives. In this study, we attempt to bridge this gap by exploring the potential benefits of automated machine learning compared to manager heuristics in predicting immediate future customer value in real-time, as applied on 338,184 grocery receipts, 179,568 beauty receipts, and 111,289 non-prescription pharmacy receipts. Our results from different retailing industries with various product characteristics in brick-and-mortar contexts show that automated machine learning provides great benefits in predicting immediate future customer value. This suggests that, even with limited know-how, brick-and-mortar retailers can implement contemporary analytics for better customer prioritization in real-time.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129246624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Reinforcement Learning for Asset Allocation in US Equities 美国股票资产配置的深度强化学习
Pub Date : 2020-10-09 DOI: 10.2139/ssrn.3711487
Miquel Noguer i Alonso, Sonam Srivastava
Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of research for financial problems. Asset allocation, where the goal is to obtain the weights of the assets that maximize the rewards in a given state of the market considering risk and transaction costs, is a problem easily framed using a reinforcement learning framework. It is first a prediction problem for expected returns and covariance matrix and then an optimization problem for returns, risk, and market impact. Investors and financial researchers have been working with approaches like mean-variance optimization, minimum variance, risk parity, and equally weighted and several methods to make expected returns and covariance matrices' predictions more robust. This paper demonstrates the application of reinforcement learning to create a financial model-free solution to the asset allocation problem, learning to solve the problem using time series and deep neural networks. We demonstrate this on daily data for the top 24 stocks in the US equities universe with daily rebalancing. We use a deep reinforcement model on US stocks using different architectures. We use Long Short Term Memory networks, Convolutional Neural Networks, and Recurrent Neural Networks and compare them with more traditional portfolio management. The Deep Reinforcement Learning approach shows better results than traditional approaches using a simple reward function and only being given the time series of stocks. In Finance, no training to test error generalization results come guaranteed. We can say that the modeling framework can deal with time series prediction and asset allocation, including transaction costs.
强化学习是一种机器学习方法,通过最大化状态和动作空间中的奖励函数,以几乎无模型的方式解决动态优化问题。这一特性使其成为研究金融问题的一个令人兴奋的领域。资产配置的目标是在考虑风险和交易成本的给定市场状态下获得最大回报的资产权重,这是一个很容易使用强化学习框架构建的问题。首先是预期收益和协方差矩阵的预测问题,然后是收益、风险和市场影响的优化问题。投资者和金融研究人员一直在研究均值方差优化、最小方差、风险平价、等加权等方法,以及几种使预期收益和协方差矩阵的预测更加稳健的方法。本文演示了应用强化学习来创建资产配置问题的金融无模型解决方案,学习使用时间序列和深度神经网络来解决问题。我们通过每日再平衡美国股市中排名前24位的股票的每日数据来证明这一点。我们对美国股票使用不同架构的深度强化模型。我们使用长短期记忆网络、卷积神经网络和循环神经网络,并将它们与更传统的投资组合管理进行比较。深度强化学习方法比使用简单奖励函数和只给定股票时间序列的传统方法显示出更好的结果。在金融领域,没有训练来测试误差泛化结果。我们可以说,建模框架可以处理时间序列预测和资产分配,包括交易成本。
{"title":"Deep Reinforcement Learning for Asset Allocation in US Equities","authors":"Miquel Noguer i Alonso, Sonam Srivastava","doi":"10.2139/ssrn.3711487","DOIUrl":"https://doi.org/10.2139/ssrn.3711487","url":null,"abstract":"Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of research for financial problems. Asset allocation, where the goal is to obtain the weights of the assets that maximize the rewards in a given state of the market considering risk and transaction costs, is a problem easily framed using a reinforcement learning framework. It is first a prediction problem for expected returns and covariance matrix and then an optimization problem for returns, risk, and market impact. Investors and financial researchers have been working with approaches like mean-variance optimization, minimum variance, risk parity, and equally weighted and several methods to make expected returns and covariance matrices' predictions more robust. This paper demonstrates the application of reinforcement learning to create a financial model-free solution to the asset allocation problem, learning to solve the problem using time series and deep neural networks. We demonstrate this on daily data for the top 24 stocks in the US equities universe with daily rebalancing. We use a deep reinforcement model on US stocks using different architectures. We use Long Short Term Memory networks, Convolutional Neural Networks, and Recurrent Neural Networks and compare them with more traditional portfolio management. The Deep Reinforcement Learning approach shows better results than traditional approaches using a simple reward function and only being given the time series of stocks. In Finance, no training to test error generalization results come guaranteed. We can say that the modeling framework can deal with time series prediction and asset allocation, including transaction costs.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131747011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
AAMDRL: Augmented Asset Management With Deep Reinforcement Learning AAMDRL:深度强化学习的增强资产管理
Pub Date : 2020-09-30 DOI: 10.2139/ssrn.3702113
E. Benhamou, D. Saltiel, Sandrine Ungari, Abhishek Mukhopadhyay, J. Atif
Can an agent learn efficiently in a noisy and self adapting environment with sequential, non-stationary and non-homogeneous observations? Through trading bots, we illustrate how Deep Reinforcement Learning (DRL) can tackle this challenge. Our contributions are threefold: (i) the use of contextual information also referred to as augmented state in DRL, (ii) the impact of a one period lag between observations and actions that is more realistic for an asset management environment , (iii) the implementation of a new repetitive train test method called walk forward analysis, similar in spirit to cross validation for time series. Although our experiment is on trading bots, it can easily be translated to other bot environments that operate in sequential environment with regime changes and noisy data. Our experiment for an augmented asset manager interested in finding the best portfolio for hedging strategies shows that AAMDRL achieves superior returns and lower risk.
智能体能否在具有序列、非平稳和非均匀观测的嘈杂和自适应环境中有效地学习?通过交易机器人,我们说明了深度强化学习(DRL)如何解决这一挑战。我们的贡献有三个方面:(i)在DRL中使用上下文信息(也称为增强状态),(ii)在资产管理环境中更现实的观察和行动之间一段时间滞后的影响,(iii)实施一种新的重复训练测试方法,称为向前行走分析,在精神上类似于时间序列的交叉验证。虽然我们的实验是在交易机器人上进行的,但它可以很容易地转换到其他机器人环境中,这些环境在有制度变化和嘈杂数据的顺序环境中运行。我们对一个有兴趣为对冲策略寻找最佳投资组合的增强资产经理进行的实验表明,AAMDRL获得了更高的回报和更低的风险。
{"title":"AAMDRL: Augmented Asset Management With Deep Reinforcement Learning","authors":"E. Benhamou, D. Saltiel, Sandrine Ungari, Abhishek Mukhopadhyay, J. Atif","doi":"10.2139/ssrn.3702113","DOIUrl":"https://doi.org/10.2139/ssrn.3702113","url":null,"abstract":"Can an agent learn efficiently in a noisy and self adapting environment with sequential, non-stationary and non-homogeneous observations? Through trading bots, we illustrate how Deep Reinforcement Learning (DRL) can tackle this challenge. Our contributions are threefold: (i) the use of contextual information also referred to as augmented state in DRL, (ii) the impact of a one period lag between observations and actions that is more realistic for an asset management environment , (iii) the implementation of a new repetitive train test method called walk forward analysis, similar in spirit to cross validation for time series. Although our experiment is on trading bots, it can easily be translated to other bot environments that operate in sequential environment with regime changes and noisy data. Our experiment for an augmented asset manager interested in finding the best portfolio for hedging strategies shows that AAMDRL achieves superior returns and lower risk.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133421527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Reinforcement Learning for Optimal Market Making with the Presence of Rebate 返利条件下最优做市的强化学习
Pub Date : 2020-07-09 DOI: 10.2139/ssrn.3646753
Ge Zhang, Ying Chen
We propose a reinforcement learning (RL) framework to solve the HJB equations of optimal market making with the presence of rebate. As a numerical solution, the RL algorithm successfully mirrors the analytical solutions under the scheme of no rebate and constant rebate. Under the time-dependent rebate scheme, there is no closed form and RL provides a plausible solution. We investigate the numerical performance of the RL solutions in simulations, which show that the RL solutions deliver stable accuracy in various situations and are robust to estimation errors. Moreover, the RL solutions demonstrate the impact of rebate on the behaviour of market makers (MMs) and the quality of market. In particular, the presence of a rebate stimulates MM to quote with narrower spreads on both sides of order books and the rebate is fully transferred to the end customers, which is consistent with the theoretical results in the analytical solutions. It also improves market quality by increasing the total trading volume and providing more terminal wealth to MMs. Finally, the time-dependent rebate scheme is found to be more cost efficient than a constant rebate.
我们提出了一个强化学习(RL)框架来求解存在返利的最优做市HJB方程。RL算法作为数值解,成功地反映了无返利和常返利方案下的解析解。在按时间计算的返利计划下,没有封闭的表格,而RL提供了一个合理的解决方案。我们在仿真中研究了RL解决方案的数值性能,结果表明RL解决方案在各种情况下提供稳定的精度,并且对估计误差具有鲁棒性。此外,RL解决方案证明了回扣对做市商(mm)行为和市场质量的影响。特别是,折扣的存在刺激MM在订单两侧的价差更小,折扣完全转移给最终客户,这与解析解中的理论结果一致。它还通过增加总交易量和为mm提供更多终端财富来提高市场质量。最后,发现时间相关的返利方案比固定返利方案更具成本效益。
{"title":"Reinforcement Learning for Optimal Market Making with the Presence of Rebate","authors":"Ge Zhang, Ying Chen","doi":"10.2139/ssrn.3646753","DOIUrl":"https://doi.org/10.2139/ssrn.3646753","url":null,"abstract":"We propose a reinforcement learning (RL) framework to solve the HJB equations of optimal market making with the presence of rebate. As a numerical solution, the RL algorithm successfully mirrors the analytical solutions under the scheme of no rebate and constant rebate. Under the time-dependent rebate scheme, there is no closed form and RL provides a plausible solution. We investigate the numerical performance of the RL solutions in simulations, which show that the RL solutions deliver stable accuracy in various situations and are robust to estimation errors. Moreover, the RL solutions demonstrate the impact of rebate on the behaviour of market makers (MMs) and the quality of market. In particular, the presence of a rebate stimulates MM to quote with narrower spreads on both sides of order books and the rebate is fully transferred to the end customers, which is consistent with the theoretical results in the analytical solutions. It also improves market quality by increasing the total trading volume and providing more terminal wealth to MMs. Finally, the time-dependent rebate scheme is found to be more cost efficient than a constant rebate.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133425912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Early Maintenance and Diagnosis of Connected Machines Using Machine Learning 使用机器学习的互联机器的早期维护和诊断
Pub Date : 2020-06-30 DOI: 10.34218/ijeet.11.4.2020.046
R Srivatsan Sharath Cherian Thomas, V. P, Ravi Kumar C. V
In this paper a novel system is proposed to monitor the health of industrial machines thus helping in their maintenance and early failure detection. This will help in prediction of when an industrial machine or its part will malfunction based on the data extracted from it. We will be able to replace the part or the machine in advance before any production lines get affected. This way resources will be saved and also cost of maintenance will be reduced. On top of this it is not possible to always manually monitor machines placed in remote areas like motors and pumps in water supply systems, sewage plants and chemical plants but our system would be able to not just monitor the machines but also predict the machine’s current health. The proposal encompasses a lightweight machine monitoring system for next generation M2M ecosystem for on the fly fault detection and diagnosis.
本文提出了一种监测工业机器健康状况的新系统,从而有助于工业机器的维护和早期故障检测。这将有助于根据从中提取的数据预测工业机器或其部件何时会发生故障。我们可以在任何生产线受到影响之前提前更换零件或机器。这种方式将节省资源,也将降低维护成本。最重要的是,不可能总是手动监控放置在偏远地区的机器,如供水系统、污水处理厂和化工厂的电机和泵,但我们的系统不仅可以监控机器,还可以预测机器当前的健康状况。该提案包括用于下一代M2M生态系统的轻型机器监控系统,用于动态故障检测和诊断。
{"title":"Early Maintenance and Diagnosis of Connected Machines Using Machine Learning","authors":"R Srivatsan Sharath Cherian Thomas, V. P, Ravi Kumar C. V","doi":"10.34218/ijeet.11.4.2020.046","DOIUrl":"https://doi.org/10.34218/ijeet.11.4.2020.046","url":null,"abstract":"In this paper a novel system is proposed to monitor the health of industrial machines thus helping in their maintenance and early failure detection. This will help in prediction of when an industrial machine or its part will malfunction based on the data extracted from it. We will be able to replace the part or the machine in advance before any production lines get affected. This way resources will be saved and also cost of maintenance will be reduced. On top of this it is not possible to always manually monitor machines placed in remote areas like motors and pumps in water supply systems, sewage plants and chemical plants but our system would be able to not just monitor the machines but also predict the machine’s current health. The proposal encompasses a lightweight machine monitoring system for next generation M2M ecosystem for on the fly fault detection and diagnosis.","PeriodicalId":406435,"journal":{"name":"CompSciRN: Other Machine Learning (Topic)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125274404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
CompSciRN: Other Machine Learning (Topic)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1