T. Shibayama, N. Mizuno, H. Kusano, A. Kinoshita, M. Minegishi, R. Sakamoto, K. Hasegawa, F. Kachi
{"title":"使用神经结构搜索和灵活的训练数据集生成器的实用深度学习反演","authors":"T. Shibayama, N. Mizuno, H. Kusano, A. Kinoshita, M. Minegishi, R. Sakamoto, K. Hasegawa, F. Kachi","doi":"10.3997/2214-4609.202112777","DOIUrl":null,"url":null,"abstract":"Summary Deep learning has the potential to estimate velocity models directly from shot gathers, which would reduce the turn-around time of seismic inversion. Our study addresses two challenges in implementing deep learning techniques for seismic inversion: the practical generation of a large amount of training data and the search for the best neural network architecture. First, we propose a flexible system which parametrically generates velocity models to create a large-scale, complex and fully synthetic training dataset, without using a target subsurface model. Using this system, we created 300,000 synthetic velocity models for our experiments. Second, we employ neural architecture search techniques to design a suitable neural network using Optuna, an automatic hyperparameter optimisation framework. We incorporated the residual network into an encoder–decoder model and optimised its architecture. Thus, we obtained an optimal neural network model consisting of more than 100 hidden layers. We evaluated our model using the Marmousi2 model and the 1994 Amoco statics test dataset. The model demonstrated comprehensible estimations of the benchmark velocity models.","PeriodicalId":143998,"journal":{"name":"82nd EAGE Annual Conference & Exhibition","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Practical deep learning inversion using neural architecture search and a flexible training dataset generator\",\"authors\":\"T. Shibayama, N. Mizuno, H. Kusano, A. Kinoshita, M. Minegishi, R. Sakamoto, K. Hasegawa, F. Kachi\",\"doi\":\"10.3997/2214-4609.202112777\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Summary Deep learning has the potential to estimate velocity models directly from shot gathers, which would reduce the turn-around time of seismic inversion. Our study addresses two challenges in implementing deep learning techniques for seismic inversion: the practical generation of a large amount of training data and the search for the best neural network architecture. First, we propose a flexible system which parametrically generates velocity models to create a large-scale, complex and fully synthetic training dataset, without using a target subsurface model. Using this system, we created 300,000 synthetic velocity models for our experiments. Second, we employ neural architecture search techniques to design a suitable neural network using Optuna, an automatic hyperparameter optimisation framework. We incorporated the residual network into an encoder–decoder model and optimised its architecture. Thus, we obtained an optimal neural network model consisting of more than 100 hidden layers. We evaluated our model using the Marmousi2 model and the 1994 Amoco statics test dataset. The model demonstrated comprehensible estimations of the benchmark velocity models.\",\"PeriodicalId\":143998,\"journal\":{\"name\":\"82nd EAGE Annual Conference & Exhibition\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"82nd EAGE Annual Conference & Exhibition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3997/2214-4609.202112777\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"82nd EAGE Annual Conference & Exhibition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3997/2214-4609.202112777","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Practical deep learning inversion using neural architecture search and a flexible training dataset generator
Summary Deep learning has the potential to estimate velocity models directly from shot gathers, which would reduce the turn-around time of seismic inversion. Our study addresses two challenges in implementing deep learning techniques for seismic inversion: the practical generation of a large amount of training data and the search for the best neural network architecture. First, we propose a flexible system which parametrically generates velocity models to create a large-scale, complex and fully synthetic training dataset, without using a target subsurface model. Using this system, we created 300,000 synthetic velocity models for our experiments. Second, we employ neural architecture search techniques to design a suitable neural network using Optuna, an automatic hyperparameter optimisation framework. We incorporated the residual network into an encoder–decoder model and optimised its architecture. Thus, we obtained an optimal neural network model consisting of more than 100 hidden layers. We evaluated our model using the Marmousi2 model and the 1994 Amoco statics test dataset. The model demonstrated comprehensible estimations of the benchmark velocity models.