Pub Date : 2023-01-01DOI: 10.12700/aph.20.9.2023.9.10
Ahmad Reda, Rabab Benotsmane, Ahmed Bouzid, József Vásárhelyi
: Developing autonomous vehicles is a highly important topic in the field of intelligent transportation systems. Automated steering is a crucial function in the autonomous vehicle. Therefore, it is urgent to either develop a new effective control strategy or improve existing ones. A variety of control strategies are used for this purpose, most with limitations related to their computing capabilities with the highly complex systems or to lack of efficacy related to maintaining the balance between driving performance and driving smoothness. In this paper, three different machine learning-based models were developed to perform an autonomous driving task: a supervised learning model (Deep Neural Network, DNN), a reinforcement Deep Q-learning model (DQN), and a hybrid model. The DNN model was trained based on the behavior of the classical MPC controller. The DQN was designed with the same structure as the DNN and trained by directly interacting with the driving environment. The hybrid model is a combination of supervised and reinforcement learning algorithms, where the trained DNN model is used as a decision-maker (Actor) in a deep deterministic policy gradient reinforcement learning model. The behavior of the designed models was compared based on several performance indicators, including the ability to drive the vehicle along the desired trajectory, the response time, and the smoothness of the driving system. The results show that the DNN model was able to imitate the behavior of the traditional MP Controller efficiently and all three machine learning models successfully drive the vehicle along the desired path. The hybrid model achieves the best results and improved the smoothness of the driving system with a reasonable response time.
{"title":"A Hybrid Machine Learning-based Control Strategy for Autonomous Driving Optimization","authors":"Ahmad Reda, Rabab Benotsmane, Ahmed Bouzid, József Vásárhelyi","doi":"10.12700/aph.20.9.2023.9.10","DOIUrl":"https://doi.org/10.12700/aph.20.9.2023.9.10","url":null,"abstract":": Developing autonomous vehicles is a highly important topic in the field of intelligent transportation systems. Automated steering is a crucial function in the autonomous vehicle. Therefore, it is urgent to either develop a new effective control strategy or improve existing ones. A variety of control strategies are used for this purpose, most with limitations related to their computing capabilities with the highly complex systems or to lack of efficacy related to maintaining the balance between driving performance and driving smoothness. In this paper, three different machine learning-based models were developed to perform an autonomous driving task: a supervised learning model (Deep Neural Network, DNN), a reinforcement Deep Q-learning model (DQN), and a hybrid model. The DNN model was trained based on the behavior of the classical MPC controller. The DQN was designed with the same structure as the DNN and trained by directly interacting with the driving environment. The hybrid model is a combination of supervised and reinforcement learning algorithms, where the trained DNN model is used as a decision-maker (Actor) in a deep deterministic policy gradient reinforcement learning model. The behavior of the designed models was compared based on several performance indicators, including the ability to drive the vehicle along the desired trajectory, the response time, and the smoothness of the driving system. The results show that the DNN model was able to imitate the behavior of the traditional MP Controller efficiently and all three machine learning models successfully drive the vehicle along the desired path. The hybrid model achieves the best results and improved the smoothness of the driving system with a reasonable response time.","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135262759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.9.2023.9.1
Éva Szendrő, Zoltán Lakner
{"title":"The Long-Range Macroeconomic Effects of Sars-Covid-19 Pandemic in Hungary: a Conceptual Framework and Methodology - Focusing Approach","authors":"Éva Szendrő, Zoltán Lakner","doi":"10.12700/aph.20.9.2023.9.1","DOIUrl":"https://doi.org/10.12700/aph.20.9.2023.9.1","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"2015 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135750356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.1.2023.20.12
M. Habashneh, M. M. Rad, S. Fischer
{"title":"Bi-directional Evolutionary, Reliability-based, Geometrically Nonlinear, Elasto-Plastic Topology Optimization, of 3D Structures","authors":"M. Habashneh, M. M. Rad, S. Fischer","doi":"10.12700/aph.20.1.2023.20.12","DOIUrl":"https://doi.org/10.12700/aph.20.1.2023.20.12","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66132223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.2.2023.2.12
Csaba Bogdán, A. Magony, W. Birkfellner, A. Antal, M. Tunyogi-Csapó
{"title":"Segmentation of Moiré Fringes of Scoliotic Spines Using Filtering and Morphological Operations","authors":"Csaba Bogdán, A. Magony, W. Birkfellner, A. Antal, M. Tunyogi-Csapó","doi":"10.12700/aph.20.2.2023.2.12","DOIUrl":"https://doi.org/10.12700/aph.20.2.2023.2.12","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66133557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.4.2023.4.5
Ali H. Alhilfi, E. Ruszinkó
{"title":"Effect of Ultrasound on the Austenite Transformation of Shape Memory Alloys","authors":"Ali H. Alhilfi, E. Ruszinkó","doi":"10.12700/aph.20.4.2023.4.5","DOIUrl":"https://doi.org/10.12700/aph.20.4.2023.4.5","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66135647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.1.2023.20.3
H. Ismail, M. Bruggi, J. Lógó
{"title":"Topology Optimization for Loads with Multiple Points of Application","authors":"H. Ismail, M. Bruggi, J. Lógó","doi":"10.12700/aph.20.1.2023.20.3","DOIUrl":"https://doi.org/10.12700/aph.20.1.2023.20.3","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"14 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66132841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.1.2023.20.4
S. Khaleel Ibrahim, M. M. Rad, S. Fischer
{"title":"Optimal Elasto-Plastic Analysis of Reinforced Concrete Structures under Residual Plastic Deformation Limitations","authors":"S. Khaleel Ibrahim, M. M. Rad, S. Fischer","doi":"10.12700/aph.20.1.2023.20.4","DOIUrl":"https://doi.org/10.12700/aph.20.1.2023.20.4","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66132961","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.12700/aph.20.1.2023.20.7
M. Tica, Željko Vrcan, S. Troha, D. Marinković
{"title":"Reversible Planetary Gearsets Controlled by Two Brakes, for Internal Combustion Railway Vehicle Transmission Applications","authors":"M. Tica, Željko Vrcan, S. Troha, D. Marinković","doi":"10.12700/aph.20.1.2023.20.7","DOIUrl":"https://doi.org/10.12700/aph.20.1.2023.20.7","url":null,"abstract":"","PeriodicalId":50884,"journal":{"name":"Acta Polytechnica Hungarica","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66133041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}