This paper presents the basic quantum reinforcement learning theory and its applications to various engineering problems. With the advances in quantum computing and deep learning technologies, various research works have focused on quantum deep learning and quantum machine learning. In this paper, quantum neural network (QNN)-based reinforcement learning (RL) models are discussed and introduced. Moreover, the pros of the QNN-based RL algorithms and models, such as fast training, high scalability, and efficient learning parameter utilization, are presented along with various research results. In addition, one of the well-known multi-agent extensions of QNN-based RL models, the quantum centralized-critic and multiple-actor network, is also discussed and its applications to multi-agent cooperation and coordination are introduced. Finally, the applications and future research directions are introduced and discussed in terms of federated learning, split learning, autonomous control, and quantum deep learning software testing.
{"title":"Trends in quantum reinforcement learning: State-of-the-arts and the road ahead","authors":"Soohyun Park, Joongheon Kim","doi":"10.4218/etrij.2024-0153","DOIUrl":"https://doi.org/10.4218/etrij.2024-0153","url":null,"abstract":"<p>This paper presents the basic quantum reinforcement learning theory and its applications to various engineering problems. With the advances in quantum computing and deep learning technologies, various research works have focused on quantum deep learning and quantum machine learning. In this paper, quantum neural network (QNN)-based reinforcement learning (RL) models are discussed and introduced. Moreover, the pros of the QNN-based RL algorithms and models, such as fast training, high scalability, and efficient learning parameter utilization, are presented along with various research results. In addition, one of the well-known multi-agent extensions of QNN-based RL models, the quantum centralized-critic and multiple-actor network, is also discussed and its applications to multi-agent cooperation and coordination are introduced. Finally, the applications and future research directions are introduced and discussed in terms of federated learning, split learning, autonomous control, and quantum deep learning software testing.</p>","PeriodicalId":11901,"journal":{"name":"ETRI Journal","volume":"46 5","pages":"748-758"},"PeriodicalIF":1.3,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.4218/etrij.2024-0153","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142524655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dong-sheng Xu, Li-tian Wang, Li-rong Qian, Cui-ping Li, Ya-hui Tian, Hong-lang Li, Xuan Chen, Yu-qi Li
In this paper, a novel dual-band wideband bandpass filter (BPF) based on transversal signal-interaction concepts with a wide upper stopband is proposed and investigated. The designed specification of two passbands can be managed and satisfied based on the independent controllable fractional bandwidth of the two passbands and the centered frequencies. The centered frequencies of dual-band BPF are, respectively, 0.79 GHz (ƒ1) and 1.24 GHz (ƒ2) with 3 dB fraction bandwidths of 26.54% and 11.3%. Two transmission paths consisting of coupled stub-loaded square ring resonators and anti-coupled shorted lines are used to realize signal cancellation of multiple transmission path signal transmission from Port 1 to Port 2. Eleven transmission zeros (TZs) modify harmonic suppression up to 10 ƒ1 with stopband rejection higher than 15 dB. Butterworth lumped notch network and step impedance resonator (SIR) are also utilized to improve the selectivity and harmonic suppression. A compact filter with a circuit size of 0.08λg × 0.08λg is implemented and tested. Good agreement between simulation and measured results verifies the reliability of the designing scheme.
{"title":"A compact dual-band bandpass filter based on coupled stub-loaded square ring resonators by using transversal signal-interaction concepts","authors":"Dong-sheng Xu, Li-tian Wang, Li-rong Qian, Cui-ping Li, Ya-hui Tian, Hong-lang Li, Xuan Chen, Yu-qi Li","doi":"10.4218/etrij.2023-0338","DOIUrl":"https://doi.org/10.4218/etrij.2023-0338","url":null,"abstract":"<p>In this paper, a novel dual-band wideband bandpass filter (BPF) based on transversal signal-interaction concepts with a wide upper stopband is proposed and investigated. The designed specification of two passbands can be managed and satisfied based on the independent controllable fractional bandwidth of the two passbands and the centered frequencies. The centered frequencies of dual-band BPF are, respectively, 0.79 GHz (ƒ<sub>1</sub>) and 1.24 GHz (ƒ<sub>2</sub>) with 3 dB fraction bandwidths of 26.54% and 11.3%. Two transmission paths consisting of coupled stub-loaded square ring resonators and anti-coupled shorted lines are used to realize signal cancellation of multiple transmission path signal transmission from Port 1 to Port 2. Eleven transmission zeros (TZs) modify harmonic suppression up to 10 ƒ<sub>1</sub> with stopband rejection higher than 15 dB. Butterworth lumped notch network and step impedance resonator (SIR) are also utilized to improve the selectivity and harmonic suppression. A compact filter with a circuit size of 0.08<i>λ</i>g × 0.08<i>λ</i>g is implemented and tested. Good agreement between simulation and measured results verifies the reliability of the designing scheme.</p>","PeriodicalId":11901,"journal":{"name":"ETRI Journal","volume":"46 6","pages":"1113-1124"},"PeriodicalIF":1.3,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.4218/etrij.2023-0338","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142862320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
As technology advances, smart homes are being increasingly adopted, thus generating massive data that pose new research challenges. We propose a machine learning framework for monitoring energy consumption in smart home devices. The proposed framework involves an anomaly detection module, followed by a predictive model to forecast energy consumption patterns in a typical smart home. We employ three outlier-based techniques for anomaly detection: (1) local outlier factor, (2) connectivity-based outlier factor, and (3) cluster-based local outlier factor. Furthermore, we apply random forest, linear regression, decision tree, and the ensemble techniques of adaptive, gradient, and extreme gradient boosting to anomaly free data to develop baseline models that predict the energy consumption patterns of smart home devices. The framework is evaluated on three publicly available energy datasets collected from various smart homes. The experimental results reveal that the cluster-based local outlier factor with extreme gradient boosting achieves promising results with high prediction accuracy.
{"title":"Anomaly detection and prediction of energy consumption for smart homes using machine learning","authors":"Anitha Ambat, Jayakrushna Sahoo","doi":"10.4218/etrij.2023-0155","DOIUrl":"https://doi.org/10.4218/etrij.2023-0155","url":null,"abstract":"<p>As technology advances, smart homes are being increasingly adopted, thus generating massive data that pose new research challenges. We propose a machine learning framework for monitoring energy consumption in smart home devices. The proposed framework involves an anomaly detection module, followed by a predictive model to forecast energy consumption patterns in a typical smart home. We employ three outlier-based techniques for anomaly detection: (1) local outlier factor, (2) connectivity-based outlier factor, and (3) cluster-based local outlier factor. Furthermore, we apply random forest, linear regression, decision tree, and the ensemble techniques of adaptive, gradient, and extreme gradient boosting to anomaly free data to develop baseline models that predict the energy consumption patterns of smart home devices. The framework is evaluated on three publicly available energy datasets collected from various smart homes. The experimental results reveal that the cluster-based local outlier factor with extreme gradient boosting achieves promising results with high prediction accuracy.</p>","PeriodicalId":11901,"journal":{"name":"ETRI Journal","volume":"47 5","pages":"934-945"},"PeriodicalIF":1.6,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.4218/etrij.2023-0155","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145335930","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Harisu Abdullahi Shehu, Ibrahim Furkan Ince, Faruk Bulut
The eye socket is a cavity in the skull that encloses the eyeball and its surrounding muscles. It has unique shapes in individuals. This study proposes a new recognition method that relies on the eye socket shape and region. This method involves the utilization of an inverse histogram fusion image to generate Gabor features from the identified eye socket regions. These Gabor features are subsequently transformed into Gabor images and employed for recognition by utilizing both traditional methods and deep-learning models. Four distinct benchmark datasets (Flickr30, BioID, Masked AT & T, and CK+) were used to evaluate the method's performance. These datasets encompass a range of perspectives, including variations in eye shape, covering, and angles. Experimental results and comparative studies indicate that the proposed method achieved a significantly (