首页 > 最新文献

Frontiers of Information Technology & Electronic Engineering最新文献

英文 中文
A high-isolation coupled-fed building block for metal-rimmed 5G smartphones 用于金属边框 5G 智能手机的高隔离耦合馈电构件
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300203
Aidi Ren, Chengwei Yu, Lixia Yang, Wei Cui, Zhixiang Huang, Ying Liu

A compact coupled-fed dual-antenna building block has been constructed in this study. The building block is simple in structure and easy to process, and has a high degree of isolation. The dual-antenna building block is composed of a coupled-fed loop antenna and a coupled-fed slot antenna that completely overlap. Based on this dual-antenna module, an eight-element MIMO system is designed, and the fabricated eight-element MIMO array is measured. The measured isolation of the designed eight-element MIMO system is >18.5 dB without any decoupling element. In addition, the MIMO array has good measured efficiencies, with a measured efficiency variation range of 43%–54% in the entire working frequency band. The measured ECC of the MIMO system is <0.02. Therefore, the designed MIMO array has great potential in 5G metal-rimmed mobile phone applications.

本研究构建了一个紧凑型耦合馈电双天线构件。该构件结构简单,易于加工,具有很高的隔离度。双天线构件由完全重叠的耦合馈电环形天线和耦合馈电槽形天线组成。基于该双天线模块,设计了一个八元 MIMO 系统,并对制作的八元 MIMO 阵列进行了测量。在不使用任何去耦元件的情况下,所设计的八元件 MIMO 系统的测量隔离度为 18.5 dB。此外,MIMO 阵列具有良好的测量效率,在整个工作频段内的测量效率变化范围为 43%-54%。MIMO 系统的 ECC 测量值为 0.02。因此,所设计的 MIMO 阵列在 5G 金属边框手机应用中具有巨大潜力。
{"title":"A high-isolation coupled-fed building block for metal-rimmed 5G smartphones","authors":"Aidi Ren, Chengwei Yu, Lixia Yang, Wei Cui, Zhixiang Huang, Ying Liu","doi":"10.1631/fitee.2300203","DOIUrl":"https://doi.org/10.1631/fitee.2300203","url":null,"abstract":"<p>A compact coupled-fed dual-antenna building block has been constructed in this study. The building block is simple in structure and easy to process, and has a high degree of isolation. The dual-antenna building block is composed of a coupled-fed loop antenna and a coupled-fed slot antenna that completely overlap. Based on this dual-antenna module, an eight-element MIMO system is designed, and the fabricated eight-element MIMO array is measured. The measured isolation of the designed eight-element MIMO system is &gt;18.5 dB without any decoupling element. In addition, the MIMO array has good measured efficiencies, with a measured efficiency variation range of 43%–54% in the entire working frequency band. The measured ECC of the MIMO system is &lt;0.02. Therefore, the designed MIMO array has great potential in 5G metal-rimmed mobile phone applications.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"10 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A novel topology with controllable wideband baseband impedance for power amplifiers 功率放大器宽带基带阻抗可控的新型拓扑结构
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300074
Yao Yao, Zhijiang Dai, Mingyu Li

This paper presents a novel topology to control the baseband impedance of a power amplifier (PA) to avoid performance deterioration in concurrent dual-band mode. This topology can avoid pure resonance of capacitors and inductors LC, which leads to a high impedance at some frequency points. Consequently, it can be applied to transmitters that are excited by broadband signals. In particular, by adjusting the circuit parameters and increasing stages, the impedance of the key frequency bands can be flexibly controlled. A PA is designed to support this design idea. Its saturated output power is around 46.7 dBm, and the drain efficiency is >68.2% (1.8–2.3 GHz). Under concurrent two-tone excitation, the drain efficiency reaches around 40% even under 5.5 dB back-off power with the tone spacing from 10 MHz to 500 MHz. These results demonstrate that the proposed topology is capable of controlling wideband baseband impedance.

本文提出了一种新型拓扑结构,用于控制功率放大器(PA)的基带阻抗,以避免并发双频模式下的性能下降。这种拓扑结构可避免电容器和电感器 LC 产生纯共振,从而导致某些频点的阻抗过高。因此,它可用于宽带信号激励的发射机。特别是,通过调整电路参数和增加级数,可以灵活控制关键频段的阻抗。为支持这一设计理念,我们设计了一种功率放大器。其饱和输出功率约为 46.7 dBm,漏极效率为 68.2%(1.8-2.3 GHz)。在并发双音频激励下,即使在音调间隔为 10 MHz 至 500 MHz 的情况下,输出功率为 5.5 dB,漏极效率也能达到 40% 左右。这些结果表明,所提出的拓扑结构能够控制宽带基带阻抗。
{"title":"A novel topology with controllable wideband baseband impedance for power amplifiers","authors":"Yao Yao, Zhijiang Dai, Mingyu Li","doi":"10.1631/fitee.2300074","DOIUrl":"https://doi.org/10.1631/fitee.2300074","url":null,"abstract":"<p>This paper presents a novel topology to control the baseband impedance of a power amplifier (PA) to avoid performance deterioration in concurrent dual-band mode. This topology can avoid pure resonance of capacitors and inductors <i>LC</i>, which leads to a high impedance at some frequency points. Consequently, it can be applied to transmitters that are excited by broadband signals. In particular, by adjusting the circuit parameters and increasing stages, the impedance of the key frequency bands can be flexibly controlled. A PA is designed to support this design idea. Its saturated output power is around 46.7 dBm, and the drain efficiency is &gt;68.2% (1.8–2.3 GHz). Under concurrent two-tone excitation, the drain efficiency reaches around 40% even under 5.5 dB back-off power with the tone spacing from 10 MHz to 500 MHz. These results demonstrate that the proposed topology is capable of controlling wideband baseband impedance.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"13 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Magnetically driven microrobots moving in a flow: a review 磁力驱动微型机器人在流动中移动:综述
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300054
Jiamiao Miao, Xiaopu Wang, Yan Zhou, Min Ye, Hongyu Zhao, Ruoyu Xu, Huihuan Qian

Magnetically driven microrobots hold great potential to perform specific tasks more locally and less invasively in the human body. To reach the lesion area in vivo, microrobots should usually be navigated in flowing blood, which is much more complex than static liquid. Therefore, it is more challenging to design a corresponding precise control scheme. A considerable amount of work has been done regarding control of magnetic microrobots in a flow and the corresponding theories. In this paper, we review and summarize the state-of-the-art research progress concerning magnetic microrobots in blood flow, including the establishment of flow systems, dynamics modeling of motion, and control methods. In addition, current challenges and limitations are discussed. We hope this work can shed light on the efficient control of microrobots in complex flow environments and accelerate the study of microrobots for clinical use.

磁力驱动的微型机器人具有巨大的潜力,可以在人体内更局部、更微创地执行特定任务。要到达体内病变区域,微机器人通常要在流动的血液中航行,而流动的血液要比静态的液体复杂得多。因此,设计相应的精确控制方案更具挑战性。关于磁性微机器人在流动中的控制和相应的理论,已经有大量的研究工作。本文回顾并总结了血流中磁性微机器人的最新研究进展,包括流动系统的建立、运动动力学建模和控制方法。此外,我们还讨论了当前面临的挑战和局限性。我们希望这项工作能够阐明如何在复杂的流动环境中有效控制微机器人,并加速微机器人的临床应用研究。
{"title":"Magnetically driven microrobots moving in a flow: a review","authors":"Jiamiao Miao, Xiaopu Wang, Yan Zhou, Min Ye, Hongyu Zhao, Ruoyu Xu, Huihuan Qian","doi":"10.1631/fitee.2300054","DOIUrl":"https://doi.org/10.1631/fitee.2300054","url":null,"abstract":"<p>Magnetically driven microrobots hold great potential to perform specific tasks more locally and less invasively in the human body. To reach the lesion area in vivo, microrobots should usually be navigated in flowing blood, which is much more complex than static liquid. Therefore, it is more challenging to design a corresponding precise control scheme. A considerable amount of work has been done regarding control of magnetic microrobots in a flow and the corresponding theories. In this paper, we review and summarize the state-of-the-art research progress concerning magnetic microrobots in blood flow, including the establishment of flow systems, dynamics modeling of motion, and control methods. In addition, current challenges and limitations are discussed. We hope this work can shed light on the efficient control of microrobots in complex flow environments and accelerate the study of microrobots for clinical use.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"159 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multimodal dense convolution network for blind image quality assessment 用于盲图像质量评估的多模态密集卷积网络
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2200534
Nandhini Chockalingam, Brindha Murugan

Technological advancements continue to expand the communications industry’s potential. Images, which are an important component in strengthening communication, are widely available. Therefore, image quality assessment (IQA) is critical in improving content delivered to end users. Convolutional neural networks (CNNs) used in IQA face two common challenges. One issue is that these methods fail to provide the best representation of the image. The other issue is that the models have a large number of parameters, which easily leads to overfitting. To address these issues, the dense convolution network (DSC-Net), a deep learning model with fewer parameters, is proposed for no-reference image quality assessment (NR-IQA). Moreover, it is obvious that the use of multimodal data for deep learning has improved the performance of applications. As a result, multimodal dense convolution network (MDSC-Net) fuses the texture features extracted using the gray-level co-occurrence matrix (GLCM) method and spatial features extracted using DSC-Net and predicts the image quality. The performance of the proposed framework on the benchmark synthetic datasets LIVE, TID2013, and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.

技术进步不断拓展通信业的潜力。图像是加强通信的重要组成部分,可广泛获取。因此,图像质量评估(IQA)对于改善提供给最终用户的内容至关重要。用于 IQA 的卷积神经网络(CNN)面临两个共同的挑战。一个问题是这些方法无法提供图像的最佳表示。另一个问题是,这些模型有大量参数,很容易导致过度拟合。为了解决这些问题,我们提出了参数较少的深度学习模型--密集卷积网络(DSC-Net),用于无参考图像质量评估(NR-IQA)。此外,使用多模态数据进行深度学习显然提高了应用性能。因此,多模态密集卷积网络(MDSC-Net)融合了利用灰度共现矩阵(GLCM)方法提取的纹理特征和利用 DSC-Net 提取的空间特征,并预测了图像质量。拟议框架在基准合成数据集 LIVE、TID2013 和 KADID-10k 上的表现表明,在 NR-IQA 任务中,MDSC-Net 方法比最先进的方法取得了更好的性能。
{"title":"A multimodal dense convolution network for blind image quality assessment","authors":"Nandhini Chockalingam, Brindha Murugan","doi":"10.1631/fitee.2200534","DOIUrl":"https://doi.org/10.1631/fitee.2200534","url":null,"abstract":"<p>Technological advancements continue to expand the communications industry’s potential. Images, which are an important component in strengthening communication, are widely available. Therefore, image quality assessment (IQA) is critical in improving content delivered to end users. Convolutional neural networks (CNNs) used in IQA face two common challenges. One issue is that these methods fail to provide the best representation of the image. The other issue is that the models have a large number of parameters, which easily leads to overfitting. To address these issues, the dense convolution network (DSC-Net), a deep learning model with fewer parameters, is proposed for no-reference image quality assessment (NR-IQA). Moreover, it is obvious that the use of multimodal data for deep learning has improved the performance of applications. As a result, multimodal dense convolution network (MDSC-Net) fuses the texture features extracted using the gray-level co-occurrence matrix (GLCM) method and spatial features extracted using DSC-Net and predicts the image quality. The performance of the proposed framework on the benchmark synthetic datasets LIVE, TID2013, and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"10 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic parameterized learning for unsupervised domain adaptation 用于无监督领域适应的动态参数化学习
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2200631
Runhua Jiang, Yahong Han

Unsupervised domain adaptation enables neural networks to transfer from a labeled source domain to an unlabeled target domain by learning domain-invariant representations. Recent approaches achieve this by directly matching the marginal distributions of these two domains. Most of them, however, ignore exploration of the dynamic trade-off between domain alignment and semantic discrimination learning, thus rendering them susceptible to the problems of negative transfer and outlier samples. To address these issues, we introduce the dynamic parameterized learning framework. First, by exploring domain-level semantic knowledge, the dynamic alignment parameter is proposed, to adaptively adjust the optimization steps of domain alignment and semantic discrimination learning. Besides, for obtaining semantic-discriminative and domain-invariant representations, we propose to align training trajectories on both source and target domains. Comprehensive experiments are conducted to validate the effectiveness of the proposed methods, and extensive comparisons are conducted on seven datasets of three visual tasks to demonstrate their practicability.

无监督领域适应使神经网络能够通过学习领域不变表征,从有标记的源领域转移到无标记的目标领域。最近的方法通过直接匹配这两个域的边际分布来实现这一目标。然而,大多数方法都忽略了对领域匹配和语义辨别学习之间动态权衡的探索,因此容易出现负迁移和离群样本的问题。为了解决这些问题,我们引入了动态参数化学习框架。首先,通过探索领域级语义知识,提出了动态配准参数,以自适应地调整领域配准和语义判别学习的优化步骤。此外,为了获得语义判别和领域不变的表征,我们提出在源领域和目标领域上对齐训练轨迹。为了验证所提方法的有效性,我们进行了全面的实验,并在三个视觉任务的七个数据集上进行了广泛的比较,以证明这些方法的实用性。
{"title":"Dynamic parameterized learning for unsupervised domain adaptation","authors":"Runhua Jiang, Yahong Han","doi":"10.1631/fitee.2200631","DOIUrl":"https://doi.org/10.1631/fitee.2200631","url":null,"abstract":"<p>Unsupervised domain adaptation enables neural networks to transfer from a labeled source domain to an unlabeled target domain by learning domain-invariant representations. Recent approaches achieve this by directly matching the marginal distributions of these two domains. Most of them, however, ignore exploration of the dynamic trade-off between domain alignment and semantic discrimination learning, thus rendering them susceptible to the problems of negative transfer and outlier samples. To address these issues, we introduce the dynamic parameterized learning framework. First, by exploring domain-level semantic knowledge, the dynamic alignment parameter is proposed, to adaptively adjust the optimization steps of domain alignment and semantic discrimination learning. Besides, for obtaining semantic-discriminative and domain-invariant representations, we propose to align training trajectories on both source and target domains. Comprehensive experiments are conducted to validate the effectiveness of the proposed methods, and extensive comparisons are conducted on seven datasets of three visual tasks to demonstrate their practicability.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"159 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A modified harmony search algorithm and its applications in weighted fuzzy production rule extraction 改进的和谐搜索算法及其在加权模糊生产规则提取中的应用
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2200334
Shaoqiang Ye, Kaiqing Zhou, Azlan Mohd Zain, Fangling Wang, Yusliza Yusoff

Harmony search (HS) is a form of stochastic meta-heuristic inspired by the improvisation process of musicians. In this study, a modified HS with a hybrid cuckoo search (CS) operator, HS-CS, is proposed to enhance global search ability while avoiding falling into local optima. First, the randomness of the HS pitch disturbance adjusting method is analyzed to generate an adaptive inertia weight according to the quality of solutions in the harmony memory and to reconstruct the fine-tuning bandwidth optimization. This is to improve the efficiency and accuracy of HS algorithm optimization. Second, the CS operator is introduced to expand the scope of the solution space and improve the density of the population, which can quickly jump out of the local optimum in the randomly generated harmony and update stage. Finally, a dynamic parameter adjustment mechanism is set to improve the efficiency of optimization. Three theorems are proved to reveal HS-CS as a global convergence meta-heuristic algorithm. In addition, 12 benchmark functions are selected for the optimization solution to verify the performance of HS-CS. The analysis shows that HS-CS is significantly better than other algorithms in optimizing high-dimensional problems with strong robustness, high convergence speed, and high convergence accuracy. For further verification, HS-CS is used to optimize the back propagation neural network (BPNN) to extract weighted fuzzy production rules. Simulation results show that the BPNN optimized by HS-CS can obtain higher classification accuracy of weighted fuzzy production rules. Therefore, the proposed HS-CS is proved to be effective.

和谐搜索(HS)是一种随机元启发式,其灵感来自音乐家的即兴创作过程。本研究提出了一种带有混合布谷鸟搜索(CS)算子 HS-CS 的改进 HS,以增强全局搜索能力,同时避免陷入局部最优。首先,分析了 HS 音高干扰调整方法的随机性,根据和声记忆中解的质量生成自适应惯性权重,并重建微调带宽优化。从而提高 HS 算法优化的效率和精度。其次,引入 CS 算子,扩大解空间范围,提高种群密度,在随机生成的和谐与更新阶段,能快速跳出局部最优。最后,设置了动态参数调整机制,以提高优化效率。三个定理揭示了 HS-CS 是一种全局收敛元启发式算法。此外,还选取了 12 个基准函数作为优化解,以验证 HS-CS 的性能。分析表明,在优化高维问题时,HS-CS 的鲁棒性强、收敛速度快、收敛精度高,明显优于其他算法。为了进一步验证,HS-CS 被用于优化反向传播神经网络(BPNN)以提取加权模糊生产规则。仿真结果表明,经 HS-CS 优化的 BPNN 可以获得更高的加权模糊生产规则分类精度。因此,所提出的 HS-CS 被证明是有效的。
{"title":"A modified harmony search algorithm and its applications in weighted fuzzy production rule extraction","authors":"Shaoqiang Ye, Kaiqing Zhou, Azlan Mohd Zain, Fangling Wang, Yusliza Yusoff","doi":"10.1631/fitee.2200334","DOIUrl":"https://doi.org/10.1631/fitee.2200334","url":null,"abstract":"<p>Harmony search (HS) is a form of stochastic meta-heuristic inspired by the improvisation process of musicians. In this study, a modified HS with a hybrid cuckoo search (CS) operator, HS-CS, is proposed to enhance global search ability while avoiding falling into local optima. First, the randomness of the HS pitch disturbance adjusting method is analyzed to generate an adaptive inertia weight according to the quality of solutions in the harmony memory and to reconstruct the fine-tuning bandwidth optimization. This is to improve the efficiency and accuracy of HS algorithm optimization. Second, the CS operator is introduced to expand the scope of the solution space and improve the density of the population, which can quickly jump out of the local optimum in the randomly generated harmony and update stage. Finally, a dynamic parameter adjustment mechanism is set to improve the efficiency of optimization. Three theorems are proved to reveal HS-CS as a global convergence meta-heuristic algorithm. In addition, 12 benchmark functions are selected for the optimization solution to verify the performance of HS-CS. The analysis shows that HS-CS is significantly better than other algorithms in optimizing high-dimensional problems with strong robustness, high convergence speed, and high convergence accuracy. For further verification, HS-CS is used to optimize the back propagation neural network (BPNN) to extract weighted fuzzy production rules. Simulation results show that the BPNN optimized by HS-CS can obtain higher classification accuracy of weighted fuzzy production rules. Therefore, the proposed HS-CS is proved to be effective.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"159 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Embedding expert demonstrations into clustering buffer for effective deep reinforcement learning 将专家示范嵌入聚类缓冲区,实现有效的深度强化学习
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300084
Shihmin Wang, Binqi Zhao, Zhengfeng Zhang, Junping Zhang, Jian Pu

As one of the most fundamental topics in reinforcement learning (RL), sample efficiency is essential to the deployment of deep RL algorithms. Unlike most existing exploration methods that sample an action from different types of posterior distributions, we focus on the policy sampling process and propose an efficient selective sampling approach to improve sample efficiency by modeling the internal hierarchy of the environment. Specifically, we first employ clustering methods in the policy sampling process to generate an action candidate set. Then we introduce a clustering buffer for modeling the internal hierarchy, which consists of on-policy data, off-policy data, and expert data to evaluate actions from the clusters in the action candidate set in the exploration stage. In this way, our approach is able to take advantage of the supervision information in the expert demonstration data. Experiments on six different continuous locomotion environments demonstrate superior reinforcement learning performance and faster convergence of selective sampling. In particular, on the LGSVL task, our method can reduce the number of convergence steps by 46.7% and the convergence time by 28.5%. Furthermore, our code is open-source for reproducibility. The code is available at https://github.com/Shihwin/SelectiveSampling.

作为强化学习(RL)中最基本的课题之一,采样效率对于深度 RL 算法的部署至关重要。现有的大多数探索方法都是从不同类型的后验分布中对行动进行采样,与此不同,我们专注于策略采样过程,并提出了一种高效的选择性采样方法,通过模拟环境的内部层次结构来提高采样效率。具体来说,我们首先在策略采样过程中采用聚类方法生成行动候选集。然后,我们引入一个聚类缓冲区来模拟内部层次结构,该缓冲区由政策内数据、政策外数据和专家数据组成,用于在探索阶段评估行动候选集中的聚类行动。这样,我们的方法就能利用专家示范数据中的监督信息。在六种不同的连续运动环境中进行的实验表明,强化学习性能优越,选择性采样的收敛速度更快。特别是在 LGSVL 任务中,我们的方法可以减少 46.7% 的收敛步数和 28.5% 的收敛时间。此外,我们的代码是开源的,具有可重复性。代码可在 https://github.com/Shihwin/SelectiveSampling 上获取。
{"title":"Embedding expert demonstrations into clustering buffer for effective deep reinforcement learning","authors":"Shihmin Wang, Binqi Zhao, Zhengfeng Zhang, Junping Zhang, Jian Pu","doi":"10.1631/fitee.2300084","DOIUrl":"https://doi.org/10.1631/fitee.2300084","url":null,"abstract":"<p>As one of the most fundamental topics in reinforcement learning (RL), sample efficiency is essential to the deployment of deep RL algorithms. Unlike most existing exploration methods that sample an action from different types of posterior distributions, we focus on the policy sampling process and propose an efficient selective sampling approach to improve sample efficiency by modeling the internal hierarchy of the environment. Specifically, we first employ clustering methods in the policy sampling process to generate an action candidate set. Then we introduce a clustering buffer for modeling the internal hierarchy, which consists of on-policy data, off-policy data, and expert data to evaluate actions from the clusters in the action candidate set in the exploration stage. In this way, our approach is able to take advantage of the supervision information in the expert demonstration data. Experiments on six different continuous locomotion environments demonstrate superior reinforcement learning performance and faster convergence of selective sampling. In particular, on the LGSVL task, our method can reduce the number of convergence steps by 46.7% and the convergence time by 28.5%. Furthermore, our code is open-source for reproducibility. The code is available at https://github.com/Shihwin/SelectiveSampling.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"20 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Software development in the age of intelligence: embracing large language models with the right approach 智能时代的软件开发:用正确的方法拥抱大型语言模型
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300537
Xin Peng

Embracing LLMs is definitely a correct and even necessary direction for software enterprises to improve quality and efficiency. However, achieving systematic and comprehensive intelligent software development still requires careful consideration and there is much fundamental work to do. For enterprises, solidifying the digitization and knowledge accumulation of software development, as well as the fundamental capabilities of software engineering such as requirement analysis, design, and validation, remains crucial and is also a basic condition for achieving higher levels of intelligent development. For academic research, there is still much work to do in the direction of systematic and comprehensive intelligent software development. This also requires us have a deeper understanding of the complexity of software systems and software requirements and design, based on understanding the capabilities of LLMs.

对于软件企业来说,拥抱 LLMs 无疑是一个正确甚至是必要的方向,有助于提高质量和效率。但是,实现系统、全面的智能软件开发还需要深思熟虑,还有许多基础性工作要做。对企业而言,夯实软件开发的数字化和知识积累,以及需求分析、设计、验证等软件工程的基础能力,仍然至关重要,也是实现更高水平智能开发的基本条件。就学术研究而言,在系统、全面的智能软件开发方向上还有许多工作要做。这也需要我们在了解 LLM 能力的基础上,对软件系统和软件需求与设计的复杂性有更深入的理解。
{"title":"Software development in the age of intelligence: embracing large language models with the right approach","authors":"Xin Peng","doi":"10.1631/fitee.2300537","DOIUrl":"https://doi.org/10.1631/fitee.2300537","url":null,"abstract":"<p>Embracing LLMs is definitely a correct and even necessary direction for software enterprises to improve quality and efficiency. However, achieving systematic and comprehensive intelligent software development still requires careful consideration and there is much fundamental work to do. For enterprises, solidifying the digitization and knowledge accumulation of software development, as well as the fundamental capabilities of software engineering such as requirement analysis, design, and validation, remains crucial and is also a basic condition for achieving higher levels of intelligent development. For academic research, there is still much work to do in the direction of systematic and comprehensive intelligent software development. This also requires us have a deeper understanding of the complexity of software systems and software requirements and design, based on understanding the capabilities of LLMs.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"5 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
High-emitter identification for heavy-duty vehicles by temporal optimization LSTM and an adaptive dynamic threshold 通过时间优化 LSTM 和自适应动态阈值识别重型车辆的高发射器
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-07 DOI: 10.1631/fitee.2300005
Zhenyi Xu, Renjun Wang, Yang Cao, Yu Kang

Heavy-duty diesel vehicles are important sources of urban nitrogen oxides (NOx) in actual applications for environmental compliance, emitting more than 80% of NOx and more than 90% of particulate matter (PM) in total vehicle emissions. The detection and control of heavy-duty diesel emissions are critical for protecting public health. Currently, vehicles on the road must be regularly tested, every six months or once a year, to filter out high-emission mobile sources at vehicle inspection stations. However, it is difficult to effectively screen high-emission vehicles in time with a long interval between annual inspections, and the fixed threshold cannot adapt to the dynamic changes of vehicle driving conditions. An on-board diagnostic device (OBD) is installed inside the vehicle and can record the vehicle’s emission data in real time. In this paper, we propose a temporal optimization long short-term memory (LSTM) and adaptive dynamic threshold approach to identify heavy-duty high-emitters by using OBD data, which can continuously track and record the emission status in real time. First, a temporal optimization LSTM emission prediction model is established to solve the attention bias discrepancy problem on time steps that is caused by the large number of OBD data streams in practice. Then, the concentration prediction error sequence is detected and distinguished from the anomalous emission contexts using flexible criteria, calculated by an adaptive dynamic threshold with changing driving conditions. Finally, a similarity metric strategy for the time series is introduced to correct some pseudo anomalous results. Experiments on three real OBD time-series emission datasets demonstrate that our method can achieve high accuracy anomalous emission identification.

在实际应用中,重型柴油车是城市氮氧化物(NOx)的重要来源,其排放的氮氧化物和颗粒物(PM)分别占汽车总排放量的 80% 和 90% 以上。检测和控制重型柴油机的排放对保护公众健康至关重要。目前,上路行驶的车辆必须定期接受检测,每半年或一年一次,在车辆检测站过滤掉高排放移动源。然而,由于年检间隔时间较长,很难及时有效地筛选出高排放车辆,而且固定的阈值无法适应车辆行驶条件的动态变化。车载诊断设备(OBD)安装在车辆内部,可以实时记录车辆的排放数据。本文提出了一种时态优化长短期记忆(LSTM)和自适应动态阈值方法,利用车载诊断仪数据来识别重型高排放车辆,因为车载诊断仪可以连续、实时地跟踪和记录车辆的排放状态。首先,建立了时间优化 LSTM 排放预测模型,以解决实际应用中大量 OBD 数据流导致的时间步长上的注意力偏差问题。然后,使用灵活的标准检测浓度预测错误序列,并将其与异常排放情况区分开来,该标准由随驾驶条件变化的自适应动态阈值计算得出。最后,引入了时间序列的相似性度量策略,以纠正一些伪异常结果。在三个真实的车载诊断系统时间序列排放数据集上进行的实验表明,我们的方法可以实现高精度的异常排放识别。
{"title":"High-emitter identification for heavy-duty vehicles by temporal optimization LSTM and an adaptive dynamic threshold","authors":"Zhenyi Xu, Renjun Wang, Yang Cao, Yu Kang","doi":"10.1631/fitee.2300005","DOIUrl":"https://doi.org/10.1631/fitee.2300005","url":null,"abstract":"<p>Heavy-duty diesel vehicles are important sources of urban nitrogen oxides (NO<sub><i>x</i></sub>) in actual applications for environmental compliance, emitting more than 80% of NO<sub><i>x</i></sub> and more than 90% of particulate matter (PM) in total vehicle emissions. The detection and control of heavy-duty diesel emissions are critical for protecting public health. Currently, vehicles on the road must be regularly tested, every six months or once a year, to filter out high-emission mobile sources at vehicle inspection stations. However, it is difficult to effectively screen high-emission vehicles in time with a long interval between annual inspections, and the fixed threshold cannot adapt to the dynamic changes of vehicle driving conditions. An on-board diagnostic device (OBD) is installed inside the vehicle and can record the vehicle’s emission data in real time. In this paper, we propose a temporal optimization long short-term memory (LSTM) and adaptive dynamic threshold approach to identify heavy-duty high-emitters by using OBD data, which can continuously track and record the emission status in real time. First, a temporal optimization LSTM emission prediction model is established to solve the attention bias discrepancy problem on time steps that is caused by the large number of OBD data streams in practice. Then, the concentration prediction error sequence is detected and distinguished from the anomalous emission contexts using flexible criteria, calculated by an adaptive dynamic threshold with changing driving conditions. Finally, a similarity metric strategy for the time series is introduced to correct some pseudo anomalous results. Experiments on three real OBD time-series emission datasets demonstrate that our method can achieve high accuracy anomalous emission identification.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"108 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138548284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A cloud–edge–device collaborative offloading scheme with heterogeneous tasks and its performance evaluation 一种异构任务的云边缘设备协同卸载方案及其性能评价
IF 3 3区 工程技术 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1631/fitee.2300128
Xiaojun Bai, Yang Zhang, Haixing Wu, Yuting Wang, Shunfu Jin

How to collaboratively offload tasks between user devices, edge networks (ENs), and cloud data centers is an interesting and challenging research topic. In this paper, we investigate the offloading decision, analytical modeling, and system parameter optimization problem in a collaborative cloud–edge–device environment, aiming to trade off different performance measures. According to the differentiated delay requirements of tasks, we classify the tasks into delay-sensitive and delay-tolerant tasks. To meet the delay requirements of delay-sensitive tasks and process as many delay-tolerant tasks as possible, we propose a cloud–edge–device collaborative task offloading scheme, in which delay-sensitive and delay-tolerant tasks follow the access threshold policy and the loss policy, respectively. We establish a four-dimensional continuous-time Markov chain as the system model. By using the Gauss–Seidel method, we derive the stationary probability distribution of the system model. Accordingly, we present the blocking rate of delay-sensitive tasks and the average delay of these two types of tasks. Numerical experiments are conducted and analyzed to evaluate the system performance, and numerical simulations are presented to evaluate and validate the effectiveness of the proposed task offloading scheme. Finally, we optimize the access threshold in the EN buffer to obtain the minimum system cost with different proportions of delay-sensitive tasks.

如何在用户设备、边缘网络(ENs)和云数据中心之间协同卸载任务是一个有趣且具有挑战性的研究课题。在本文中,我们研究了在协作云边缘设备环境下的卸载决策、分析建模和系统参数优化问题,旨在权衡不同的性能指标。根据任务对延迟的不同要求,将任务分为延迟敏感任务和延迟容忍任务。为了满足延迟敏感任务的延迟需求,并尽可能多地处理延迟容忍任务,我们提出了一种云-边缘设备协同任务卸载方案,其中延迟敏感任务遵循访问阈值策略,延迟容忍任务遵循丢失策略。建立了一个四维连续时间马尔可夫链作为系统模型。利用高斯-赛德尔方法,导出了系统模型的平稳概率分布。据此,我们给出了延迟敏感型任务的阻塞率以及这两类任务的平均延迟。通过数值实验和分析来评估系统的性能,并通过数值模拟来评估和验证所提出的任务卸载方案的有效性。最后,我们优化了EN缓冲区中的访问阈值,以获得不同延迟敏感任务比例下的最小系统开销。
{"title":"A cloud–edge–device collaborative offloading scheme with heterogeneous tasks and its performance evaluation","authors":"Xiaojun Bai, Yang Zhang, Haixing Wu, Yuting Wang, Shunfu Jin","doi":"10.1631/fitee.2300128","DOIUrl":"https://doi.org/10.1631/fitee.2300128","url":null,"abstract":"<p>How to collaboratively offload tasks between user devices, edge networks (ENs), and cloud data centers is an interesting and challenging research topic. In this paper, we investigate the offloading decision, analytical modeling, and system parameter optimization problem in a collaborative cloud–edge–device environment, aiming to trade off different performance measures. According to the differentiated delay requirements of tasks, we classify the tasks into delay-sensitive and delay-tolerant tasks. To meet the delay requirements of delay-sensitive tasks and process as many delay-tolerant tasks as possible, we propose a cloud–edge–device collaborative task offloading scheme, in which delay-sensitive and delay-tolerant tasks follow the access threshold policy and the loss policy, respectively. We establish a four-dimensional continuous-time Markov chain as the system model. By using the Gauss–Seidel method, we derive the stationary probability distribution of the system model. Accordingly, we present the blocking rate of delay-sensitive tasks and the average delay of these two types of tasks. Numerical experiments are conducted and analyzed to evaluate the system performance, and numerical simulations are presented to evaluate and validate the effectiveness of the proposed task offloading scheme. Finally, we optimize the access threshold in the EN buffer to obtain the minimum system cost with different proportions of delay-sensitive tasks.</p>","PeriodicalId":12608,"journal":{"name":"Frontiers of Information Technology & Electronic Engineering","volume":"27 2","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138504833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Frontiers of Information Technology & Electronic Engineering
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1