首页 > 最新文献

2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)最新文献

英文 中文
Offline Handwritten Uighur Word Recognition Based on Segmentation-driven and Two-level DTW 基于分词驱动和两级DTW的离线手写维吾尔语词识别
Xu Yamei, Xu Jili
Offline handwritten Uighur scripts is cursive and have a large vocabulary, which makes the word recognition more complicated. In this paper, we propose a segmentation-driven recognition algorithm for offline handwritten Uighur word based on grapheme analysis and two-level DTW (dynamic time wrapping). Firstly, a MSAC (main segmentation and additional clustering) algorithm is adopted to over-segment a handwritten Uighur word into two grapheme sequences. After then, a hierarchical hybrid Uighur character classifier is designed to enhance the character recognition accuracy. Finally, a novel maximum likelihood algorithm with two-level DTW is presented to select the best hypothesis of character sequence from grapheme merging and decide the word class. Experiment results show that the proposed algorithm can achieve high character segmentation accuracy and word recognition rate simultaneously.
离线手写维吾尔文字是草书,词汇量大,这使得单词识别更加复杂。本文提出了一种基于字素分析和两级动态时间包裹(DTW)的离线手写维吾尔语词分词驱动识别算法。首先,采用主分词加聚类(MSAC)算法将手写的维吾尔语词过度分词为两个字素序列;在此基础上,设计了层次混合维吾尔文字分类器,提高了维吾尔文字的识别精度。最后,提出了一种基于两级DTW的最大似然算法,从字素合并中选择最佳字符序列假设并确定词类。实验结果表明,该算法能同时达到较高的字符分割精度和单词识别率。
{"title":"Offline Handwritten Uighur Word Recognition Based on Segmentation-driven and Two-level DTW","authors":"Xu Yamei, Xu Jili","doi":"10.1109/CCET48361.2019.8989253","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989253","url":null,"abstract":"Offline handwritten Uighur scripts is cursive and have a large vocabulary, which makes the word recognition more complicated. In this paper, we propose a segmentation-driven recognition algorithm for offline handwritten Uighur word based on grapheme analysis and two-level DTW (dynamic time wrapping). Firstly, a MSAC (main segmentation and additional clustering) algorithm is adopted to over-segment a handwritten Uighur word into two grapheme sequences. After then, a hierarchical hybrid Uighur character classifier is designed to enhance the character recognition accuracy. Finally, a novel maximum likelihood algorithm with two-level DTW is presented to select the best hypothesis of character sequence from grapheme merging and decide the word class. Experiment results show that the proposed algorithm can achieve high character segmentation accuracy and word recognition rate simultaneously.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114877809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of bootloader based on DoIP 基于DoIP的引导加载程序的实现
Feng Luo, Quan Wen
With its 100Mbps high bandwidth and high-speed transmission characteristics, automotive Ethernet is expected to solve traditional vehicle bus’s problem of low bandwidth and low data transmission rate, and become the backbone network of the future vehicle. The use of automotive Ethernet introduces a new diagnostic technology, DoIP (Diagnostic over IP). ISO 13400 is the standard protocol for DoIP, which provides an Ethernet-based diagnostic method for automotive systems and describes how external tester communicate with in-vehicle ECUs. This paper analyzes the implementation principle of DoIP by studying ISO 13400 protocol, including the communication scenarios of DoIP, DoIP diagnostic process and the network time management of DoIP. Then a bootloader based on DoIP is developed and the performance of the bootloader is tested. The result shows that the DoIP-based bootloader only takes 29.6 second to update the ECU with 384K bytes code.
汽车以太网以其100Mbps的高带宽和高速传输特性,有望解决传统汽车总线带宽低、数据传输速率低的问题,成为未来汽车的骨干网络。汽车以太网的使用引入了一种新的诊断技术,DoIP (IP诊断)。ISO 13400是DoIP的标准协议,它为汽车系统提供了基于以太网的诊断方法,并描述了外部测试仪如何与车内ecu通信。本文通过对ISO 13400协议的研究,分析了DoIP的实现原理,包括DoIP的通信场景、DoIP诊断过程和DoIP的网络时间管理。然后开发了一个基于DoIP的引导加载程序,并对其性能进行了测试。结果表明,基于doip的引导加载程序只需要29.6秒就可以用384K字节的代码更新ECU。
{"title":"Implementation of bootloader based on DoIP","authors":"Feng Luo, Quan Wen","doi":"10.1109/CCET48361.2019.8989318","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989318","url":null,"abstract":"With its 100Mbps high bandwidth and high-speed transmission characteristics, automotive Ethernet is expected to solve traditional vehicle bus’s problem of low bandwidth and low data transmission rate, and become the backbone network of the future vehicle. The use of automotive Ethernet introduces a new diagnostic technology, DoIP (Diagnostic over IP). ISO 13400 is the standard protocol for DoIP, which provides an Ethernet-based diagnostic method for automotive systems and describes how external tester communicate with in-vehicle ECUs. This paper analyzes the implementation principle of DoIP by studying ISO 13400 protocol, including the communication scenarios of DoIP, DoIP diagnostic process and the network time management of DoIP. Then a bootloader based on DoIP is developed and the performance of the bootloader is tested. The result shows that the DoIP-based bootloader only takes 29.6 second to update the ECU with 384K bytes code.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124500614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A method of pulmonary embolism segmentation from CTPA images based on U-net 基于U-net的CTPA图像肺栓塞分割方法
Zhou Wen, Huaqing Wang, Hongfang Yuan, Min Liu, Xin Guo
The doctor's assessment of the degree for pulmonary embolism often needs to calculate the volume about it. The most important thing is to accurately segment pulmonary embolism in the Computed Tomography Pulmonary Angiography (CTPA) images. This paper proposes a method to segment the pulmonary embolism from CTPA images and the method is based on U-net which is an effective semantic segmentation network in deep learning. This work uses partial weights from the VGG16 pre-training model to initialize the parameters of the contracting path in the U-net. It can extremely reduce time of training and improve the generalization ability of the network. However, the class of the samples is unbalanced extremely. This paper defined a new loss function which is combined Focal loss and Dice loss to solve this problem. And the experiment shows that the proposed method can get effectively segmentation of pulmonary embolism in CTPA images.
医生对肺栓塞程度的评估,往往需要计算肺栓塞周围的容积。在ct肺血管造影(CTPA)图像中,最重要的是准确分割肺栓塞。本文提出了一种基于深度学习中有效的语义分割网络U-net的CTPA图像肺栓塞分割方法。这项工作使用来自VGG16预训练模型的偏权来初始化U-net中收缩路径的参数。极大地减少了训练时间,提高了网络的泛化能力。然而,样本的类别是极不平衡的。为了解决这一问题,本文定义了一种新的损失函数,它将Focal loss和Dice loss结合起来。实验表明,该方法可以有效地分割出CTPA图像中的肺栓塞。
{"title":"A method of pulmonary embolism segmentation from CTPA images based on U-net","authors":"Zhou Wen, Huaqing Wang, Hongfang Yuan, Min Liu, Xin Guo","doi":"10.1109/CCET48361.2019.8989357","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989357","url":null,"abstract":"The doctor's assessment of the degree for pulmonary embolism often needs to calculate the volume about it. The most important thing is to accurately segment pulmonary embolism in the Computed Tomography Pulmonary Angiography (CTPA) images. This paper proposes a method to segment the pulmonary embolism from CTPA images and the method is based on U-net which is an effective semantic segmentation network in deep learning. This work uses partial weights from the VGG16 pre-training model to initialize the parameters of the contracting path in the U-net. It can extremely reduce time of training and improve the generalization ability of the network. However, the class of the samples is unbalanced extremely. This paper defined a new loss function which is combined Focal loss and Dice loss to solve this problem. And the experiment shows that the proposed method can get effectively segmentation of pulmonary embolism in CTPA images.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"191 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129992275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Context Aware School Zone Warning System in VANETs VANETs中上下文感知的学校区域预警系统
Jamal Alsultan
School zones are areas close to schools in which crossing vehicles represent a threat to school children. Due to various reasons, drivers might not be aware that they are approaching school zone areas. Utilizing wireless technology in vehicular environments can improve road safety and reduce the number accidents through the development of vehicle safety applications. This paper proposes a context-aware school zone warning system in VANETs. A context aware On-Board Unit architecture is proposed to detect active school zones and provide timely notifications to drivers to safely reduce the speed of their vehicles. The architecture is divided into three layers (i.e. sensing, reasoning, and acting layers). The sensing layer is responsible for collecting the required information to identify active school zones. The reasoning layer identifies the active school zones and sends signals to the application layer, which is responsible for alerting drivers through in-vehicle alarms.
学区是指靠近学校的地区,在这些地区,过路车辆对学生构成威胁。由于各种原因,司机可能没有意识到他们正在接近学校区域。在车辆环境中利用无线技术可以通过开发车辆安全应用来提高道路安全性,减少事故数量。本文提出了一种基于场景感知的VANETs学区预警系统。提出了一种环境感知的车载单元架构,用于检测活跃的学校区域,并向驾驶员提供及时通知,以安全降低车辆速度。该体系结构分为三层(即感知层、推理层和行为层)。传感层负责收集必要的信息,以确定活跃的学校区域。推理层识别活跃的学校区域并向应用层发送信号,应用层负责通过车载报警器提醒驾驶员。
{"title":"Context Aware School Zone Warning System in VANETs","authors":"Jamal Alsultan","doi":"10.1109/CCET48361.2019.8989398","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989398","url":null,"abstract":"School zones are areas close to schools in which crossing vehicles represent a threat to school children. Due to various reasons, drivers might not be aware that they are approaching school zone areas. Utilizing wireless technology in vehicular environments can improve road safety and reduce the number accidents through the development of vehicle safety applications. This paper proposes a context-aware school zone warning system in VANETs. A context aware On-Board Unit architecture is proposed to detect active school zones and provide timely notifications to drivers to safely reduce the speed of their vehicles. The architecture is divided into three layers (i.e. sensing, reasoning, and acting layers). The sensing layer is responsible for collecting the required information to identify active school zones. The reasoning layer identifies the active school zones and sends signals to the application layer, which is responsible for alerting drivers through in-vehicle alarms.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132020750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Grouping Optimization Based Hybrid Beamforming for Multiuser MmWave Massive MIMO Systems 基于分组优化的多用户毫米波大规模MIMO系统混合波束形成
Y. Ding, Anzhong Hu
In millimeter-wave massive multiple input multiple output multiuser systems, inter-user interference becomes a major factor limiting system capacity. The premise of increasing system capacity is to minimize inter-user interference on the basis of ensuring large receiving power. In response to this situation, this paper proposes a low complexity grouping optimization based hybrid beamforming (HBF) algorithm. Specifically, we group users according to user channel correlation and a correlation threshold. Users with strong correlation are grouped into a group. Then, with the goal of maximizing capacity, the low-dimensional exhaustive algorithm is used in each group to select the base station beamforming vector. Moreover, a greedy algorithm is adopted, i.e., the influence of the beamforming vectors of the previous groups is considered. Simulation results show that the system sum rate of the grouping optimization HBF algorithm is higher than that of the existing HBF algorithms.
在毫米波海量多输入多输出多用户系统中,用户间干扰成为限制系统容量的主要因素。增加系统容量的前提是在保证大接收功率的基础上尽量减少用户间干扰。针对这种情况,本文提出了一种基于低复杂度分组优化的混合波束形成(HBF)算法。具体来说,我们根据用户通道相关性和相关性阈值对用户进行分组。将相关性强的用户分组为一组。然后,以容量最大化为目标,在每组中采用低维穷举算法选择基站波束形成矢量;采用贪婪算法,即考虑了前一组波束形成矢量的影响。仿真结果表明,分组优化HBF算法的系统和速率高于现有的HBF算法。
{"title":"Grouping Optimization Based Hybrid Beamforming for Multiuser MmWave Massive MIMO Systems","authors":"Y. Ding, Anzhong Hu","doi":"10.1109/CCET48361.2019.8989341","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989341","url":null,"abstract":"In millimeter-wave massive multiple input multiple output multiuser systems, inter-user interference becomes a major factor limiting system capacity. The premise of increasing system capacity is to minimize inter-user interference on the basis of ensuring large receiving power. In response to this situation, this paper proposes a low complexity grouping optimization based hybrid beamforming (HBF) algorithm. Specifically, we group users according to user channel correlation and a correlation threshold. Users with strong correlation are grouped into a group. Then, with the goal of maximizing capacity, the low-dimensional exhaustive algorithm is used in each group to select the base station beamforming vector. Moreover, a greedy algorithm is adopted, i.e., the influence of the beamforming vectors of the previous groups is considered. Simulation results show that the system sum rate of the grouping optimization HBF algorithm is higher than that of the existing HBF algorithms.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114358366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
CCET 2019 Committees CCET 2019委员会
{"title":"CCET 2019 Committees","authors":"","doi":"10.1109/ccet48361.2019.8989011","DOIUrl":"https://doi.org/10.1109/ccet48361.2019.8989011","url":null,"abstract":"","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132675019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
dSCADL: A Data Flow based Symmetric Cryptographic Algorithm Description Language 一种基于数据流的对称密码算法描述语言
J. Rao, X. Zou, Kui Dai
The symmetric cryptographic algorithm(SCA) is one of the fundamental technologies for information security. Due to the ever-increasing computing power and evolving attack technologies, researchers have to keep seeking more secure algorithms with better attack resistances. This paper proposes a data flow based Symmetric Cryptographic Algorithm Description Language(dSCADL) to speed up the implementation and evaluation which are vital for new cipher algorithm explorations. With flexible data structures and proven Turing-completeness, users can intuitively describe algorithms by mainly focusing on data flow. Evaluation results show that dSCADL can speed up implementation efficiency of typical SCAs by 2.95 to 9.75 times over existing researches. The language definition and runtime library are open sources for practical SCA explorations.
对称密码算法(SCA)是信息安全的基础技术之一。由于计算能力的不断提高和攻击技术的不断发展,研究人员必须不断寻求更安全、更抗攻击的算法。本文提出了一种基于数据流的对称密码算法描述语言(dSCADL),以加快算法的实现和评估,这对探索新的密码算法至关重要。灵活的数据结构和经过验证的图灵完备性,使用户能够以数据流为主,直观地描述算法。评估结果表明,与现有研究相比,dSCADL可将典型sca的实施效率提高2.95 ~ 9.75倍。语言定义和运行时库是用于实际SCA探索的开放源代码。
{"title":"dSCADL: A Data Flow based Symmetric Cryptographic Algorithm Description Language","authors":"J. Rao, X. Zou, Kui Dai","doi":"10.1109/CCET48361.2019.8989331","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989331","url":null,"abstract":"The symmetric cryptographic algorithm(SCA) is one of the fundamental technologies for information security. Due to the ever-increasing computing power and evolving attack technologies, researchers have to keep seeking more secure algorithms with better attack resistances. This paper proposes a data flow based Symmetric Cryptographic Algorithm Description Language(dSCADL) to speed up the implementation and evaluation which are vital for new cipher algorithm explorations. With flexible data structures and proven Turing-completeness, users can intuitively describe algorithms by mainly focusing on data flow. Evaluation results show that dSCADL can speed up implementation efficiency of typical SCAs by 2.95 to 9.75 times over existing researches. The language definition and runtime library are open sources for practical SCA explorations.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115922286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic Summarization and Keyword Extraction from Web Page or Text File 自动摘要和关键字提取从网页或文本文件
Xiangdong You
In this paper, we study the automatic summarization and keyword extraction techniques for web page and text file. First, we use the Readability algorithm to extract the text of the web page, and study the PageRank algorithm and TextRank algorithm, and then use the TextRank algorithm to extract keywords, key sentences and abstracts. We also develop the web application that processes web page and text file. The application can input URL, text file, or text paragraph, then application can complete the extraction of main content, abstract, keywords and key sentences.
本文主要研究了网页和文本文件的自动摘要和关键词提取技术。首先,我们使用可读性算法提取网页文本,并研究PageRank算法和TextRank算法,然后使用TextRank算法提取关键词、关键句和摘要。我们还开发了处理网页和文本文件的web应用程序。应用程序可以输入URL、文本文件或文本段落,然后应用程序可以完成主要内容、摘要、关键字和关键句的提取。
{"title":"Automatic Summarization and Keyword Extraction from Web Page or Text File","authors":"Xiangdong You","doi":"10.1109/CCET48361.2019.8989315","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989315","url":null,"abstract":"In this paper, we study the automatic summarization and keyword extraction techniques for web page and text file. First, we use the Readability algorithm to extract the text of the web page, and study the PageRank algorithm and TextRank algorithm, and then use the TextRank algorithm to extract keywords, key sentences and abstracts. We also develop the web application that processes web page and text file. The application can input URL, text file, or text paragraph, then application can complete the extraction of main content, abstract, keywords and key sentences.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124218860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Modeling a Continuous Locomotion Behavior of an Intelligent Agent Using Deep Reinforcement Technique. 基于深度强化技术的智能体连续运动行为建模。
Stephen Dankwa, Wenfeng Zheng
In this current research work, we applied a Twin- Delayed DDPG (TD3) algorithm to solve the most challenging virtual Artificial Intelligence application by training a HalfCheetah robot as an Intelligent Agent to run across a field. Twin-Delayed DDPG (TD3) is a recent breakthrough smart AI model of a Deep Reinforcement Learning which combines the state-of-the-art techniques in Artificial Intelligence, including continuous Double Deep Q-Learning, Policy Gradient and Actor-Critic. These Deep Reinforcement Learning approaches have the capabilities to train an Intelligent agent to interact with an environment with automatic feature engineering, that is, requiring minimal domain knowledge. Twin-Delayed Deep Deterministic Policy Gradient algorithm (TD3) was built on the Deep Deterministic Policy Gradient algorithm (DDPG). During the implementation of the TD3 model, we used a two- layer feedforward neural network of 400 and 300 hidden nodes respectively, with Rectified Linear Units (ReLU) as an activation function between each layer for both the Actor and Critics, and then a final tanh unit following the output of the Actor. Overall, we developed six (6) neural networks. The Critic received both the state and action as input to the first layer. Both the network parameters were updated using the Adam optimizer. The implementation of the TD3 algorithm was made possible by using the pybullet continuous control environment which was interfaced through the OpenAI Gym. The idea behind the Twin-Delayed DDPG (TD3) is to reduce overestimation bias in Deep Q-Learning with discrete actions which are ineffective in an Actor-Critic domain setting. After exposing the Agent to training for 500,000 iterations, the Agent then achieved a Maximum Average Reward over the evaluation time-step of approximately 1891. Twin-Delayed Deep Deterministic Policy Gradient (TD3) has prominently improved both the learning speed and performance of the DDPG in a challenging task in a continuous control setting.
在当前的研究工作中,我们采用双延迟DDPG (TD3)算法来解决最具挑战性的虚拟人工智能应用,通过训练HalfCheetah机器人作为智能代理(Intelligent Agent)在田野上奔跑。双延迟DDPG (TD3)是最近突破性的深度强化学习智能人工智能模型,它结合了人工智能中最先进的技术,包括连续双深度q -学习,策略梯度和行为者批评。这些深度强化学习方法能够训练智能代理通过自动特征工程与环境进行交互,也就是说,只需要最少的领域知识。双延迟深度确定性策略梯度算法(TD3)是在深度确定性策略梯度算法(DDPG)的基础上建立的。在TD3模型的实现过程中,我们使用了一个两层前馈神经网络,分别包含400和300个隐藏节点,其中校正线性单元(ReLU)作为每层之间的激活函数,用于Actor和Critics,然后在Actor的输出之后使用最终的tanh单元。总的来说,我们开发了六(6)个神经网络。批评家同时接收状态和动作作为第一层的输入。使用Adam优化器更新了两个网络参数。TD3算法的实现是通过使用通过OpenAI Gym接口的pybullet连续控制环境实现的。双延迟DDPG (TD3)背后的思想是减少深度q学习中的高估偏差,这些偏差在Actor-Critic域设置中是无效的。在将Agent暴露于500,000次迭代的训练之后,Agent在大约1891的评估时间步长上获得了最大平均奖励。双延迟深度确定性策略梯度(TD3)在连续控制环境下显著提高了DDPG在挑战性任务中的学习速度和性能。
{"title":"Modeling a Continuous Locomotion Behavior of an Intelligent Agent Using Deep Reinforcement Technique.","authors":"Stephen Dankwa, Wenfeng Zheng","doi":"10.1109/CCET48361.2019.8989177","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989177","url":null,"abstract":"In this current research work, we applied a Twin- Delayed DDPG (TD3) algorithm to solve the most challenging virtual Artificial Intelligence application by training a HalfCheetah robot as an Intelligent Agent to run across a field. Twin-Delayed DDPG (TD3) is a recent breakthrough smart AI model of a Deep Reinforcement Learning which combines the state-of-the-art techniques in Artificial Intelligence, including continuous Double Deep Q-Learning, Policy Gradient and Actor-Critic. These Deep Reinforcement Learning approaches have the capabilities to train an Intelligent agent to interact with an environment with automatic feature engineering, that is, requiring minimal domain knowledge. Twin-Delayed Deep Deterministic Policy Gradient algorithm (TD3) was built on the Deep Deterministic Policy Gradient algorithm (DDPG). During the implementation of the TD3 model, we used a two- layer feedforward neural network of 400 and 300 hidden nodes respectively, with Rectified Linear Units (ReLU) as an activation function between each layer for both the Actor and Critics, and then a final tanh unit following the output of the Actor. Overall, we developed six (6) neural networks. The Critic received both the state and action as input to the first layer. Both the network parameters were updated using the Adam optimizer. The implementation of the TD3 algorithm was made possible by using the pybullet continuous control environment which was interfaced through the OpenAI Gym. The idea behind the Twin-Delayed DDPG (TD3) is to reduce overestimation bias in Deep Q-Learning with discrete actions which are ineffective in an Actor-Critic domain setting. After exposing the Agent to training for 500,000 iterations, the Agent then achieved a Maximum Average Reward over the evaluation time-step of approximately 1891. Twin-Delayed Deep Deterministic Policy Gradient (TD3) has prominently improved both the learning speed and performance of the DDPG in a challenging task in a continuous control setting.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128363482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
A Novel Content Popularity and Distance based Interval Caching Strategy for Named Data Mobile Ad-hoc Network (NDMANET) 一种基于内容流行度和距离的命名数据移动自组网(NDMANET)间隔缓存策略
Junyu Lai, Chengkang Li, Zhongwei Chen, Yingbing Sun, Han Xiao
Information Centric Networking (ICN) is a promising future networking architecture, and Named Data Networking (NDN) is considered to be its authoritative and representative scheme. In recent years, applying ICN/NDN concept in Mobile Ad-hoc Network (MANET), i.e. Name Data Mobile Ad-hoc Network (NDMANET), becomes a research hotspot. Compared with traditional IP protocol, NDN scheme is thought to be more robust and profitable to the node mobility and dynamically changed topologies in MANET. This paper focuses on NDMANET’s in-networking caching strategy, which provides a great flexibility and efficiency for data dissemination and is a vital feature of NDMANET. Firstly, the paper investigates and analyzes some existing caching strategies which are widely applied in the ICN/NDN domain. On that basis, a novel Content Popularity and Distance based Interval (CPDI) caching strategy is derived for NDMANET, with the purpose of improving its network performance. Comprehensive simulation experiments have been carried out and the results illustrate that the proposed CPDI caching strategy can introduce considerable improvements on the average cache hit ratio, the average number of cached data packets, and the average energy consumption with only slightly degrading the average download delay.
信息中心网络(ICN)是一种很有发展前景的网络架构,命名数据网络(NDN)被认为是ICN的权威和代表性方案。近年来,在移动自组网(MANET)即名称数据移动自组网(NDMANET)中应用ICN/NDN概念成为研究热点。与传统的IP协议相比,NDN方案具有更强的鲁棒性,更有利于MANET中节点的移动性和拓扑的动态变化。NDMANET的网络内缓存策略是NDMANET的一个重要特征,它为数据分发提供了极大的灵活性和效率。本文首先对目前在ICN/NDN领域广泛应用的几种缓存策略进行了研究和分析。在此基础上,提出了一种新的基于内容流行度和距离间隔(CPDI)的NDMANET缓存策略,以提高NDMANET的网络性能。综合仿真实验结果表明,CPDI缓存策略在平均缓存命中率、平均缓存数据包数量和平均能耗方面有显著改善,而平均下载延迟仅略有降低。
{"title":"A Novel Content Popularity and Distance based Interval Caching Strategy for Named Data Mobile Ad-hoc Network (NDMANET)","authors":"Junyu Lai, Chengkang Li, Zhongwei Chen, Yingbing Sun, Han Xiao","doi":"10.1109/CCET48361.2019.8989033","DOIUrl":"https://doi.org/10.1109/CCET48361.2019.8989033","url":null,"abstract":"Information Centric Networking (ICN) is a promising future networking architecture, and Named Data Networking (NDN) is considered to be its authoritative and representative scheme. In recent years, applying ICN/NDN concept in Mobile Ad-hoc Network (MANET), i.e. Name Data Mobile Ad-hoc Network (NDMANET), becomes a research hotspot. Compared with traditional IP protocol, NDN scheme is thought to be more robust and profitable to the node mobility and dynamically changed topologies in MANET. This paper focuses on NDMANET’s in-networking caching strategy, which provides a great flexibility and efficiency for data dissemination and is a vital feature of NDMANET. Firstly, the paper investigates and analyzes some existing caching strategies which are widely applied in the ICN/NDN domain. On that basis, a novel Content Popularity and Distance based Interval (CPDI) caching strategy is derived for NDMANET, with the purpose of improving its network performance. Comprehensive simulation experiments have been carried out and the results illustrate that the proposed CPDI caching strategy can introduce considerable improvements on the average cache hit ratio, the average number of cached data packets, and the average energy consumption with only slightly degrading the average download delay.","PeriodicalId":231425,"journal":{"name":"2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130169826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1