{"title":"使用函数哈希法进行动态参数预测的可视化问答","authors":"Chunye Li, Zhiping Zhou","doi":"10.1145/3366194.3366252","DOIUrl":null,"url":null,"abstract":"The dynamic parameter prediction model (DPPnet) established a mapping between the original space and the compression space by HashedNet for Visual Question Answering (VQA). HashedNet is a single-seeded random hash function, so the collision rate is linear to the compression ratio. In order to relieve the interference of the conflict rate to VQA and improve the stability and accuracy of the model, we introduce a multi-seed random hashing compression named functional hashing to be used as the fusion mechanism in this paper. Multiple pairs of independent random hash function are active and the variable parameters among them are trained by a lightweight reconfigurable neural network, making the compression mechanism more flexible. In addition, we use Bi-GRU to extract the historical and future context information from question sentences. At the same time, we propose gated convolution to selectively learn the feature from images questioned dynamically. Experimental results show that our proposed method achieves higher accuracy compared with existing models.","PeriodicalId":105852,"journal":{"name":"Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Visual Question Answering with Dynamic Parameter Prediction using Functional Hashing\",\"authors\":\"Chunye Li, Zhiping Zhou\",\"doi\":\"10.1145/3366194.3366252\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The dynamic parameter prediction model (DPPnet) established a mapping between the original space and the compression space by HashedNet for Visual Question Answering (VQA). HashedNet is a single-seeded random hash function, so the collision rate is linear to the compression ratio. In order to relieve the interference of the conflict rate to VQA and improve the stability and accuracy of the model, we introduce a multi-seed random hashing compression named functional hashing to be used as the fusion mechanism in this paper. Multiple pairs of independent random hash function are active and the variable parameters among them are trained by a lightweight reconfigurable neural network, making the compression mechanism more flexible. In addition, we use Bi-GRU to extract the historical and future context information from question sentences. At the same time, we propose gated convolution to selectively learn the feature from images questioned dynamically. Experimental results show that our proposed method achieves higher accuracy compared with existing models.\",\"PeriodicalId\":105852,\"journal\":{\"name\":\"Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3366194.3366252\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3366194.3366252","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Visual Question Answering with Dynamic Parameter Prediction using Functional Hashing
The dynamic parameter prediction model (DPPnet) established a mapping between the original space and the compression space by HashedNet for Visual Question Answering (VQA). HashedNet is a single-seeded random hash function, so the collision rate is linear to the compression ratio. In order to relieve the interference of the conflict rate to VQA and improve the stability and accuracy of the model, we introduce a multi-seed random hashing compression named functional hashing to be used as the fusion mechanism in this paper. Multiple pairs of independent random hash function are active and the variable parameters among them are trained by a lightweight reconfigurable neural network, making the compression mechanism more flexible. In addition, we use Bi-GRU to extract the historical and future context information from question sentences. At the same time, we propose gated convolution to selectively learn the feature from images questioned dynamically. Experimental results show that our proposed method achieves higher accuracy compared with existing models.