{"title":"基于跨模态检索的剪辑模板推荐","authors":"Zhiyi Zhu, Xiaoyu Wu, Xueting Yang, Kai Zhang, Haoyi Yu, Xiangshan Chen","doi":"10.1109/cost57098.2022.00071","DOIUrl":null,"url":null,"abstract":"Nowadays, the use of video editing software has increased dramatically. However, there is a problem of insufficient intelligence in the recommendation of clip templates in these software. Therefore, this paper addresses this problem and devotes to combining machine learning algorithms and deep learning to achieve optimization of video clip template recommendation, and proposes the design of a clip template recommendation system based on cross-modal retrieval technology. Firstly, the Requests module is used to crawl some data from Baidu images and NetEase cloud music websites and store them persistently as components of user templates to make the templates diverse and meet the needs of more users. Secondly, the algorithm network construction based on PyTorch framework was completed to realize background replacement and music matching, improve the template matching mechanism for users, and generate videos from images; finally, the Android Studio platform was used to develop the APP for Android system, and the Web server was built to realize the data interaction between the client side and the server side, so that users can easily use the APP to get functional experience.","PeriodicalId":135595,"journal":{"name":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","volume":"57 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Recommendation of Clip Templates Based on Cross-Modal Retrieval\",\"authors\":\"Zhiyi Zhu, Xiaoyu Wu, Xueting Yang, Kai Zhang, Haoyi Yu, Xiangshan Chen\",\"doi\":\"10.1109/cost57098.2022.00071\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Nowadays, the use of video editing software has increased dramatically. However, there is a problem of insufficient intelligence in the recommendation of clip templates in these software. Therefore, this paper addresses this problem and devotes to combining machine learning algorithms and deep learning to achieve optimization of video clip template recommendation, and proposes the design of a clip template recommendation system based on cross-modal retrieval technology. Firstly, the Requests module is used to crawl some data from Baidu images and NetEase cloud music websites and store them persistently as components of user templates to make the templates diverse and meet the needs of more users. Secondly, the algorithm network construction based on PyTorch framework was completed to realize background replacement and music matching, improve the template matching mechanism for users, and generate videos from images; finally, the Android Studio platform was used to develop the APP for Android system, and the Web server was built to realize the data interaction between the client side and the server side, so that users can easily use the APP to get functional experience.\",\"PeriodicalId\":135595,\"journal\":{\"name\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"volume\":\"57 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/cost57098.2022.00071\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/cost57098.2022.00071","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Recommendation of Clip Templates Based on Cross-Modal Retrieval
Nowadays, the use of video editing software has increased dramatically. However, there is a problem of insufficient intelligence in the recommendation of clip templates in these software. Therefore, this paper addresses this problem and devotes to combining machine learning algorithms and deep learning to achieve optimization of video clip template recommendation, and proposes the design of a clip template recommendation system based on cross-modal retrieval technology. Firstly, the Requests module is used to crawl some data from Baidu images and NetEase cloud music websites and store them persistently as components of user templates to make the templates diverse and meet the needs of more users. Secondly, the algorithm network construction based on PyTorch framework was completed to realize background replacement and music matching, improve the template matching mechanism for users, and generate videos from images; finally, the Android Studio platform was used to develop the APP for Android system, and the Web server was built to realize the data interaction between the client side and the server side, so that users can easily use the APP to get functional experience.