What Is a Multi-Modal Knowledge Graph: A Survey

IF 4.2 3区计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Big Data Research Pub Date : 2023-05-28 DOI:10.1016/j.bdr.2023.100380

Jinghui Peng, Xinyu Hu, Wenbo Huang, Jian Yang

引用次数: 0

Abstract

With the explosive growth of multi-modal information on the Internet, the multi-modal knowledge graph (MMKG) has become an important research topic in knowledge graphs to meet the needs of data management and application. Most research on MMKG has taken image-text data as the research object and used the multi-modal deep learning approach to process multi-modal data. In comparison, the structure of the MMKG is no uniform statement. This paper focuses on MMKG, introduces the related theories of multi-modal knowledge, and analyzes several common ideas about its construction. The survey also explains the structural evolution, proposes mirror node alignment to represent cross-modal knowledge for MMKG, lists some tasks' difficulties, and ultimately gives a sample MMKG for the news scene.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

什么是多模态知识图谱:综述

随着互联网上多模态信息的爆炸式增长，为了满足数据管理和应用的需要，多模态知识图（MMKG）已成为知识图中的一个重要研究课题。大多数关于MMKG的研究都以图像文本数据为研究对象，并使用多模态深度学习方法来处理多模态数据。相比之下，MMKG的结构并不是一个统一的说法。本文以MMKG为研究对象，介绍了多模态知识的相关理论，并分析了其构建的几种常见思想。调查还解释了结构演变，提出了镜像节点对齐来表示MMKG的跨模态知识，列出了一些任务的困难，并最终给出了新闻场景的MMKG样本。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Big Data Research Computer Science-Computer Science Applications

CiteScore

8.40

自引率

3.00%

发文量

期刊介绍： The journal aims to promote and communicate advances in big data research by providing a fast and high quality forum for researchers, practitioners and policy makers from the very many different communities working on, and with, this topic. The journal will accept papers on foundational aspects in dealing with big data, as well as papers on specific Platforms and Technologies used to deal with big data. To promote Data Science and interdisciplinary collaboration between fields, and to showcase the benefits of data driven research, papers demonstrating applications of big data in domains as diverse as Geoscience, Social Web, Finance, e-Commerce, Health Care, Environment and Climate, Physics and Astronomy, Chemistry, life sciences and drug discovery, digital libraries and scientific publications, security and government will also be considered. Occasionally the journal may publish whitepapers on policies, standards and best practices.

期刊最新文献

Realistic image-to-image machine unlearning via decoupling and knowledge retention Explainable classification of astronomical uncertain time series Opinion fraud detection on massive datasets by spark Large-scale least squares regression based on fast spectral embedding and random Fourier feature mapping VertexLocater: PIM-enabled dynamic offloading for graph computing