FFEINR: flow feature-enhanced implicit neural representation for spatiotemporal super-resolution

IF 1.7 4区 计算机科学 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Journal of Visualization Pub Date : 2024-02-19 DOI:10.1007/s12650-024-00959-1
Chenyue Jiao, Chongke Bi, Lu Yang
{"title":"FFEINR: flow feature-enhanced implicit neural representation for spatiotemporal super-resolution","authors":"Chenyue Jiao, Chongke Bi, Lu Yang","doi":"10.1007/s12650-024-00959-1","DOIUrl":null,"url":null,"abstract":"<p>Large-scale numerical simulations are capable of generating data up to terabytes or even petabytes. As a promising method of data reduction, super-resolution (SR) has been widely studied in the scientific visualization community. However, most of them are based on deep convolutional neural networks or generative adversarial networks and the scale factor needs to be determined before constructing the network. As a result, a single training session only supports a fixed factor and has poor generalization ability. To address these problems, this paper proposes a flow feature-enhanced implicit neural representation (FFEINR) for spatiotemporal super-resolution of flow field data. It can take full advantage of the implicit neural representation in terms of model structure and sampling resolution. The neural representation is based on a fully connected network with periodic activation functions, which enables us to obtain lightweight models. The learned continuous representation can decode the low-resolution flow field input data to arbitrary spatial and temporal resolutions, allowing for flexible upsampling. The training process of FFEINR is facilitated by introducing feature enhancements for the input layer, which complements the contextual information of the flow field. To demonstrate the effectiveness of the proposed method, a series of experiments are conducted on different datasets by setting different hyperparameters. The results show that FFEINR achieves significantly better results than the trilinear interpolation method.</p><h3 data-test=\"abstract-sub-heading\">Graphical abstract</h3>\n","PeriodicalId":54756,"journal":{"name":"Journal of Visualization","volume":"15 1","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2024-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Visualization","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s12650-024-00959-1","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Large-scale numerical simulations are capable of generating data up to terabytes or even petabytes. As a promising method of data reduction, super-resolution (SR) has been widely studied in the scientific visualization community. However, most of them are based on deep convolutional neural networks or generative adversarial networks and the scale factor needs to be determined before constructing the network. As a result, a single training session only supports a fixed factor and has poor generalization ability. To address these problems, this paper proposes a flow feature-enhanced implicit neural representation (FFEINR) for spatiotemporal super-resolution of flow field data. It can take full advantage of the implicit neural representation in terms of model structure and sampling resolution. The neural representation is based on a fully connected network with periodic activation functions, which enables us to obtain lightweight models. The learned continuous representation can decode the low-resolution flow field input data to arbitrary spatial and temporal resolutions, allowing for flexible upsampling. The training process of FFEINR is facilitated by introducing feature enhancements for the input layer, which complements the contextual information of the flow field. To demonstrate the effectiveness of the proposed method, a series of experiments are conducted on different datasets by setting different hyperparameters. The results show that FFEINR achieves significantly better results than the trilinear interpolation method.

Graphical abstract

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
FFEINR:用于时空超分辨率的流特征增强隐式神经表征
大规模数值模拟能够产生高达 TB 甚至 PB 的数据。超分辨率(SR)作为一种很有前景的数据缩减方法,在科学可视化领域得到了广泛研究。然而,它们大多基于深度卷积神经网络或生成对抗网络,需要在构建网络之前确定规模因子。因此,单次训练只能支持固定的因子,泛化能力较差。针对这些问题,本文提出了一种用于流场数据时空超分辨率的流量特征增强隐式神经表示(FFEINR)。它可以充分利用隐式神经表示在模型结构和采样分辨率方面的优势。神经表征基于具有周期性激活函数的全连接网络,这使我们能够获得轻量级模型。学习到的连续表征可以将低分辨率流场输入数据解码为任意的空间和时间分辨率,从而实现灵活的上采样。FFEINR 的训练过程通过为输入层引入特征增强来实现,从而补充了流场的上下文信息。为了证明所提方法的有效性,通过设置不同的超参数,在不同的数据集上进行了一系列实验。结果表明,FFEINR 的效果明显优于三线插值法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Visualization
Journal of Visualization COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-IMAGING SCIENCE & PHOTOGRAPHIC TECHNOLOGY
CiteScore
3.40
自引率
5.90%
发文量
79
审稿时长
>12 weeks
期刊介绍: Visualization is an interdisciplinary imaging science devoted to making the invisible visible through the techniques of experimental visualization and computer-aided visualization. The scope of the Journal is to provide a place to exchange information on the latest visualization technology and its application by the presentation of latest papers of both researchers and technicians.
期刊最新文献
Visualizing particle velocity from dual-camera mixed reality video images using 3D particle tracking velocimetry Numerical investigations of heat transfer enhancement in ionic liquid-piston compressor using cooling pipes Scatterplot selection for dimensionality reduction in multidimensional data visualization Robust and multiresolution sparse processing particle image velocimetry for improvement in spatial resolution A user study of visualisations of spatio-temporal eye tracking data
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1