Debiased Mapping for Full-Reference Image Quality Assessment

ArXiv Pub Date : 2023-02-22 DOI:10.48550/arXiv.2302.11464
Baoliang Chen, Hanwei Zhu, liingyu Zhu, Shiqi Wang
{"title":"Debiased Mapping for Full-Reference Image Quality Assessment","authors":"Baoliang Chen, Hanwei Zhu, liingyu Zhu, Shiqi Wang","doi":"10.48550/arXiv.2302.11464","DOIUrl":null,"url":null,"abstract":"Mapping images to deep feature space for comparisons has been wildly adopted in recent learning-based full-reference image quality assessment (FR-IQA) models. Analogous to the classical classification task, the ideal mapping space for quality regression should possess both inter-class separability and intra-class compactness. The inter-class separability that focuses on the discrimination of images with different quality levels has been highly emphasized in existing models. However, the intra-class compactness that maintains small objective quality variance of images with the same or indistinguishable quality escapes the research attention, potentially leading to the perception-biased measures. In this paper, we reveal that such bias is mainly caused by the unsuitable subspace that the features are projected and compared in. To account for this, we develop the Debiased Mapping based quality Measure (DMM), which relies on the orthonormal bases of deep learning features formed by singular value decomposition (SVD). The SVD in deep learning feature domain, which overwhelmingly separates the quality variations with singular values and projection bases, facilitates the quality inference with dedicatedly designed distance measure. Experiments on different IQA databases demonstrate the mapping method is able to mitigate the perception bias efficiently, and the superior performance on quality prediction verifies the effectiveness of our method. The implementation will be publicly available.","PeriodicalId":93888,"journal":{"name":"ArXiv","volume":"83 1-2 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ArXiv","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2302.11464","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Mapping images to deep feature space for comparisons has been wildly adopted in recent learning-based full-reference image quality assessment (FR-IQA) models. Analogous to the classical classification task, the ideal mapping space for quality regression should possess both inter-class separability and intra-class compactness. The inter-class separability that focuses on the discrimination of images with different quality levels has been highly emphasized in existing models. However, the intra-class compactness that maintains small objective quality variance of images with the same or indistinguishable quality escapes the research attention, potentially leading to the perception-biased measures. In this paper, we reveal that such bias is mainly caused by the unsuitable subspace that the features are projected and compared in. To account for this, we develop the Debiased Mapping based quality Measure (DMM), which relies on the orthonormal bases of deep learning features formed by singular value decomposition (SVD). The SVD in deep learning feature domain, which overwhelmingly separates the quality variations with singular values and projection bases, facilitates the quality inference with dedicatedly designed distance measure. Experiments on different IQA databases demonstrate the mapping method is able to mitigate the perception bias efficiently, and the superior performance on quality prediction verifies the effectiveness of our method. The implementation will be publicly available.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
全参考图像质量评估的去偏映射
在最近基于学习的全参考图像质量评估(FR-IQA)模型中,将图像映射到深度特征空间进行比较已被广泛采用。与经典的分类任务类似,质量回归的理想映射空间应该同时具有类间可分性和类内紧性。类间可分离性在现有模型中得到了高度重视,其重点是对不同质量水平的图像进行区分。然而,保持具有相同或不可区分质量的图像的小客观质量方差的类内紧密性却没有得到研究的关注,这可能导致感知偏差的测量。在本文中,我们揭示了这种偏差主要是由于特征投影和比较的子空间不合适造成的。为了解决这个问题,我们开发了基于Debiased Mapping的质量度量(DMM),它依赖于由奇异值分解(SVD)形成的深度学习特征的正交基。深度学习特征域的奇异值分解(SVD)极大地分离了具有奇异值和投影基的质量变化,便于用专门设计的距离度量进行质量推断。在不同的IQA数据库上进行的实验表明,映射方法能够有效地缓解感知偏差,并且在质量预测方面的优异性能验证了该方法的有效性。实现将是公开的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Grade Inflation in Generative Models. A recent evaluation on the performance of LLMs on radiation oncology physics using questions of randomly shuffled options. A Systematic Computational Framework for Practical Identifiability Analysis in Mathematical Models Arising from Biology. Back to the Continuous Attractor. Inferring resource competition in microbial communities from time series.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1