Shayan Hundrieser , Gilles Mordant , Christoph A. Weitkamp , Axel Munk
{"title":"估计成本下的经验最佳运输:分布极限和统计应用","authors":"Shayan Hundrieser , Gilles Mordant , Christoph A. Weitkamp , Axel Munk","doi":"10.1016/j.spa.2024.104462","DOIUrl":null,"url":null,"abstract":"<div><p>Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This is addressed in this paper with the derivation of distributional limits for the empirical OT value when the cost function and the measures are estimated from data. For statistical inference purposes, but also from the viewpoint of a stability analysis, understanding the fluctuation of such quantities is paramount. Our results find direct application in the problem of goodness-of-fit testing for group families, in machine learning applications where invariant transport costs arise, in the problem of estimating the distance between mixtures of distributions, and for the analysis of empirical sliced OT quantities.</p><p>The established distributional limits assume either weak convergence of the cost process in uniform norm or that the cost is determined by an optimization problem of the OT value over a fixed parameter space. For the first setting we rely on careful lower and upper bounds for the OT value in terms of the measures and the cost in conjunction with a Skorokhod representation. The second setting is based on a functional delta method for the OT value process over the parameter space. The proof techniques might be of independent interest.</p></div>","PeriodicalId":51160,"journal":{"name":"Stochastic Processes and their Applications","volume":"178 ","pages":"Article 104462"},"PeriodicalIF":1.1000,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0304414924001686/pdfft?md5=85ae0030da302445cc5b0165b5edb030&pid=1-s2.0-S0304414924001686-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Empirical optimal transport under estimated costs: Distributional limits and statistical applications\",\"authors\":\"Shayan Hundrieser , Gilles Mordant , Christoph A. Weitkamp , Axel Munk\",\"doi\":\"10.1016/j.spa.2024.104462\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This is addressed in this paper with the derivation of distributional limits for the empirical OT value when the cost function and the measures are estimated from data. For statistical inference purposes, but also from the viewpoint of a stability analysis, understanding the fluctuation of such quantities is paramount. Our results find direct application in the problem of goodness-of-fit testing for group families, in machine learning applications where invariant transport costs arise, in the problem of estimating the distance between mixtures of distributions, and for the analysis of empirical sliced OT quantities.</p><p>The established distributional limits assume either weak convergence of the cost process in uniform norm or that the cost is determined by an optimization problem of the OT value over a fixed parameter space. For the first setting we rely on careful lower and upper bounds for the OT value in terms of the measures and the cost in conjunction with a Skorokhod representation. The second setting is based on a functional delta method for the OT value process over the parameter space. The proof techniques might be of independent interest.</p></div>\",\"PeriodicalId\":51160,\"journal\":{\"name\":\"Stochastic Processes and their Applications\",\"volume\":\"178 \",\"pages\":\"Article 104462\"},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2024-08-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0304414924001686/pdfft?md5=85ae0030da302445cc5b0165b5edb030&pid=1-s2.0-S0304414924001686-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Stochastic Processes and their Applications\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0304414924001686\",\"RegionNum\":2,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"STATISTICS & PROBABILITY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Stochastic Processes and their Applications","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0304414924001686","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0
摘要
基于数据的优化运输(OT)分析经常会遇到基础成本函数(部分)未知的问题。本文针对这一问题,推导了根据数据估算成本函数和度量值时,经验 OT 值的分布极限。无论是出于统计推断的目的,还是从稳定性分析的角度来看,理解这些量的波动都是至关重要的。我们的结果可直接应用于群族拟合优度测试问题、出现不变传输成本的机器学习应用、估计分布混合物间距离的问题,以及经验切片加时赛量的分析。在第一种情况下,我们依靠的是根据度量和成本以及 Skorokhod 表示法对 OT 值进行仔细的下限和上限计算。第二种情况是基于参数空间上 OT 值过程的函数三角法。这些证明技术可能会引起不同的兴趣。
Empirical optimal transport under estimated costs: Distributional limits and statistical applications
Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This is addressed in this paper with the derivation of distributional limits for the empirical OT value when the cost function and the measures are estimated from data. For statistical inference purposes, but also from the viewpoint of a stability analysis, understanding the fluctuation of such quantities is paramount. Our results find direct application in the problem of goodness-of-fit testing for group families, in machine learning applications where invariant transport costs arise, in the problem of estimating the distance between mixtures of distributions, and for the analysis of empirical sliced OT quantities.
The established distributional limits assume either weak convergence of the cost process in uniform norm or that the cost is determined by an optimization problem of the OT value over a fixed parameter space. For the first setting we rely on careful lower and upper bounds for the OT value in terms of the measures and the cost in conjunction with a Skorokhod representation. The second setting is based on a functional delta method for the OT value process over the parameter space. The proof techniques might be of independent interest.
期刊介绍:
Stochastic Processes and their Applications publishes papers on the theory and applications of stochastic processes. It is concerned with concepts and techniques, and is oriented towards a broad spectrum of mathematical, scientific and engineering interests.
Characterization, structural properties, inference and control of stochastic processes are covered. The journal is exacting and scholarly in its standards. Every effort is made to promote innovation, vitality, and communication between disciplines. All papers are refereed.