{"title":"A special section honoring Nils Lid Hjort","authors":"Ørnulf Borgan, Ingrid K. Glad","doi":"10.1111/sjos.12745","DOIUrl":"https://doi.org/10.1111/sjos.12745","url":null,"abstract":"","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141780376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Louise Alamichel, Daria Bystrova, Julyan Arbel, Guillaume Kon Kam King
Bayesian nonparametric mixture models are common for modeling complex data. While these models are well‐suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of components is finite, for the Dirichlet process and Pitman–Yor process mixture models. We extend these results to additional Bayesian nonparametric priors such as Gibbs‐type processes and finite‐dimensional representations thereof. The latter include the Dirichlet multinomial process, the recently proposed Pitman–Yor, and normalized generalized gamma multinomial processes. We show that mixture models based on these processes are also inconsistent in the number of clusters and discuss possible solutions. Notably, we show that a postprocessing algorithm introduced for the Dirichlet process can be extended to more general models and provides a consistent method to estimate the number of components.
{"title":"Bayesian mixture models (in)consistency for the number of clusters","authors":"Louise Alamichel, Daria Bystrova, Julyan Arbel, Guillaume Kon Kam King","doi":"10.1111/sjos.12739","DOIUrl":"https://doi.org/10.1111/sjos.12739","url":null,"abstract":"Bayesian nonparametric mixture models are common for modeling complex data. While these models are well‐suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of components is finite, for the Dirichlet process and Pitman–Yor process mixture models. We extend these results to additional Bayesian nonparametric priors such as Gibbs‐type processes and finite‐dimensional representations thereof. The latter include the Dirichlet multinomial process, the recently proposed Pitman–Yor, and normalized generalized gamma multinomial processes. We show that mixture models based on these processes are also inconsistent in the number of clusters and discuss possible solutions. Notably, we show that a postprocessing algorithm introduced for the Dirichlet process can be extended to more general models and provides a consistent method to estimate the number of components.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141780375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Georgios Aristotelous, Theodore Kypraios, Philip D. O'Neill
This paper addresses the problem of assessing the homogeneity of the disease transmission process in stochastic epidemic models in populations that are partitioned into social groups. We develop a classical hypothesis test for completed epidemics which assesses whether or not there is significant within‐group transmission during an outbreak. The test is based on time‐ordered group labels of individuals. The null hypothesis is that of homogeneity of disease transmission among individuals, a hypothesis under which the discrete random vector of groups labels has a known sampling distribution that is independent of any model parameters. The test exhibits excellent performance when applied to various scenarios of simulated data and is also illustrated using two real‐life epidemic data sets. We develop some asymptotic theory including a central limit theorem. The test is practically very appealing, being computationally cheap and straightforward to implement, as well as being applicable to a wide range of real‐life outbreak settings and to related problems in other fields.
{"title":"A classical hypothesis test for assessing the homogeneity of disease transmission in stochastic epidemic models","authors":"Georgios Aristotelous, Theodore Kypraios, Philip D. O'Neill","doi":"10.1111/sjos.12743","DOIUrl":"https://doi.org/10.1111/sjos.12743","url":null,"abstract":"This paper addresses the problem of assessing the homogeneity of the disease transmission process in stochastic epidemic models in populations that are partitioned into social groups. We develop a classical hypothesis test for completed epidemics which assesses whether or not there is significant within‐group transmission during an outbreak. The test is based on time‐ordered group labels of individuals. The null hypothesis is that of homogeneity of disease transmission among individuals, a hypothesis under which the discrete random vector of groups labels has a known sampling distribution that is independent of any model parameters. The test exhibits excellent performance when applied to various scenarios of simulated data and is also illustrated using two real‐life epidemic data sets. We develop some asymptotic theory including a central limit theorem. The test is practically very appealing, being computationally cheap and straightforward to implement, as well as being applicable to a wide range of real‐life outbreak settings and to related problems in other fields.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141738111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper analyzes several covariance matrix U‐tests, which are constructed by modifying the classical John‐Nagao and Ledoit‐Wolf tests, under the elliptically distributed data structure. We study the limiting distributions of these location‐invariant test statistics as the data dimension may go to infinity in an arbitrary way as the sample size does. We find that they tend to have unsatisfactory size performances for general elliptical population. This is mainly because such population often possesses high‐order correlations among their coordinates. Taking such kind of dependency into consideration, we propose necessary corrections for these tests to cope with elliptically high‐dimensional data. For computational efficiency, alternative forms of the new test statistics are also provided. We derive the universal asymptotic null distributions of the proposed test statistics under elliptical distributions and beyond. The powers of the proposed tests are further investigated. The accuracy of the tests is demonstrated by simulations and an empirical study.
本文分析了椭圆分布数据结构下的几种协方差矩阵 U 检验,这些检验是通过修改经典的 John-Nagao 检验和 Ledoit-Wolf 检验而构建的。我们研究了这些位置不变检验统计量的极限分布,因为随着样本量的增加,数据维度可能会以任意方式达到无穷大。我们发现,对于一般的椭圆群体,这些统计量的大小表现往往不能令人满意。这主要是因为这类群体的坐标之间往往具有高阶相关性。考虑到这种依赖性,我们对这些检验提出了必要的修正,以应对椭圆高维数据。为了提高计算效率,我们还提供了新检验统计量的替代形式。我们推导出了所提出的检验统计量在椭圆分布及其他分布下的普遍渐近零分布。我们还进一步研究了拟议检验的幂。我们通过模拟和实证研究证明了检验的准确性。
{"title":"Adjusted location‐invariant U‐tests for the covariance matrix with elliptically high‐dimensional data","authors":"Kai Xu, Yeqing Zhou, Liping Zhu","doi":"10.1111/sjos.12738","DOIUrl":"https://doi.org/10.1111/sjos.12738","url":null,"abstract":"This paper analyzes several covariance matrix U‐tests, which are constructed by modifying the classical John‐Nagao and Ledoit‐Wolf tests, under the elliptically distributed data structure. We study the limiting distributions of these location‐invariant test statistics as the data dimension may go to infinity in an arbitrary way as the sample size does. We find that they tend to have unsatisfactory size performances for general elliptical population. This is mainly because such population often possesses high‐order correlations among their coordinates. Taking such kind of dependency into consideration, we propose necessary corrections for these tests to cope with elliptically high‐dimensional data. For computational efficiency, alternative forms of the new test statistics are also provided. We derive the universal asymptotic null distributions of the proposed test statistics under elliptical distributions and beyond. The powers of the proposed tests are further investigated. The accuracy of the tests is demonstrated by simulations and an empirical study.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":0.8,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141649823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We study the problem of the nonparametric estimation for the density of the stationary distribution of a ‐dimensional stochastic differential equation . From the continuous observation of the sampling path on , we study the estimation of as goes to infinity. For , we characterize the minimax rate for the ‐risk in pointwise estimation over a class of anisotropic Hölder functions with regularity . For , our finding is that, having ordered the smoothness such that , the minimax rate depends on whether or . In the first case, this rate is , and in the second case, it is , where is an explicit exponent dependent on the dimension and , the harmonic mean of smoothness over the directions after excluding and , the smallest ones. We also demonstrate that kernel‐based estimators achieve the optimal minimax rate. Furthermore, we propose an adaptive procedure for both integrated and pointwise risk. In the two‐dimensional case, we show that kernel density estimators achieve the rate , which is optimal in the minimax sense. Finally we illustrate the validity of our theoretical findings by proposing numerical results.
{"title":"Minimax rate of estimation for invariant densities associated to continuous stochastic differential equations over anisotropic Hölder classes","authors":"Chiara Amorino, Arnaud Gloter","doi":"10.1111/sjos.12735","DOIUrl":"https://doi.org/10.1111/sjos.12735","url":null,"abstract":"We study the problem of the nonparametric estimation for the density of the stationary distribution of a ‐dimensional stochastic differential equation . From the continuous observation of the sampling path on , we study the estimation of as goes to infinity. For , we characterize the minimax rate for the ‐risk in pointwise estimation over a class of anisotropic Hölder functions with regularity . For , our finding is that, having ordered the smoothness such that , the minimax rate depends on whether or . In the first case, this rate is , and in the second case, it is , where is an explicit exponent dependent on the dimension and , the harmonic mean of smoothness over the directions after excluding and , the smallest ones. We also demonstrate that kernel‐based estimators achieve the optimal minimax rate. Furthermore, we propose an adaptive procedure for both integrated and pointwise risk. In the two‐dimensional case, we show that kernel density estimators achieve the rate , which is optimal in the minimax sense. Finally we illustrate the validity of our theoretical findings by proposing numerical results.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614551","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The win ratio has in the recent decade gained popularity for analyzing prioritized multiple event data in clinical cohort studies, in particular within cardiovascular research. The literature on estimation of the win ratio using censored event data is however sparse. The methods that have been suggested have either an insufficient adjustment of the censoring or by assuming the the win and loss probabilities are proportional over time. The assumption of proportional win and loss probabilities will often in practice not be satisfied. In this paper, we present estimates for the win ratio, and win and loss probabilities, under independent right‐censoring and derive the asymptotic distribution of the estimates. The proposed win ratio estimate does not require the assumption of proportional win and loss probabilities. The small sample properties of the proposed method are studied in a simulation study showing that the variance formula is accurate even for small samples. The method is applied on two data sets.
{"title":"Estimation of win, loss probabilities, and win ratio based on right‐censored event data","authors":"Erik T. Parner, Morten Overgaard","doi":"10.1111/sjos.12734","DOIUrl":"https://doi.org/10.1111/sjos.12734","url":null,"abstract":"The win ratio has in the recent decade gained popularity for analyzing prioritized multiple event data in clinical cohort studies, in particular within cardiovascular research. The literature on estimation of the win ratio using censored event data is however sparse. The methods that have been suggested have either an insufficient adjustment of the censoring or by assuming the the win and loss probabilities are proportional over time. The assumption of proportional win and loss probabilities will often in practice not be satisfied. In this paper, we present estimates for the win ratio, and win and loss probabilities, under independent right‐censoring and derive the asymptotic distribution of the estimates. The proposed win ratio estimate does not require the assumption of proportional win and loss probabilities. The small sample properties of the proposed method are studied in a simulation study showing that the variance formula is accurate even for small samples. The method is applied on two data sets.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141548567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Commentary on “Pitfalls of amateur regression: The Dutch New Herring controversies”","authors":"Jan C. Van Ours, Ben Vollaard","doi":"10.1111/sjos.12741","DOIUrl":"https://doi.org/10.1111/sjos.12741","url":null,"abstract":"","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141548566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hyperspherical kernel density estimators (KDE), which use a parametric distribution as a guide, are studied in this paper. The main benefit is that these estimators improve the bias of nonguided kernel density estimators when the parametric guiding distribution is not too far from the true density, while preserving the variance. When using a von Mises‐Fisher density as guide, the proposal performs as well as the classical KDE, even when the guiding model is incorrect, and far from the true distribution. This benefit is particular for the hyperspherical setting given its compact support, and is in contrast to similar methods for real valued data. Moreover, we deal with the important issue of data‐driven selection of the smoothing parameter. Simulations and real data examples illustrate the finite‐sample performance of the proposed method, also in comparison with other recently proposed estimation methods.
本文研究了使用参数分布作为导向的超球核密度估计器(KDE)。其主要优点是,当参数指导分布与真实密度相差不大时,这些估计器可以改善非指导核密度估计器的偏差,同时保留方差。当使用 von Mises-Fisher 密度作为指导时,即使指导模型不正确且与真实分布相差甚远,该提案的性能也不亚于经典的 KDE。考虑到超球面的紧凑支持,这种优势在超球面设置中尤为明显,这与用于实值数据的类似方法形成了鲜明对比。此外,我们还处理了数据驱动的平滑参数选择这一重要问题。模拟和真实数据实例说明了所提方法的有限样本性能,同时也与最近提出的其他估计方法进行了比较。
{"title":"Nonparametric estimation of densities on the hypersphere using a parametric guide","authors":"María Alonso‐Pena, Gerda Claeskens, Irène Gijbels","doi":"10.1111/sjos.12737","DOIUrl":"https://doi.org/10.1111/sjos.12737","url":null,"abstract":"Hyperspherical kernel density estimators (KDE), which use a parametric distribution as a guide, are studied in this paper. The main benefit is that these estimators improve the bias of nonguided kernel density estimators when the parametric guiding distribution is not too far from the true density, while preserving the variance. When using a von Mises‐Fisher density as guide, the proposal performs as well as the classical KDE, even when the guiding model is incorrect, and far from the true distribution. This benefit is particular for the hyperspherical setting given its compact support, and is in contrast to similar methods for real valued data. Moreover, we deal with the important issue of data‐driven selection of the smoothing parameter. Simulations and real data examples illustrate the finite‐sample performance of the proposed method, also in comparison with other recently proposed estimation methods.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141548569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
We suggest novel correlation coefficients which equal the maximum correlation for a class of bivariate Lancaster distributions while being only slightly smaller than maximum correlation for a variety of further bivariate distributions. In contrast to maximum correlation, however, our correlation coefficients allow for rank and moment‐based estimators which are simple to compute and have tractable asymptotic distributions. Confidence intervals resulting from these asymptotic approximations and the covariance bootstrap show good finite‐sample coverage. In a simulation, the power of asymptotic as well as permutation tests for independence based on our correlation measures compares favorably with competing methods based on distance correlation or rank coefficients for functional dependence, among others. Moreover, for the bivariate normal distribution, our correlation coefficients equal the absolute value of the Pearson correlation, an attractive feature for practitioners which is not shared by various competitors. We illustrate the practical usefulness of our methods in applications to two real data sets.
{"title":"Lancaster correlation: A new dependence measure linked to maximum correlation","authors":"Hajo Holzmann, Bernhard Klar","doi":"10.1111/sjos.12733","DOIUrl":"https://doi.org/10.1111/sjos.12733","url":null,"abstract":"We suggest novel correlation coefficients which equal the maximum correlation for a class of bivariate Lancaster distributions while being only slightly smaller than maximum correlation for a variety of further bivariate distributions. In contrast to maximum correlation, however, our correlation coefficients allow for rank and moment‐based estimators which are simple to compute and have tractable asymptotic distributions. Confidence intervals resulting from these asymptotic approximations and the covariance bootstrap show good finite‐sample coverage. In a simulation, the power of asymptotic as well as permutation tests for independence based on our correlation measures compares favorably with competing methods based on distance correlation or rank coefficients for functional dependence, among others. Moreover, for the bivariate normal distribution, our correlation coefficients equal the absolute value of the Pearson correlation, an attractive feature for practitioners which is not shared by various competitors. We illustrate the practical usefulness of our methods in applications to two real data sets.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141548568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Claudio Heinrich‐Mertsching, Thordis L. Thorarinsdottir, Peter Guttorp, Max Schneider
We introduce a class of proper scoring rules for evaluating spatial point process forecasts based on summary statistics. These scoring rules rely on Monte Carlo approximations of expectations and can therefore easily be evaluated for any point process model that can be simulated. In this regard, they are more flexible than the commonly used logarithmic score and other existing proper scores for point process predictions. The scoring rules allow for evaluating the calibration of a model to specific aspects of a point process, such as its spatial distribution or tendency toward clustering. Using simulations, we analyze the sensitivity of our scoring rules to different aspects of the forecasts and compare it to the logarithmic score. Applications to earthquake occurrences in northern California, United States and the spatial distribution of Pacific silver firs in Findley Lake Reserve in Washington highlight the usefulness of our scores for scientific model selection.
{"title":"Validation of point process predictions with proper scoring rules","authors":"Claudio Heinrich‐Mertsching, Thordis L. Thorarinsdottir, Peter Guttorp, Max Schneider","doi":"10.1111/sjos.12736","DOIUrl":"https://doi.org/10.1111/sjos.12736","url":null,"abstract":"We introduce a class of proper scoring rules for evaluating spatial point process forecasts based on summary statistics. These scoring rules rely on Monte Carlo approximations of expectations and can therefore easily be evaluated for any point process model that can be simulated. In this regard, they are more flexible than the commonly used logarithmic score and other existing proper scores for point process predictions. The scoring rules allow for evaluating the calibration of a model to specific aspects of a point process, such as its spatial distribution or tendency toward clustering. Using simulations, we analyze the sensitivity of our scoring rules to different aspects of the forecasts and compare it to the logarithmic score. Applications to earthquake occurrences in northern California, United States and the spatial distribution of Pacific silver firs in Findley Lake Reserve in Washington highlight the usefulness of our scores for scientific model selection.","PeriodicalId":49567,"journal":{"name":"Scandinavian Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}