Pub Date : 2023-01-01Epub Date: 2023-04-13DOI: 10.4310/22-sii729
Anass El Yaagoubi Bourakna, Marco Pinto, Norbert Fortin, Hernando Ombao
Multivariate time series data appear often as realizations of non-stationary processes where the covariance matrix or spectral matrix smoothly evolve over time. Most of the current approaches estimate the time-varying spectral properties only retrospectively - that is, after the entire data has been observed. Retrospective estimation is a major limitation in many adaptive control applications where it is important to estimate these properties and detect changes in the system as they happen in real-time. To overcome this limitation, we develop an online estimation procedure that gives a real-time update of the time-varying parameters as new observations arrive. One approach to modeling non-stationary time series is to fit time-varying vector autoregressive models (tv-VAR). However, one major obstacle in online estimation of such models is the computational cost due to the high-dimensionality of the parameters. Existing methods such as the Kalman filter or local least squares are feasible. However, they are not always suitable because they provide noisy estimates and can become prohibitively costly as the dimension of the time series increases. In our brain signal application, it is critical to develop a robust method that can estimate, in real-time, the properties of the underlying stochastic process, in particular, the spectral brain connectivity measures. For these reasons we propose a new smooth online parameter estimation approach (SOPE) that has the ability to control for the smoothness of the estimates with a reasonable computational complexity. Consequently, the models are fit in real-time even for high dimensional time series. We demonstrate that our proposed SOPE approach is as good as the Kalman filter in terms of mean-squared error for small dimensions. However, unlike the Kalman filter, the SOPE has lower computational cost and hence scalable for higher dimensions. Finally, we apply the SOPE method to local field potential activity data from the hippocampus of a rat performing an odor sequence memory task. As demonstrated in the video, the proposed SOPE method is able to capture the dynamics of the connectivity as the rat samples the different odor stimuli.
{"title":"Smooth online parameter estimation for time varying VAR models with application to rat local field potential activity data.","authors":"Anass El Yaagoubi Bourakna, Marco Pinto, Norbert Fortin, Hernando Ombao","doi":"10.4310/22-sii729","DOIUrl":"10.4310/22-sii729","url":null,"abstract":"<p><p>Multivariate time series data appear often as realizations of non-stationary processes where the covariance matrix or spectral matrix smoothly evolve over time. Most of the current approaches estimate the time-varying spectral properties only retrospectively - that is, after the entire data has been observed. Retrospective estimation is a major limitation in many adaptive control applications where it is important to estimate these properties and detect changes in the system as they happen in real-time. To overcome this limitation, we develop an online estimation procedure that gives a real-time update of the time-varying parameters as new observations arrive. One approach to modeling non-stationary time series is to fit time-varying vector autoregressive models (tv-VAR). However, one major obstacle in online estimation of such models is the computational cost due to the high-dimensionality of the parameters. Existing methods such as the Kalman filter or local least squares are feasible. However, they are not always suitable because they provide noisy estimates and can become prohibitively costly as the dimension of the time series increases. In our brain signal application, it is critical to develop a robust method that can estimate, in real-time, the properties of the underlying stochastic process, in particular, the spectral brain connectivity measures. For these reasons we propose a new smooth online parameter estimation approach (SOPE) that has the ability to control for the smoothness of the estimates with a reasonable computational complexity. Consequently, the models are fit in real-time even for high dimensional time series. We demonstrate that our proposed SOPE approach is as good as the Kalman filter in terms of mean-squared error for small dimensions. However, unlike the Kalman filter, the SOPE has lower computational cost and hence scalable for higher dimensions. Finally, we apply the SOPE method to local field potential activity data from the hippocampus of a rat performing an odor sequence memory task. As demonstrated in the video, the proposed SOPE method is able to capture the dynamics of the connectivity as the rat samples the different odor stimuli.</p>","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":"227-257"},"PeriodicalIF":0.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12015553/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71152350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Classical second-order spectral analysis, which is based on the Fourier transform of the autocovariance functions, focuses on summarizing the oscillatory behaviors of a time series. However, this type of analysis is subject to two major limitations: first, being covariance-based, it cannot captures oscillatory information beyond the second moment, such as time-irreversibility and kurtosis, and cannot accommodate heavy-tail dependence and infinite variance; second, focusing on a single time series, it is unable to quantify the association between multiple time series and other covariates of interests. In this article, we propose a novel nonparametric approach to the spectral analysis of multiple time series and the associated covariates. The procedure is based on the copula spectral density kernel, which inherits the robust-ness properties of quantile regression and does not require any distributional assumptions such as the existence of finite moments. Copula spectral density kernels of different pairs are modeled jointly as a matrix to allow flexible smoothing. Through a tensor-product spline model of Cholesky components of the conditional copula spectral density matrix, the approach provides flexible nonparametric estimates of the copula spectral density matrix as nonparametric functions of frequency and covariate while preserving geometric con-straints. Empirical performance is evaluated in simulation studies and illustrated through an analysis of stride interval time series.
{"title":"Robust conditional spectral analysis of replicated time series","authors":"Zeda Li","doi":"10.4310/21-sii698","DOIUrl":"https://doi.org/10.4310/21-sii698","url":null,"abstract":"Classical second-order spectral analysis, which is based on the Fourier transform of the autocovariance functions, focuses on summarizing the oscillatory behaviors of a time series. However, this type of analysis is subject to two major limitations: first, being covariance-based, it cannot captures oscillatory information beyond the second moment, such as time-irreversibility and kurtosis, and cannot accommodate heavy-tail dependence and infinite variance; second, focusing on a single time series, it is unable to quantify the association between multiple time series and other covariates of interests. In this article, we propose a novel nonparametric approach to the spectral analysis of multiple time series and the associated covariates. The procedure is based on the copula spectral density kernel, which inherits the robust-ness properties of quantile regression and does not require any distributional assumptions such as the existence of finite moments. Copula spectral density kernels of different pairs are modeled jointly as a matrix to allow flexible smoothing. Through a tensor-product spline model of Cholesky components of the conditional copula spectral density matrix, the approach provides flexible nonparametric estimates of the copula spectral density matrix as nonparametric functions of frequency and covariate while preserving geometric con-straints. Empirical performance is evaluated in simulation studies and illustrated through an analysis of stride interval time series.","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71151106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An iterative algorithm with adaptive weights and sparse Laplacian shrinkage for regression problems","authors":"Xingyu Chen, Yuehan Yang","doi":"10.4310/22-sii732","DOIUrl":"https://doi.org/10.4310/22-sii732","url":null,"abstract":"","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71152067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Two-stage multivariate dynamic linear models to extract environmental and climate signals in coastal ecosystem data","authors":"J. Strock, G. Puggioni, S. Menden‐Deuer","doi":"10.4310/22-sii731","DOIUrl":"https://doi.org/10.4310/22-sii731","url":null,"abstract":"","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71152401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-04-14DOI: 10.4310/22-sii737
Nina Orwitz, Thaddeus Tarpey, Eva Petkova
Evolving medical technologies have motivated the development of treatment decision rules (TDRs) that incorporate complex, costly data (e.g., imaging). In clinical practice, we aim for TDRs to be valuable by reducing unnecessary testing while still identifying the best possible treatment for a patient. Regardless of how well any TDR performs in the target population, there is an associated degree of uncertainty about its optimality for a specific patient. In this paper, we aim to quantify, via a confidence measure, the uncertainty in a TDR as patient data from sequential procedures accumulate in real-time. We first propose estimating confidence using the distance of a patient's vector of covariates to a treatment decision boundary, with further distances corresponding to higher certainty. We further propose measuring confidence through the conditional probabilities of ultimately (with all possible information available) being assigned a particular treatment, given that the same treatment is assigned with the patient's currently available data or given the treatment recommendation made using only the currently available patient data. As patient data accumulate, the treatment decision is updated and confidence reassessed until a sufficiently high confidence level is achieved. We present results from simulation studies and illustrate the methods using a motivating example from a depression clinical trial. Recommendations for practical use of the measures are proposed.
{"title":"Confidence in the treatment decision for an individual patient: strategies for sequential assessment.","authors":"Nina Orwitz, Thaddeus Tarpey, Eva Petkova","doi":"10.4310/22-sii737","DOIUrl":"10.4310/22-sii737","url":null,"abstract":"<p><p>Evolving medical technologies have motivated the development of treatment decision rules (TDRs) that incorporate complex, costly data (e.g., imaging). In clinical practice, we aim for TDRs to be valuable by reducing unnecessary testing while still identifying the best possible treatment for a patient. Regardless of how well any TDR performs in the target population, there is an associated degree of uncertainty about its optimality for a specific patient. In this paper, we aim to quantify, via a confidence measure, the uncertainty in a TDR as patient data from sequential procedures accumulate in real-time. We first propose estimating confidence using the distance of a patient's vector of covariates to a treatment decision boundary, with further distances corresponding to higher certainty. We further propose measuring confidence through the conditional probabilities of ultimately (with all possible information available) being assigned a particular treatment, given that the same treatment is assigned with the patient's currently available data or given the treatment recommendation made using only the currently available patient data. As patient data accumulate, the treatment decision is updated and confidence reassessed until a sufficiently high confidence level is achieved. We present results from simulation studies and illustrate the methods using a motivating example from a depression clinical trial. Recommendations for practical use of the measures are proposed.</p>","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"16 3","pages":"475-491"},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10238081/pdf/nihms-1895097.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9575344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper discusses the dependence of gold futures prices on macro risk factors using a multiple linear regression model. Recently introduced uncertainty indexes such as geopolitical risk index and economic policy uncertainty index are included in this study. We also examine the investment nature of gold futures contract among other assets. The results provide insights on the influence of these inter-related macro economic variables on a financial derivative contract in an emerging economy and its unique position in portfolio allocation and are aimed to help practitioners and policy makers.
{"title":"Analyses of the impact of country specific macro risk variables on gold futures contract and its position as an asset class: evidence from India","authors":"Rupel Nargunam, William W. S. Wei, N. Anuradha","doi":"10.4310/21-sii697","DOIUrl":"https://doi.org/10.4310/21-sii697","url":null,"abstract":"This paper discusses the dependence of gold futures prices on macro risk factors using a multiple linear regression model. Recently introduced uncertainty indexes such as geopolitical risk index and economic policy uncertainty index are included in this study. We also examine the investment nature of gold futures contract among other assets. The results provide insights on the influence of these inter-related macro economic variables on a financial derivative contract in an emerging economy and its unique position in portfolio allocation and are aimed to help practitioners and policy makers.","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71151421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Singular spectrum analysis (SSA) is a popular tool for analysing and forecasting time series. The SSA forecasting algorithms have two parameters which should be chosen by the researcher or using the so-called automatic choice based on the root mean squared errors (RMSE) of retrospective forecasts. We study the sensitivity of the RMSE and inves-tigate the reliability of the automatic choice of parameters for forecasting monthly temperature and humidity recorded at three meteorological stations in Oman.
{"title":"Study of automatic choice of parameters for forecasting in singular spectrum analysis","authors":"Safia Al-Marhoobi, A. Pepelyshev","doi":"10.4310/21-sii707","DOIUrl":"https://doi.org/10.4310/21-sii707","url":null,"abstract":"Singular spectrum analysis (SSA) is a popular tool for analysing and forecasting time series. The SSA forecasting algorithms have two parameters which should be chosen by the researcher or using the so-called automatic choice based on the root mean squared errors (RMSE) of retrospective forecasts. We study the sensitivity of the RMSE and inves-tigate the reliability of the automatic choice of parameters for forecasting monthly temperature and humidity recorded at three meteorological stations in Oman.","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71151652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A pairwise pseudo-likelihood approach for the additive hazards model with left-truncated and interval-censored data","authors":"Peijie Wang, Yichen Lou, Jianguo Sun","doi":"10.4310/22-sii743","DOIUrl":"https://doi.org/10.4310/22-sii743","url":null,"abstract":"","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"24 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71152553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Most established techniques that search for structural breaks in time series have a difficult time identifying small changes in the process, especially when looking for narrowband frequency changes. The problem is that many of the techniques assume very smooth local spectra and tend to produce overly smooth estimates. The problem of over-smoothing tends to produce spectral estimates that miss slight frequency changes because frequencies that are close together will be lumped into one frequency. The goal of this work is to develop techniques that concentrate on detecting slight frequency changes by requiring a high degree of resolution in the frequency domain.
{"title":"AutoSpec: detection of narrowband frequency changes in time series","authors":"D. Stoffer","doi":"10.4310/21-sii703","DOIUrl":"https://doi.org/10.4310/21-sii703","url":null,"abstract":"Most established techniques that search for structural breaks in time series have a difficult time identifying small changes in the process, especially when looking for narrowband frequency changes. The problem is that many of the techniques assume very smooth local spectra and tend to produce overly smooth estimates. The problem of over-smoothing tends to produce spectral estimates that miss slight frequency changes because frequencies that are close together will be lumped into one frequency. The goal of this work is to develop techniques that concentrate on detecting slight frequency changes by requiring a high degree of resolution in the frequency domain.","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71151179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing attributable effects hypotheses with an application to the Oregon Health Insurance Experiment","authors":"M. Fredrickson, Yuguo Chen","doi":"10.4310/22-sii724","DOIUrl":"https://doi.org/10.4310/22-sii724","url":null,"abstract":"","PeriodicalId":51230,"journal":{"name":"Statistics and Its Interface","volume":"1 1","pages":""},"PeriodicalIF":0.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71152041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}