Pub Date : 2024-02-07DOI: 10.1080/00401706.2024.2315937
Jiangyan Zhao, Jin Xu
Constrained optimization problems pose challenges when the objective function and constraints are nonconvex and their evaluation requires expensive black-box simulations. Recently, hybrid optimizat...
{"title":"Bayesian Optimization via Exact Penalty","authors":"Jiangyan Zhao, Jin Xu","doi":"10.1080/00401706.2024.2315937","DOIUrl":"https://doi.org/10.1080/00401706.2024.2315937","url":null,"abstract":"Constrained optimization problems pose challenges when the objective function and constraints are nonconvex and their evaluation requires expensive black-box simulations. Recently, hybrid optimizat...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"3 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139759916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-22DOI: 10.1080/00401706.2024.2308202
Joonpyo Kim, Hee-Seok Oh, Haeran Cho
Abstract–We propose a computationally and statistically efficient procedure for segmenting univariate data under piecewise linearity. The proposed moving sum (MOSUM) methodology detects multiple ch...
{"title":"Moving sum procedure for change point detection under piecewise linearity","authors":"Joonpyo Kim, Hee-Seok Oh, Haeran Cho","doi":"10.1080/00401706.2024.2308202","DOIUrl":"https://doi.org/10.1080/00401706.2024.2308202","url":null,"abstract":"Abstract–We propose a computationally and statistically efficient procedure for segmenting univariate data under piecewise linearity. The proposed moving sum (MOSUM) methodology detects multiple ch...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"160 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139553564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-18DOI: 10.1080/00401706.2024.2304341
Arnald Puy, Pamphile T. Roy, Andrea Saltelli
While sensitivity analysis improves the transparency and reliability of mathematical models, its uptake by modelers is still scarce. This is partially explained by its technical requirements, which...
{"title":"Discrepancy measures for global sensitivity analysis","authors":"Arnald Puy, Pamphile T. Roy, Andrea Saltelli","doi":"10.1080/00401706.2024.2304341","DOIUrl":"https://doi.org/10.1080/00401706.2024.2304341","url":null,"abstract":"While sensitivity analysis improves the transparency and reliability of mathematical models, its uptake by modelers is still scarce. This is partially explained by its technical requirements, which...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"108 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139507562","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-10DOI: 10.1080/00401706.2024.2304334
Yan Gong, Peng Zhong, Thomas Opitz, Raphaël Huser
We propose a novel extremal dependence measure called the partial tail-correlation coefficient (PTCC), in analogy to the partial correlation coefficient in classical multivariate analysis. The cons...
{"title":"Partial Tail-Correlation Coefficient Applied to Extremal-Network Learning","authors":"Yan Gong, Peng Zhong, Thomas Opitz, Raphaël Huser","doi":"10.1080/00401706.2024.2304334","DOIUrl":"https://doi.org/10.1080/00401706.2024.2304334","url":null,"abstract":"We propose a novel extremal dependence measure called the partial tail-correlation coefficient (PTCC), in analogy to the partial correlation coefficient in classical multivariate analysis. The cons...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"263 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139423399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-21DOI: 10.1080/00401706.2023.2288324
Jingjing Fan, Abhra Sarkar
{"title":"Bayesian Semiparametric Local Clustering of Multiple Time Series Data","authors":"Jingjing Fan, Abhra Sarkar","doi":"10.1080/00401706.2023.2288324","DOIUrl":"https://doi.org/10.1080/00401706.2023.2288324","url":null,"abstract":"","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"56 8","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138951120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-18DOI: 10.1080/00401706.2023.2296465
Adel Ahmadi Nadi, Stefan H. Steiner, Nathaniel T. Stevens
Assessing the agreement between an established and a new measurement system is a practical and important challenge in many application areas. The probability of agreement (PoA) has recently been in...
{"title":"Assessing measurement system agreement in the presence of reproducibility and repeatability","authors":"Adel Ahmadi Nadi, Stefan H. Steiner, Nathaniel T. Stevens","doi":"10.1080/00401706.2023.2296465","DOIUrl":"https://doi.org/10.1080/00401706.2023.2296465","url":null,"abstract":"Assessing the agreement between an established and a new measurement system is a practical and important challenge in many application areas. The probability of agreement (PoA) has recently been in...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"14 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138745406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-18DOI: 10.1080/00401706.2023.2296451
Akhil Vakayil, V. Roshan Joseph
In this work, we propose a novel framework for large-scale Gaussian process (GP) modeling. Contrary to the global, and local approximations proposed in the literature to address the computational b...
{"title":"A Global-Local Approximation Framework for Large-Scale Gaussian Process Modeling","authors":"Akhil Vakayil, V. Roshan Joseph","doi":"10.1080/00401706.2023.2296451","DOIUrl":"https://doi.org/10.1080/00401706.2023.2296451","url":null,"abstract":"In this work, we propose a novel framework for large-scale Gaussian process (GP) modeling. Contrary to the global, and local approximations proposed in the literature to address the computational b...","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"33 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138745509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-09DOI: 10.1080/00401706.2023.2281940
Yi Ji, Simon Mak, Derek Soeder, J-F Paquet, Steffen A. Bass
AbstractWith advances in scientific computing and mathematical modeling, complex scientific phenomena such as galaxy formations and rocket propulsion can now be reliably simulated. Such simulations can however be very time-intensive, requiring millions of CPU hours to perform. One solution is multi-fidelity emulation, which uses data of different fidelities to train an efficient predictive model which emulates the expensive simulator. For complex scientific problems and with careful elicitation from scientists, such multi-fidelity data may often be linked by a directed acyclic graph (DAG) representing its scientific model dependencies. We thus propose a new Graphical Multi-fidelity Gaussian Process (GMGP) model, which embeds this DAG structure (capturing scientific dependencies) within a Gaussian process framework. We show that the GMGP has desirable modeling traits via two Markov properties, and admits a scalable algorithm for recursive computation of the posterior mean and variance along at each depth level of the DAG. We also present a novel experimental design methodology over the DAG given an experimental budget, and propose a nonlinear extension of the GMGP via deep Gaussian processes. The advantages of the GMGP are then demonstrated via a suite of numerical experiments and an application to emulation of heavy-ion collisions, which can be used to study the conditions of matter in the Universe shortly after the Big Bang. The proposed model has broader uses in data fusion applications with graphical structure, which we further discuss.Keywords: Computer experimentsGaussian processesgraphical modelsnuclear physicsmulti-fidelity modelingDisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.
{"title":"A graphical multi-fidelity Gaussian process model, with application to emulation of heavy-ion collisions","authors":"Yi Ji, Simon Mak, Derek Soeder, J-F Paquet, Steffen A. Bass","doi":"10.1080/00401706.2023.2281940","DOIUrl":"https://doi.org/10.1080/00401706.2023.2281940","url":null,"abstract":"AbstractWith advances in scientific computing and mathematical modeling, complex scientific phenomena such as galaxy formations and rocket propulsion can now be reliably simulated. Such simulations can however be very time-intensive, requiring millions of CPU hours to perform. One solution is multi-fidelity emulation, which uses data of different fidelities to train an efficient predictive model which emulates the expensive simulator. For complex scientific problems and with careful elicitation from scientists, such multi-fidelity data may often be linked by a directed acyclic graph (DAG) representing its scientific model dependencies. We thus propose a new Graphical Multi-fidelity Gaussian Process (GMGP) model, which embeds this DAG structure (capturing scientific dependencies) within a Gaussian process framework. We show that the GMGP has desirable modeling traits via two Markov properties, and admits a scalable algorithm for recursive computation of the posterior mean and variance along at each depth level of the DAG. We also present a novel experimental design methodology over the DAG given an experimental budget, and propose a nonlinear extension of the GMGP via deep Gaussian processes. The advantages of the GMGP are then demonstrated via a suite of numerical experiments and an application to emulation of heavy-ion collisions, which can be used to study the conditions of matter in the Universe shortly after the Big Bang. The proposed model has broader uses in data fusion applications with graphical structure, which we further discuss.Keywords: Computer experimentsGaussian processesgraphical modelsnuclear physicsmulti-fidelity modelingDisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":" 41","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135291181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-02DOI: 10.1080/00401706.2023.2277711
Suk Joo Bae, Byeong Min Mun, Xiaoyan Zhu
AbstractIn some practical circumstances, data are recorded after the systems have begun operations, and data collection is stopped at a predetermined time or after a predetermined number of failures. In such circumstances, incompleteness of various types exists in the aspect of the missing number of failures and their occurrence times beyond the duration of the pilot study. Additionally, multiple repairable systems may present system-to-system variability caused by differences in the operating environments or working loads of individual systems. With respect to left-truncated and right-censored recurrent failure data from multiple repairable systems, we propose a reliability model based on a proportional intensity model with frailty. The frailty model explicitly models unobserved heterogeneity among systems. Covariates incorporated into the proportional intensity model additionally account for the heterogeneity between different operating conditions. To estimate the model parameters for the left-truncated and right-censored recurrent failure data, a Monte Carlo expectation maximization algorithm is proposed. Details of the estimation of the model parameters and the construction of their confidence intervals are examined. A real-world example and simulation studies under various scenarios show prominent applications of the proportional intensity model with frailty to left-truncated and right-censored multiple repairable systems for reliability prediction.1Index Terms: Monte Carlo expectation maximization (MCEM) algorithmnonhomogeneous Poisson processrecurrent failure dataproportional intensity modelrepairable systemDisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.
{"title":"A Proportional Intensity Model with Frailty for Missing Recurrent Failure Data","authors":"Suk Joo Bae, Byeong Min Mun, Xiaoyan Zhu","doi":"10.1080/00401706.2023.2277711","DOIUrl":"https://doi.org/10.1080/00401706.2023.2277711","url":null,"abstract":"AbstractIn some practical circumstances, data are recorded after the systems have begun operations, and data collection is stopped at a predetermined time or after a predetermined number of failures. In such circumstances, incompleteness of various types exists in the aspect of the missing number of failures and their occurrence times beyond the duration of the pilot study. Additionally, multiple repairable systems may present system-to-system variability caused by differences in the operating environments or working loads of individual systems. With respect to left-truncated and right-censored recurrent failure data from multiple repairable systems, we propose a reliability model based on a proportional intensity model with frailty. The frailty model explicitly models unobserved heterogeneity among systems. Covariates incorporated into the proportional intensity model additionally account for the heterogeneity between different operating conditions. To estimate the model parameters for the left-truncated and right-censored recurrent failure data, a Monte Carlo expectation maximization algorithm is proposed. Details of the estimation of the model parameters and the construction of their confidence intervals are examined. A real-world example and simulation studies under various scenarios show prominent applications of the proportional intensity model with frailty to left-truncated and right-censored multiple repairable systems for reliability prediction.1Index Terms: Monte Carlo expectation maximization (MCEM) algorithmnonhomogeneous Poisson processrecurrent failure dataproportional intensity modelrepairable systemDisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"23 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135973291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-24DOI: 10.1080/00401706.2023.2271017
Dave Osthus, Brian P. Weaver, Lauren J. Beesley, Kelly R. Moran, Madeline A. Stricklin, Eric J. Zirnstein, Paul H. Janzen, Daniel B. Reisenfeld
AbstractThe Interstellar Boundary Explorer (IBEX) satellite has been in orbit since 2008 and detects energy-resolved energetic neutral atoms (ENAs) originating from the heliosphere. Different regions of the heliosphere generate ENAs at different rates. It is of scientific interest to take the data collected by IBEX and estimate spatial maps of heliospheric ENA rates (referred to as sky maps) at higher resolutions than before. These sky maps will subsequently be used to discern between competing theories of heliosphere properties that are not currently possible. The data IBEX collects present challenges to sky map estimation. The two primary challenges are noisy and irregularly spaced data collection and the IBEX instrumentation’s point spread function. In essence, the data collected by IBEX are both noisy and biased for the underlying sky map of inferential interest. In this paper, we present a two-stage sky map estimation procedure called Theseus. In Stage 1, Theseus estimates a blurred sky map from the noisy and irregularly spaced data using an ensemble approach that leverages projection pursuit regression and generalized additive models. In Stage 2, Theseus deblurs the sky map by deconvolving the PSF with the blurred map using regularization. Unblurred sky map uncertainties are computed via bootstrapping. We compare Theseus to a method closely related to the one operationally used today by the IBEX Science Operation Center (ISOC) on both simulated and real data. Theseus outperforms ISOC in nearly every considered metric on simulated data, indicating that Theseus is an improvement over the current state of the art.DisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.
{"title":"Towards Improved Heliosphere Sky Map Estimation with Theseus","authors":"Dave Osthus, Brian P. Weaver, Lauren J. Beesley, Kelly R. Moran, Madeline A. Stricklin, Eric J. Zirnstein, Paul H. Janzen, Daniel B. Reisenfeld","doi":"10.1080/00401706.2023.2271017","DOIUrl":"https://doi.org/10.1080/00401706.2023.2271017","url":null,"abstract":"AbstractThe Interstellar Boundary Explorer (IBEX) satellite has been in orbit since 2008 and detects energy-resolved energetic neutral atoms (ENAs) originating from the heliosphere. Different regions of the heliosphere generate ENAs at different rates. It is of scientific interest to take the data collected by IBEX and estimate spatial maps of heliospheric ENA rates (referred to as sky maps) at higher resolutions than before. These sky maps will subsequently be used to discern between competing theories of heliosphere properties that are not currently possible. The data IBEX collects present challenges to sky map estimation. The two primary challenges are noisy and irregularly spaced data collection and the IBEX instrumentation’s point spread function. In essence, the data collected by IBEX are both noisy and biased for the underlying sky map of inferential interest. In this paper, we present a two-stage sky map estimation procedure called Theseus. In Stage 1, Theseus estimates a blurred sky map from the noisy and irregularly spaced data using an ensemble approach that leverages projection pursuit regression and generalized additive models. In Stage 2, Theseus deblurs the sky map by deconvolving the PSF with the blurred map using regularization. Unblurred sky map uncertainties are computed via bootstrapping. We compare Theseus to a method closely related to the one operationally used today by the IBEX Science Operation Center (ISOC) on both simulated and real data. Theseus outperforms ISOC in nearly every considered metric on simulated data, indicating that Theseus is an improvement over the current state of the art.DisclaimerAs a service to authors and researchers we are providing this version of an accepted manuscript (AM). Copyediting, typesetting, and review of the resulting proofs will be undertaken on this manuscript before final publication of the Version of Record (VoR). During production and pre-press, errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal relate to these versions also.","PeriodicalId":22208,"journal":{"name":"Technometrics","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135266422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}