首页 > 最新文献

Journal of the Korean Statistical Society最新文献

英文 中文
Disseminating massive frequency tables by masking aggregated cell frequencies 通过掩盖小区汇总频率传播海量频率表
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-30 DOI: 10.1007/s42952-023-00248-x
Min-Jeong Park, Hang J. Kim, Sunghoon Kwon

We propose a confidential approach for disseminating frequency tables constructed for any combination of key variables in the given microdata, including those of hierarchical key variables. The system generates all possible frequency tables by either marginalizing or aggregating fully joint frequency tables of key variables while protecting the original cells with low frequencies through two masking steps: the small cell adjustments for joint tables followed by the proposed algorithm called information loss bounded aggregation for aggregated cells. The two-step approach is designed to control both disclosure risk and information loss by ensuring the k-anonymity of original cells with small frequencies while keeping the loss within a bounded limit.

我们提出了一种保密方法,用于传播为给定微观数据中任何关键变量组合(包括分层关键变量组合)构建的频率表。该系统通过对关键变量的完全联合频率表进行边际化或聚合,生成所有可能的频率表,同时通过两个屏蔽步骤保护频率较低的原始单元格:对联合表进行小单元格调整,然后对聚合单元格采用所提出的称为信息损失约束聚合的算法。该两步法旨在通过确保频率较低的原始单元格的 k 匿名性,同时将损失控制在一定范围内,从而控制披露风险和信息损失。
{"title":"Disseminating massive frequency tables by masking aggregated cell frequencies","authors":"Min-Jeong Park, Hang J. Kim, Sunghoon Kwon","doi":"10.1007/s42952-023-00248-x","DOIUrl":"https://doi.org/10.1007/s42952-023-00248-x","url":null,"abstract":"<p>We propose a confidential approach for disseminating frequency tables constructed for any combination of key variables in the given microdata, including those of hierarchical key variables. The system generates all possible frequency tables by either marginalizing or aggregating fully joint frequency tables of key variables while protecting the original cells with low frequencies through two masking steps: the small cell adjustments for joint tables followed by the proposed algorithm called information loss bounded aggregation for aggregated cells. The two-step approach is designed to control both disclosure risk and information loss by ensuring the <i>k</i>-anonymity of original cells with small frequencies while keeping the loss within a bounded limit.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"13 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139647272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Use of ridge calibration method in predicting election results 使用脊校准法预测选举结果
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-23 DOI: 10.1007/s42952-023-00254-z
Yohan Lim, Mingue Park

Ridge calibration is a penalized method used in survey sampling to reduce the variability of the final set of weights by relaxing the linear restrictions. We proposed a method for selecting the penalty parameter that minimizes the estimated mean squared error of the mean estimator when estimated auxiliary information is used. We showed that the proposed estimator is asymptotically equivalent to the generalized regression estimator. A simple simulation study shows that our estimator has the smaller MSE compared to the traditional calibration ones. We applied our method to predict election result using National Barometer Survey and Korea Social Integration Survey.

脊校准是调查抽样中使用的一种惩罚方法,通过放宽线性限制来减少最终权重集的变异性。我们提出了一种选择惩罚参数的方法,该方法可在使用估计辅助信息时使均值估计器的估计均方误差最小化。我们证明了所提出的估计器在渐近上等同于广义回归估计器。一个简单的模拟研究表明,与传统的校准估计器相比,我们的估计器具有更小的 MSE。我们利用全国晴雨表调查和韩国社会融合调查将我们的方法用于预测选举结果。
{"title":"Use of ridge calibration method in predicting election results","authors":"Yohan Lim, Mingue Park","doi":"10.1007/s42952-023-00254-z","DOIUrl":"https://doi.org/10.1007/s42952-023-00254-z","url":null,"abstract":"<p>Ridge calibration is a penalized method used in survey sampling to reduce the variability of the final set of weights by relaxing the linear restrictions. We proposed a method for selecting the penalty parameter that minimizes the estimated mean squared error of the mean estimator when estimated auxiliary information is used. We showed that the proposed estimator is asymptotically equivalent to the generalized regression estimator. A simple simulation study shows that our estimator has the smaller MSE compared to the traditional calibration ones. We applied our method to predict election result using National Barometer Survey and Korea Social Integration Survey.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"7 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139558036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Asymptotic of the number of false change points of the fused lasso signal approximator 融合套索信号近似器错误变化点数量的渐近线
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-18 DOI: 10.1007/s42952-023-00250-3
Donghyeon Yu, Johan Lim, Won Son

It is well-known that the fused lasso signal approximator (FLSA) is inconsistent in change point detection under the presence of staircase blocks in true mean values. The existing studies focus on modifying the FLSA model to remedy this inconsistency. However, the inconsistency of the FLSA does not severely degrade the performance in change point detection if the FLSA can identify all true change points and the estimated change points set is sufficiently close to the true change points set. In this study, we investigate some asymptotic properties of the FLSA under the assumption of the noise level (sigma _n = o(n log n)). To be specific, we show that all the falsely segmented blocks are sub-blocks of true staircase blocks if the noise level is sufficiently low and a tuning parameter is chosen appropriately. In addition, each false change point of the optimal FLSA estimate can be associated with a vertex of a concave majorant or a convex minorant of a discrete Brownian bridge. Based on these results, we derive an asymptotic distribution of the number of false change points and provide numerical examples supporting the theoretical results.

众所周知,在真实平均值存在阶梯块的情况下,融合套索信号近似器(FLSA)在变化点检测方面存在不一致性。现有研究的重点是修改 FLSA 模型,以弥补这种不一致性。然而,如果 FLSA 能够识别所有真实变化点,并且估计的变化点集与真实变化点集足够接近,那么 FLSA 的不一致性并不会严重降低变化点检测的性能。在本研究中,我们研究了 FLSA 在噪声水平 (sigma _n = o(n log n))假设下的一些渐近特性。具体来说,我们证明了如果噪声水平足够低,并且适当地选择了一个调整参数,那么所有被错误分割的块都是真正的阶梯块的子块。此外,最佳 FLSA 估计值的每个假变化点都可以与离散布朗桥的凹大切或凸小切的顶点相关联。基于这些结果,我们推导出了错误变化点数量的渐近分布,并提供了支持理论结果的数值示例。
{"title":"Asymptotic of the number of false change points of the fused lasso signal approximator","authors":"Donghyeon Yu, Johan Lim, Won Son","doi":"10.1007/s42952-023-00250-3","DOIUrl":"https://doi.org/10.1007/s42952-023-00250-3","url":null,"abstract":"<p>It is well-known that the fused lasso signal approximator (FLSA) is inconsistent in change point detection under the presence of staircase blocks in true mean values. The existing studies focus on modifying the FLSA model to remedy this inconsistency. However, the inconsistency of the FLSA does not severely degrade the performance in change point detection if the FLSA can identify all true change points and the estimated change points set is sufficiently close to the true change points set. In this study, we investigate some asymptotic properties of the FLSA under the assumption of the noise level <span>(sigma _n = o(n log n))</span>. To be specific, we show that all the falsely segmented blocks are sub-blocks of true staircase blocks if the noise level is sufficiently low and a tuning parameter is chosen appropriately. In addition, each false change point of the optimal FLSA estimate can be associated with a vertex of a concave majorant or a convex minorant of a discrete Brownian bridge. Based on these results, we derive an asymptotic distribution of the number of false change points and provide numerical examples supporting the theoretical results.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"10 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139499555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large sample properties of maximum likelihood estimator using moving extremes ranked set sampling 使用移动极值排序集抽样的最大似然估计器的大样本特性
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-13 DOI: 10.1007/s42952-023-00251-2
Han Wang, Wangxue Chen, Bingjie Li

In this paper, we investigate the maximum likelihood estimator (MLE) for the parameter (theta) in the probability density function (f(x;theta )). We specifically focus on the application of moving extremes ranked set sampling (MERSS) and analyze its properties in large samples. We establish the existence and uniqueness of the MLE for two common distributions when utilizing MERSS. Our theoretical analysis demonstrates that the MLE obtained through MERSS is, at the very least, as efficient as the MLE obtained through simple random sampling with an equivalent sample size. To substantiate these theoretical findings, we conduct numerical experiments. Furthermore, we explore the implications of imperfect ranking and provide a practical illustration by applying our approach to a real dataset.

在本文中,我们研究了概率密度函数 (f(x;theta )) 中参数 (theta) 的最大似然估计器(MLE)。我们特别关注移动极值排序集采样(MERSS)的应用,并分析其在大样本中的特性。在使用 MERSS 时,我们为两种常见分布建立了 MLE 的存在性和唯一性。我们的理论分析表明,通过 MERSS 获得的 MLE 至少与通过样本量相当的简单随机抽样获得的 MLE 一样有效。为了证实这些理论发现,我们进行了数值实验。此外,我们还探讨了不完美排序的影响,并通过将我们的方法应用于真实数据集进行了实际说明。
{"title":"Large sample properties of maximum likelihood estimator using moving extremes ranked set sampling","authors":"Han Wang, Wangxue Chen, Bingjie Li","doi":"10.1007/s42952-023-00251-2","DOIUrl":"https://doi.org/10.1007/s42952-023-00251-2","url":null,"abstract":"<p>In this paper, we investigate the maximum likelihood estimator (MLE) for the parameter <span>(theta)</span> in the probability density function <span>(f(x;theta ))</span>. We specifically focus on the application of moving extremes ranked set sampling (MERSS) and analyze its properties in large samples. We establish the existence and uniqueness of the MLE for two common distributions when utilizing MERSS. Our theoretical analysis demonstrates that the MLE obtained through MERSS is, at the very least, as efficient as the MLE obtained through simple random sampling with an equivalent sample size. To substantiate these theoretical findings, we conduct numerical experiments. Furthermore, we explore the implications of imperfect ranking and provide a practical illustration by applying our approach to a real dataset.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"83 3 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Logistic regression models for elastic shape of curves based on tangent representations 基于切线表示法的曲线弹性形状逻辑回归模型
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-12 DOI: 10.1007/s42952-023-00252-1
Tae-Young Heo, Joon Myoung Lee, Myung Hun Woo, Hyeongseok Lee, Min Ho Cho

Shape analysis is widely used in many application areas such as computer vision, medical and biological studies. One challenge to analyze the shape of an object in an image is its invariant property to shape-preserving transformations. To measure the distance or dissimilarity between two different shapes, we worked with the square-root velocity function (SRVF) representation and the elastic metric. Since shapes are inherently high-dimensional in a nonlinear space, we adopted a tangent space at the mean shape and a few principal components (PCs) on the linearized space. We proposed classification methods based on logistic regression using these PCs and tangent vectors with the elastic net penalty. We then compared its performance with other model-based methods for shape classification in application to shape of algae in watersheds as well as simulated data generated by the mixture of von Mises-Fisher distributions.

形状分析广泛应用于计算机视觉、医学和生物研究等多个领域。分析图像中物体的形状所面临的一个挑战是其对保形变换的不变性。为了测量两个不同形状之间的距离或差异,我们使用了平方根速度函数(SRVF)表示法和弹性度量。由于形状在非线性空间中本身就是高维的,因此我们在平均形状处采用了切线空间,并在线性化空间上采用了几个主成分(PC)。我们提出了基于逻辑回归的分类方法,使用这些 PC 和切向量以及弹性网惩罚。然后,我们将其与其他基于模型的形状分类方法进行了性能比较,并将其应用于流域中藻类的形状以及由 von Mises-Fisher 分布混合生成的模拟数据。
{"title":"Logistic regression models for elastic shape of curves based on tangent representations","authors":"Tae-Young Heo, Joon Myoung Lee, Myung Hun Woo, Hyeongseok Lee, Min Ho Cho","doi":"10.1007/s42952-023-00252-1","DOIUrl":"https://doi.org/10.1007/s42952-023-00252-1","url":null,"abstract":"<p>Shape analysis is widely used in many application areas such as computer vision, medical and biological studies. One challenge to analyze the shape of an object in an image is its invariant property to shape-preserving transformations. To measure the distance or dissimilarity between two different shapes, we worked with the square-root velocity function (SRVF) representation and the elastic metric. Since shapes are inherently high-dimensional in a nonlinear space, we adopted a tangent space at the mean shape and a few principal components (PCs) on the linearized space. We proposed classification methods based on logistic regression using these PCs and tangent vectors with the elastic net penalty. We then compared its performance with other model-based methods for shape classification in application to shape of algae in watersheds as well as simulated data generated by the mixture of von Mises-Fisher distributions.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"1 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Byzantine-resilient decentralized network learning 拜占庭式弹性分散网络学习
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-10 DOI: 10.1007/s42952-023-00249-w
Yaohong Yang, Lei Wang

Decentralized federated learning based on fully normal nodes has drawn attention in modern statistical learning. However, due to data corruption, device malfunctioning, malicious attacks and some other unexpected behaviors, not all nodes can obey the estimation process and the existing decentralized federated learning methods may fail. An unknown number of abnormal nodes, called Byzantine nodes, arbitrarily deviate from their intended behaviors, send wrong messages to their neighbors and affect all honest nodes across the entire network through passing polluted messages. In this paper, we focus on decentralized federated learning in the presence of Byzantine attacks and then propose a unified Byzantine-resilient framework based on the network gradient descent and several robust aggregation rules. Theoretically, the convergence of the proposed algorithm is guaranteed under some weakly balanced conditions of network structure. The finite-sample performance is studied through simulations under different network topologies and various Byzantine attacks. An application to Communities and Crime Data is also presented.

基于完全正常节点的分散联合学习在现代统计学习中备受关注。然而,由于数据损坏、设备故障、恶意攻击和其他一些意外行为,并非所有节点都能遵守估计过程,现有的分散联合学习方法可能会失败。数量未知的异常节点(称为拜占庭节点)会任意偏离其预期行为,向其邻居发送错误信息,并通过传递污染信息影响整个网络中的所有诚实节点。在本文中,我们将重点放在拜占庭攻击下的分散式联合学习上,然后提出了一种基于网络梯度下降和几种鲁棒聚合规则的统一拜占庭抗性框架。从理论上讲,在网络结构的某些弱平衡条件下,所提算法的收敛性是有保证的。通过模拟研究了不同网络拓扑结构和各种拜占庭攻击下的有限样本性能。此外,还介绍了该算法在社区和犯罪数据中的应用。
{"title":"Byzantine-resilient decentralized network learning","authors":"Yaohong Yang, Lei Wang","doi":"10.1007/s42952-023-00249-w","DOIUrl":"https://doi.org/10.1007/s42952-023-00249-w","url":null,"abstract":"<p>Decentralized federated learning based on fully normal nodes has drawn attention in modern statistical learning. However, due to data corruption, device malfunctioning, malicious attacks and some other unexpected behaviors, not all nodes can obey the estimation process and the existing decentralized federated learning methods may fail. An unknown number of abnormal nodes, called Byzantine nodes, arbitrarily deviate from their intended behaviors, send wrong messages to their neighbors and affect all honest nodes across the entire network through passing polluted messages. In this paper, we focus on decentralized federated learning in the presence of Byzantine attacks and then propose a unified Byzantine-resilient framework based on the network gradient descent and several robust aggregation rules. Theoretically, the convergence of the proposed algorithm is guaranteed under some weakly balanced conditions of network structure. The finite-sample performance is studied through simulations under different network topologies and various Byzantine attacks. An application to Communities and Crime Data is also presented.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"62 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139414140","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sequential online monitoring for autoregressive time series of counts 自回归计数时间序列的连续在线监测
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2024-01-02 DOI: 10.1007/s42952-023-00247-y

Abstract

This study considers the online monitoring problem for detecting the parameter change in time series of counts. For this task, we construct a monitoring process based on the residuals obtained from integer-valued generalized autoregressive conditional heteroscedastic (INGARCH) models. We consider this problem within a more general framework using martingale difference sequences as the monitoring problem on GARCH-type processes based on the residuals or score vectors can be viewed as a special case of the monitoring problems on martingale differences. The limiting behavior of the stopping rule is investigated in this general set-up and is applied to the INGARCH processes. To assess the performance of our method, we conduct Monte Carlo simulations. A real data analysis is also provided for illustration. Our findings in this empirical study demonstrate the validity of the proposed monitoring process.

摘要 本研究探讨了检测计数时间序列参数变化的在线监测问题。为此,我们根据整值广义自回归条件异速(INGARCH)模型得到的残差构建了一个监测过程。由于基于残差或得分向量的 GARCH 类型过程的监控问题可视为马氏差分监控问题的特例,因此我们在使用马氏差分序列的更一般框架内考虑这一问题。在这种一般设置中,研究了停止规则的极限行为,并将其应用于 INGARCH 过程。为了评估我们方法的性能,我们进行了蒙特卡罗模拟。我们还提供了真实数据分析,以作说明。我们的实证研究结果证明了所建议的监控过程的有效性。
{"title":"Sequential online monitoring for autoregressive time series of counts","authors":"","doi":"10.1007/s42952-023-00247-y","DOIUrl":"https://doi.org/10.1007/s42952-023-00247-y","url":null,"abstract":"<h3>Abstract</h3> <p>This study considers the online monitoring problem for detecting the parameter change in time series of counts. For this task, we construct a monitoring process based on the residuals obtained from integer-valued generalized autoregressive conditional heteroscedastic (INGARCH) models. We consider this problem within a more general framework using martingale difference sequences as the monitoring problem on GARCH-type processes based on the residuals or score vectors can be viewed as a special case of the monitoring problems on martingale differences. The limiting behavior of the stopping rule is investigated in this general set-up and is applied to the INGARCH processes. To assess the performance of our method, we conduct Monte Carlo simulations. A real data analysis is also provided for illustration. Our findings in this empirical study demonstrate the validity of the proposed monitoring process.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"50 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139079722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Return prediction by machine learning for the Korean stock market 通过机器学习预测韩国股票市场的回报率
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2023-12-20 DOI: 10.1007/s42952-023-00245-0
Wonwoo Choi, Seongho Jang, Sanghee Kim, Chayoung Park, Sunyoung Park, Seongjoo Song

In this study, we aim to forecast monthly stock returns and analyze factors influencing stock prices in the Korean stock market. To find a model that maximizes the cumulative return of the portfolio of stocks with high predicted returns, we use machine learning models such as linear models, tree-based models, neural networks, and learning to rank algorithms. We employ a novel validation metric which we call the Cumulative net Return of a Portfolio with top 10% predicted return (CRP10) for tuning hyperparameters to increase the cumulative return of the selected portfolio. CRP10 tends to provide higher cumulative returns compared to out-of-sample R-squared as a validation metric with the data that we used. Our findings indicate that Light Gradient Boosting Machine (LightGBM) and Gradient Boosted Regression Trees (GBRT) demonstrate better performance than other models when we apply a single model for the entire test period. We also take the strategy of changing the model on a yearly basis by assessing the best model annually and observed that it did not outperform the approach of using a single model such as LightGBM or GBRT for the entire period.

在本研究中,我们旨在预测韩国股市的月度股票回报率并分析影响股价的因素。为了找到一个能使预测回报率高的股票投资组合的累计回报率最大化的模型,我们使用了线性模型、树型模型、神经网络和学习排名算法等机器学习模型。我们采用了一种新颖的验证指标,称为 "预测回报率前 10%的投资组合的累计净回报率(CRP10)",用于调整超参数,以提高所选投资组合的累计回报率。在我们使用的数据中,与样本外 R 平方作为验证指标相比,CRP10 往往能提供更高的累计回报。我们的研究结果表明,当我们在整个测试期间使用单一模型时,轻梯度提升机(LightGBM)和梯度提升回归树(GBRT)比其他模型表现得更好。我们还采取了每年更换模型的策略,每年对最佳模型进行评估,结果发现,在整个测试期间使用 LightGBM 或 GBRT 等单一模型的效果并不理想。
{"title":"Return prediction by machine learning for the Korean stock market","authors":"Wonwoo Choi, Seongho Jang, Sanghee Kim, Chayoung Park, Sunyoung Park, Seongjoo Song","doi":"10.1007/s42952-023-00245-0","DOIUrl":"https://doi.org/10.1007/s42952-023-00245-0","url":null,"abstract":"<p>In this study, we aim to forecast monthly stock returns and analyze factors influencing stock prices in the Korean stock market. To find a model that maximizes the cumulative return of the portfolio of stocks with high predicted returns, we use machine learning models such as linear models, tree-based models, neural networks, and learning to rank algorithms. We employ a novel validation metric which we call the Cumulative net Return of a Portfolio with top 10% predicted return (CRP10) for tuning hyperparameters to increase the cumulative return of the selected portfolio. CRP10 tends to provide higher cumulative returns compared to out-of-sample R-squared as a validation metric with the data that we used. Our findings indicate that Light Gradient Boosting Machine (LightGBM) and Gradient Boosted Regression Trees (GBRT) demonstrate better performance than other models when we apply a single model for the entire test period. We also take the strategy of changing the model on a yearly basis by assessing the best model annually and observed that it did not outperform the approach of using a single model such as LightGBM or GBRT for the entire period.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"65 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138816752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Spatially integrated estimator of finite population total by integrating data from two independent surveys using spatial information 利用空间信息整合来自两个独立调查的数据,对有限人口总数进行空间整合估算
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2023-12-19 DOI: 10.1007/s42952-023-00244-1
Nobin Chandra Paul, Anil Rai, Tauqueer Ahmad, Ankur Biswas, Prachi Misra Sahoo

A major goal of survey sampling is finite population inference. In recent years, large-scale survey programs have encountered many practical challenges which include higher data collection cost, increasing non-response rate, increasing demand for disaggregated level statistics and desire for timely estimates. Data integration is a new field of research that provides a timely solution to these above-mentioned challenges by integrating data from multiple surveys. Now, it is possible to develop a framework that can efficiently combine information from several surveys to obtain more precise estimates of population parameters. In many surveys, parameters of interest are often spatial in nature, which means, the relationship between the study variable and covariates varies across all locations in the study area and this situation is referred as spatial non-stationarity. Hence, there is a need of a sampling methodology that can efficiently tackle this spatial non-stationarity problem and can be able to integrate this spatially referenced data to get more detailed information. In this study, a Geographically Weighted Spatially Integrated (GWSI) estimator of finite population total was developed by integrating data from two independent surveys using spatial information. The statistical properties of the proposed spatially integrated estimator were then evaluated empirically through a spatial simulation study. Three different spatial populations were generated having high spatial autocorrelation. The proposed spatially integrated estimator performed better than usual design-based estimator under all three populations. Furthermore, a Spatial Proportionate Bootstrap (SPB) method was developed for variance estimation of the proposed spatially integrated estimator.

调查抽样的一个主要目标是有限人口推断。近年来,大规模调查项目遇到了许多实际挑战,包括数据收集成本上升、非响应率增加、对分类水平统计的需求增加以及对及时估算的渴望。数据整合是一个新的研究领域,它通过整合来自多个调查的数据,为上述挑战提供了及时的解决方案。现在,我们有可能建立一个框架,有效地整合来自多个调查的信息,从而获得更精确的人口参数估算值。在许多调查中,所关注的参数往往具有空间性质,这意味着研究变量与协变因素之间的关系在研究区域的所有地点都各不相同,这种情况被称为空间非平稳性。因此,需要一种能有效解决空间非稳态问题的抽样方法,并能整合这些空间参考数据,以获得更详细的信息。在本研究中,通过利用空间信息整合来自两个独立调查的数据,开发了有限人口总数的地理加权空间整合(GWSI)估计器。然后,通过空间模拟研究对所提出的空间综合估算器的统计特性进行了实证评估。生成的三个不同空间种群具有高度的空间自相关性。在所有三个种群中,建议的空间综合估计器的表现都优于通常的基于设计的估计器。此外,还开发了一种空间比例引导(SPB)方法,用于对提议的空间综合估计器进行方差估计。
{"title":"Spatially integrated estimator of finite population total by integrating data from two independent surveys using spatial information","authors":"Nobin Chandra Paul, Anil Rai, Tauqueer Ahmad, Ankur Biswas, Prachi Misra Sahoo","doi":"10.1007/s42952-023-00244-1","DOIUrl":"https://doi.org/10.1007/s42952-023-00244-1","url":null,"abstract":"<p>A major goal of survey sampling is finite population inference. In recent years, large-scale survey programs have encountered many practical challenges which include higher data collection cost, increasing non-response rate, increasing demand for disaggregated level statistics and desire for timely estimates. Data integration is a new field of research that provides a timely solution to these above-mentioned challenges by integrating data from multiple surveys. Now, it is possible to develop a framework that can efficiently combine information from several surveys to obtain more precise estimates of population parameters. In many surveys, parameters of interest are often spatial in nature, which means, the relationship between the study variable and covariates varies across all locations in the study area and this situation is referred as spatial non-stationarity. Hence, there is a need of a sampling methodology that can efficiently tackle this spatial non-stationarity problem and can be able to integrate this spatially referenced data to get more detailed information. In this study, a Geographically Weighted Spatially Integrated (GWSI) estimator of finite population total was developed by integrating data from two independent surveys using spatial information. The statistical properties of the proposed spatially integrated estimator were then evaluated empirically through a spatial simulation study. Three different spatial populations were generated having high spatial autocorrelation. The proposed spatially integrated estimator performed better than usual design-based estimator under all three populations. Furthermore, a Spatial Proportionate Bootstrap (SPB) method was developed for variance estimation of the proposed spatially integrated estimator.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"15 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138744869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Statistical integration of allele frequencies from several organizations 统计整合多个组织的等位基因频率
IF 0.6 4区 数学 Q4 STATISTICS & PROBABILITY Pub Date : 2023-12-18 DOI: 10.1007/s42952-023-00243-2
Su Jin Jeong, Hyo-jung Lee, Soong Deok Lee, Su Jeong Park, Seung Hwan Lee, Jae Won Lee

Genetic evidence, especially evidence based on short tandem repeats, is of paramount importance for human identification in forensic inferences. In recent years, the identification of kinship using DNA evidence has drawn much attention in various fields. In particular, it is employed, using a criminal database, to confirm blood relations in forensics. The interpretation of the likelihood ratio when identifying an individual or a relationship depends on the allele frequencies that are used, and thus, it is crucial to obtain an accurate estimate of allele frequency. Each organization such as Supreme Prosecutors’ Office and Korean National Police Agency in Korea provides different statistical interpretations due to differing estimations of the allele frequency, which can lead to confusion in forensic identification. Therefore, it is very important to estimate allele frequency accurately, and doing so requires a certain amount of information. However, simply using a weighted average for each allele frequency may not be sufficient to determine biological independence. In this study, we propose a new statistical method for estimating allele frequency by integrating the data obtained from several organizations, and we analyze biological independence and differences in allele frequency relative to the weighted average of allele frequencies in various subgroups. Finally, our proposed method is illustrated using real data from 576 Korean individuals.

基因证据,尤其是基于短串联重复序列的证据,对于法医推断中的人类身份识别至关重要。近年来,利用 DNA 证据进行亲属关系鉴定在各个领域引起了广泛关注。特别是在法医学中,人们利用犯罪数据库来确认血缘关系。在确认个人或亲属关系时,对似然比的解释取决于所使用的等位基因频率,因此,准确估计等位基因频率至关重要。由于对等位基因频率的估计不同,韩国最高检察院和韩国国家警察厅等每个机构都提供了不同的统计解释,这可能导致法医鉴定中的混乱。因此,准确估算等位基因频率非常重要,而这样做需要一定量的信息。然而,仅仅使用每个等位基因频率的加权平均值可能不足以确定生物独立性。在本研究中,我们提出了一种新的统计方法,通过整合从多个机构获得的数据来估算等位基因频率,并分析了生物独立性以及相对于不同亚组等位基因频率加权平均值的等位基因频率差异。最后,我们使用 576 个韩国个体的真实数据对我们提出的方法进行了说明。
{"title":"Statistical integration of allele frequencies from several organizations","authors":"Su Jin Jeong, Hyo-jung Lee, Soong Deok Lee, Su Jeong Park, Seung Hwan Lee, Jae Won Lee","doi":"10.1007/s42952-023-00243-2","DOIUrl":"https://doi.org/10.1007/s42952-023-00243-2","url":null,"abstract":"<p>Genetic evidence, especially evidence based on short tandem repeats, is of paramount importance for human identification in forensic inferences. In recent years, the identification of kinship using DNA evidence has drawn much attention in various fields. In particular, it is employed, using a criminal database, to confirm blood relations in forensics. The interpretation of the likelihood ratio when identifying an individual or a relationship depends on the allele frequencies that are used, and thus, it is crucial to obtain an accurate estimate of allele frequency. Each organization such as Supreme Prosecutors’ Office and Korean National Police Agency in Korea provides different statistical interpretations due to differing estimations of the allele frequency, which can lead to confusion in forensic identification. Therefore, it is very important to estimate allele frequency accurately, and doing so requires a certain amount of information. However, simply using a weighted average for each allele frequency may not be sufficient to determine biological independence. In this study, we propose a new statistical method for estimating allele frequency by integrating the data obtained from several organizations, and we analyze biological independence and differences in allele frequency relative to the weighted average of allele frequencies in various subgroups. Finally, our proposed method is illustrated using real data from 576 Korean individuals.</p>","PeriodicalId":49992,"journal":{"name":"Journal of the Korean Statistical Society","volume":"21 1","pages":""},"PeriodicalIF":0.6,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138717017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of the Korean Statistical Society
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1