作为罕见事件分类问题启发式方法的黑洞算法

IF 1.1 Q3 STATISTICS & PROBABILITY Pakistan Journal of Statistics and Operation Research Pub Date : 2023-12-06 DOI:10.18187/pjsor.v19i4.4211
Elif Yıldırım
{"title":"作为罕见事件分类问题启发式方法的黑洞算法","authors":"Elif Yıldırım","doi":"10.18187/pjsor.v19i4.4211","DOIUrl":null,"url":null,"abstract":"The logistic regression is generally preferred when there is no big difference in the occurrence frequencies of two possible results for the considered event. However, for the events occurring rarely such as wars, economic crisis and natural disasters, namely having relatively small occurrence frequency when compared to the general events, the logistic regression gives biased parameter estimations. Therefore, the logistic regression underestimates the occurrence probability of the rare events. In this study, black hole algorithm is proposed and used to obtain unbiased estimation parameters for rare events, instead of using the classical logistic regression approach. In order to estimate the logistic regression parameter for the cases dichotomous event groups are rare, we propose a black hole algorithm (BHA) approach. For the samples with different rareness degrees, we obtain the parameter values and their bias and root mean square errors for BHA and logistic regression, and then compare them. Moreover, we also investigate the classification performance of two methods on a real life data. As a result, we obtained that BHA gives less biased estimates in simulation and real-life data compared to logistic regression.","PeriodicalId":19973,"journal":{"name":"Pakistan Journal of Statistics and Operation Research","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2023-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Black hole algorithm as a heuristic approach for rare event classification problem\",\"authors\":\"Elif Yıldırım\",\"doi\":\"10.18187/pjsor.v19i4.4211\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The logistic regression is generally preferred when there is no big difference in the occurrence frequencies of two possible results for the considered event. However, for the events occurring rarely such as wars, economic crisis and natural disasters, namely having relatively small occurrence frequency when compared to the general events, the logistic regression gives biased parameter estimations. Therefore, the logistic regression underestimates the occurrence probability of the rare events. In this study, black hole algorithm is proposed and used to obtain unbiased estimation parameters for rare events, instead of using the classical logistic regression approach. In order to estimate the logistic regression parameter for the cases dichotomous event groups are rare, we propose a black hole algorithm (BHA) approach. For the samples with different rareness degrees, we obtain the parameter values and their bias and root mean square errors for BHA and logistic regression, and then compare them. Moreover, we also investigate the classification performance of two methods on a real life data. As a result, we obtained that BHA gives less biased estimates in simulation and real-life data compared to logistic regression.\",\"PeriodicalId\":19973,\"journal\":{\"name\":\"Pakistan Journal of Statistics and Operation Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2023-12-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pakistan Journal of Statistics and Operation Research\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.18187/pjsor.v19i4.4211\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"STATISTICS & PROBABILITY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pakistan Journal of Statistics and Operation Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.18187/pjsor.v19i4.4211","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0

摘要

当考虑的事件的两个可能结果的发生频率没有大的差异时,通常首选逻辑回归。然而,对于战争、经济危机、自然灾害等很少发生的事件,即与一般事件相比发生频率相对较小的事件,逻辑回归给出的参数估计是有偏的。因此,逻辑回归低估了罕见事件的发生概率。在本研究中,提出了黑洞算法,并将其用于获得罕见事件的无偏估计参数,而不是使用经典的逻辑回归方法。为了估计二分类事件组很少情况下的逻辑回归参数,我们提出了一种黑洞算法(BHA)方法。对于不同稀缺度的样本,我们得到了BHA和logistic回归的参数值及其偏差和均方根误差,并对它们进行了比较。此外,我们还研究了两种方法在真实生活数据上的分类性能。结果表明,与逻辑回归相比,BHA在模拟和实际数据中给出的偏差估计更小。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Black hole algorithm as a heuristic approach for rare event classification problem
The logistic regression is generally preferred when there is no big difference in the occurrence frequencies of two possible results for the considered event. However, for the events occurring rarely such as wars, economic crisis and natural disasters, namely having relatively small occurrence frequency when compared to the general events, the logistic regression gives biased parameter estimations. Therefore, the logistic regression underestimates the occurrence probability of the rare events. In this study, black hole algorithm is proposed and used to obtain unbiased estimation parameters for rare events, instead of using the classical logistic regression approach. In order to estimate the logistic regression parameter for the cases dichotomous event groups are rare, we propose a black hole algorithm (BHA) approach. For the samples with different rareness degrees, we obtain the parameter values and their bias and root mean square errors for BHA and logistic regression, and then compare them. Moreover, we also investigate the classification performance of two methods on a real life data. As a result, we obtained that BHA gives less biased estimates in simulation and real-life data compared to logistic regression.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.30
自引率
26.70%
发文量
53
期刊介绍: Pakistan Journal of Statistics and Operation Research. PJSOR is a peer-reviewed journal, published four times a year. PJSOR publishes refereed research articles and studies that describe the latest research and developments in the area of statistics, operation research and actuarial statistics.
期刊最新文献
Characterizations of the Recently Introduced Discrete Distributions A New Family of Heavy-Tailed Generalized Topp-Leone-G Distributions with Application A new class of probability distributions with an application in engineering science Approximations to the Moments of Order Statistics for Normal Distribution Approximation Methods for the Bivariate Compound Truncated Poisson Gamma Distribution
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1