首页 > 最新文献

Strategic Advancements in Utilizing Data Mining and Warehousing Technologies最新文献

英文 中文
The Power of Sampling and Stacking for the PAKDD-2007 Cross-Selling Problem PAKDD-2007交叉销售问题的抽样和堆叠能力
Pub Date : 2008-04-01 DOI: 10.4018/jdwm.2008040104
P. Adeodato, G. C. Vasconcelos, A. L. Arnaud, Rodrigo C. L. V. Cunha, Domingos S. M. P. Monteiro, R. Neto
This article presents an efficient solution for the PAKDD-2007 Competition cross-selling problem. The solution is based on a thorough approach which involves the creation of new input variables, efficient data preparation and transformation, adequate data sampling strategy and a combination of two of the most robust modeling techniques. Due to the complexity imposed by the very small amount of examples in the target class, the approach for model robustness was to produce the median score of the 11 models developed with an adapted version of the 11-fold cross-validation process and the use of a combination of two robust techniques via stacking, the MLP neural network and the n-tuple classifier. Despite the problem complexity, the performance on the prediction data set (unlabeled samples), measured through KS2 and ROC curves was shown to be very effective and finished as the first runner-up solution of the competition.
本文针对PAKDD-2007竞争交叉销售问题提出了一种有效的解决方案。该解决方案基于一种全面的方法,包括创建新的输入变量,有效的数据准备和转换,适当的数据采样策略以及两种最强大的建模技术的组合。由于目标类中非常少量的示例所带来的复杂性,模型鲁棒性的方法是产生11个模型的中位数得分,这些模型是用11倍交叉验证过程的适应版本开发的,并通过堆叠、MLP神经网络和n元组分类器结合使用两种鲁棒技术。尽管问题很复杂,但通过KS2和ROC曲线测量的预测数据集(未标记样本)的性能显示出非常有效,并成为比赛的亚军解决方案。
{"title":"The Power of Sampling and Stacking for the PAKDD-2007 Cross-Selling Problem","authors":"P. Adeodato, G. C. Vasconcelos, A. L. Arnaud, Rodrigo C. L. V. Cunha, Domingos S. M. P. Monteiro, R. Neto","doi":"10.4018/jdwm.2008040104","DOIUrl":"https://doi.org/10.4018/jdwm.2008040104","url":null,"abstract":"This article presents an efficient solution for the PAKDD-2007 Competition cross-selling problem. The solution is based on a thorough approach which involves the creation of new input variables, efficient data preparation and transformation, adequate data sampling strategy and a combination of two of the most robust modeling techniques. Due to the complexity imposed by the very small amount of examples in the target class, the approach for model robustness was to produce the median score of the 11 models developed with an adapted version of the 11-fold cross-validation process and the use of a combination of two robust techniques via stacking, the MLP neural network and the n-tuple classifier. Despite the problem complexity, the performance on the prediction data set (unlabeled samples), measured through KS2 and ROC curves was shown to be very effective and finished as the first runner-up solution of the competition.","PeriodicalId":399104,"journal":{"name":"Strategic Advancements in Utilizing Data Mining and Warehousing Technologies","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123170394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Selecting Salient Features and Samples Simultaneously to Enhance Cross-Selling Model Performance 同时选择显著特征和样本以提高交叉销售模型的性能
Pub Date : 1900-01-01 DOI: 10.4018/978-1-60566-717-1.CH021
Dehong Qiu, Ye Wang, Qifeng Zhang
The rapid growth in information science and technology has lead to generation of huge amount of valuable data in many areas. In finance for example, over the past five years, many banks have experienced exceptional growth in service and have built up bank’s Group Data Warehouse. In order to realize faster, more effective decisions and provide more excellent customer services, new technologies to handle or extract fully the latent knowledge within the data are urgently required. The finance company that donated the data for 2007 PAKDD competition would like to build a cross-selling model to predict the potential take-ups of cross-selling home loans to its credit card customers (Qiu, Wang & Bi, 2008). abstract
随着信息科学技术的飞速发展,在许多领域产生了大量有价值的数据。以金融为例,在过去五年中,许多银行在服务方面取得了非凡的增长,并建立了银行的集团数据仓库。为了实现更快、更有效的决策,提供更优质的客户服务,迫切需要处理或充分提取数据中潜在知识的新技术。为2007年PAKDD竞赛提供数据的金融公司希望建立一个交叉销售模型,以预测向其信用卡客户交叉销售住房贷款的潜在占有率(Qiu, Wang & Bi, 2008)。摘要
{"title":"Selecting Salient Features and Samples Simultaneously to Enhance Cross-Selling Model Performance","authors":"Dehong Qiu, Ye Wang, Qifeng Zhang","doi":"10.4018/978-1-60566-717-1.CH021","DOIUrl":"https://doi.org/10.4018/978-1-60566-717-1.CH021","url":null,"abstract":"The rapid growth in information science and technology has lead to generation of huge amount of valuable data in many areas. In finance for example, over the past five years, many banks have experienced exceptional growth in service and have built up bank’s Group Data Warehouse. In order to realize faster, more effective decisions and provide more excellent customer services, new technologies to handle or extract fully the latent knowledge within the data are urgently required. The finance company that donated the data for 2007 PAKDD competition would like to build a cross-selling model to predict the potential take-ups of cross-selling home loans to its credit card customers (Qiu, Wang & Bi, 2008). abstract","PeriodicalId":399104,"journal":{"name":"Strategic Advancements in Utilizing Data Mining and Warehousing Technologies","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129487998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Seismological Data Warehousing and Mining 地震数据仓库与挖掘
Pub Date : 1900-01-01 DOI: 10.4018/978-1-60566-098-1.ch019
Gerasimos Marketos, Y. Theodoridis, I. Kalogeras
Earthquake data composes an ever increasing collection of earth science information for post-processing analysis. Earth scientists, local or national administration officers and so forth, are working with these data collections for scientific or planning purposes. In this article, we discuss the architecture of a so-called seismic data management and mining system (SDMMS) for quick and easy data collection, processing, and visualization. The SDMMS architecture includes, among others, a seismological database for efficient and effective querying and a seismological data warehouse for OLAP analysis and data mining. We provide template schemes for these two components as well as examples of their functionality towards the support of decision making. We also provide a comparative survey of existing operational or prototype SDMMS.
地震数据为后处理分析提供了越来越多的地球科学信息。地球科学家、地方或国家行政官员等正在为科学或规划目的处理这些数据收集。在本文中,我们讨论了所谓的地震数据管理和挖掘系统(SDMMS)的体系结构,以实现快速简便的数据收集、处理和可视化。SDMMS体系结构包括一个用于高效查询的地震数据库和一个用于OLAP分析和数据挖掘的地震数据仓库。我们提供了这两个组件的模板方案,以及它们支持决策的功能示例。我们还提供了现有的操作或原型SDMMS的比较调查。
{"title":"Seismological Data Warehousing and Mining","authors":"Gerasimos Marketos, Y. Theodoridis, I. Kalogeras","doi":"10.4018/978-1-60566-098-1.ch019","DOIUrl":"https://doi.org/10.4018/978-1-60566-098-1.ch019","url":null,"abstract":"Earthquake data composes an ever increasing collection of earth science information for post-processing analysis. Earth scientists, local or national administration officers and so forth, are working with these data collections for scientific or planning purposes. In this article, we discuss the architecture of a so-called seismic data management and mining system (SDMMS) for quick and easy data collection, processing, and visualization. The SDMMS architecture includes, among others, a seismological database for efficient and effective querying and a seismological data warehouse for OLAP analysis and data mining. We provide template schemes for these two components as well as examples of their functionality towards the support of decision making. We also provide a comparative survey of existing operational or prototype SDMMS.","PeriodicalId":399104,"journal":{"name":"Strategic Advancements in Utilizing Data Mining and Warehousing Technologies","volume":"104 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123414004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Bagging Probit Models for Unbalanced Classification 不平衡分类的Bagging Probit模型
Pub Date : 1900-01-01 DOI: 10.4018/978-1-60566-717-1.CH017
Hualin Wang, Xiaogang Su
The 11th Pacific-Asia Knowledge Discovery and Data Mining Conference (PAKDD 2007) hosted a data mining competition, co-organized by the Singapore Institute of Statistics. The data set is from a consumer finance company with the aim of finding solutions for a cross-selling business problem. The company currently has two databases, one for credit card holders and the other for home loan (mortgage) customers and they would like to make use of this opportunity to cross-sell home loans to its credit card holders. Thus, it is of their keen interest to have an effective scoring model for predicting potential cross-sell take-ups. The training dataset contains information on 40,700 customers with 40 input variables, most of which are related to the point of application for the company’s credit card, plus a binary target variable indicating the home loan take-up status. This is a sample of customers who opened a new credit card with the company within a specific 2-year period and did not have an existing home loan with the company. The binary target variable has a value of 1 if the customer then opened a home loan with the company within 12 months after opening the credit abstract
第十一届亚太知识发现和数据挖掘会议(PAKDD 2007)主办了一项数据挖掘竞赛,由新加坡统计研究所协办。该数据集来自一家消费金融公司,目的是为交叉销售业务问题找到解决方案。该公司目前有两个数据库,一个用于信用卡持有人,另一个用于住房贷款(抵押贷款)客户,他们希望利用这个机会向信用卡持有人交叉销售住房贷款。因此,有一个有效的评分模型来预测潜在的交叉销售占有率是他们的浓厚兴趣。训练数据集包含40,700名客户的信息,其中有40个输入变量,其中大多数与公司信用卡的申请点有关,另外还有一个指示房屋贷款占用状态的二进制目标变量。这是一个客户的样本谁开了一个新的信用卡与该公司在一个特定的2年期间,并没有现有的房屋贷款与该公司。如果客户在开立信用摘要后的12个月内向该公司开立了住房贷款,则二元目标变量的值为1
{"title":"Bagging Probit Models for Unbalanced Classification","authors":"Hualin Wang, Xiaogang Su","doi":"10.4018/978-1-60566-717-1.CH017","DOIUrl":"https://doi.org/10.4018/978-1-60566-717-1.CH017","url":null,"abstract":"The 11th Pacific-Asia Knowledge Discovery and Data Mining Conference (PAKDD 2007) hosted a data mining competition, co-organized by the Singapore Institute of Statistics. The data set is from a consumer finance company with the aim of finding solutions for a cross-selling business problem. The company currently has two databases, one for credit card holders and the other for home loan (mortgage) customers and they would like to make use of this opportunity to cross-sell home loans to its credit card holders. Thus, it is of their keen interest to have an effective scoring model for predicting potential cross-sell take-ups. The training dataset contains information on 40,700 customers with 40 input variables, most of which are related to the point of application for the company’s credit card, plus a binary target variable indicating the home loan take-up status. This is a sample of customers who opened a new credit card with the company within a specific 2-year period and did not have an existing home loan with the company. The binary target variable has a value of 1 if the customer then opened a home loan with the company within 12 months after opening the credit abstract","PeriodicalId":399104,"journal":{"name":"Strategic Advancements in Utilizing Data Mining and Warehousing Technologies","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114387621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
An Integrated Framework for Fuzzy Classification and Analysis of Gene Expression Data 基因表达数据模糊分类与分析的集成框架
Pub Date : 1900-01-01 DOI: 10.4018/978-1-60566-717-1.CH009
M. Khabbaz, K. Kianmehr, Mohammed Al-Shalalfa, R. Alhajj
This chapter takes advantage of using fuzzy classifier rules to capture the correlations between genes. The main motivation to conduct this study is that a fuzzy classifier rule is essentially an “if-then” rule that contains linguistic terms to represent the feature values. This representation of a rule that demonstrates the correlations among the genes is very simple to understand and interpret for domain experts. In this proposed gene selection procedure, instead of measuring the effectiveness of every single gene for building the classifier model, the authors incorporate the impotence of a gene correlation with other existing genes in the process of gene selection. That is, a gene is rejected if it is not in a significant correlation with other genes in the dataset. Furthermore, in order to improve the reliability of this approach, the process is repeated several times in these experiments, and the genes reported as the result are the genes selected in most experiments. This chapter reports test results on five datasets and analyzes the achieved results from biological perspective. DOI: 10.4018/978-1-60566-717-1.ch009
本章利用模糊分类器规则来捕获基因之间的相关性。进行这项研究的主要动机是模糊分类器规则本质上是一个“if-then”规则,它包含语言术语来表示特征值。对于领域专家来说,这种表示基因之间相关性的规则非常容易理解和解释。在这个基因选择过程中,作者在基因选择过程中考虑了基因与其他现有基因相关的无能性,而不是衡量每个基因的有效性来构建分类器模型。也就是说,如果一个基因与数据集中的其他基因没有显著的相关性,它就会被拒绝。此外,为了提高该方法的可靠性,该过程在这些实验中重复多次,并且作为结果报告的基因是大多数实验中选择的基因。本章报告了五个数据集的测试结果,并从生物学角度分析了所获得的结果。DOI: 10.4018 / 978 - 1 - 60566 - 717 - 1. - ch009
{"title":"An Integrated Framework for Fuzzy Classification and Analysis of Gene Expression Data","authors":"M. Khabbaz, K. Kianmehr, Mohammed Al-Shalalfa, R. Alhajj","doi":"10.4018/978-1-60566-717-1.CH009","DOIUrl":"https://doi.org/10.4018/978-1-60566-717-1.CH009","url":null,"abstract":"This chapter takes advantage of using fuzzy classifier rules to capture the correlations between genes. The main motivation to conduct this study is that a fuzzy classifier rule is essentially an “if-then” rule that contains linguistic terms to represent the feature values. This representation of a rule that demonstrates the correlations among the genes is very simple to understand and interpret for domain experts. In this proposed gene selection procedure, instead of measuring the effectiveness of every single gene for building the classifier model, the authors incorporate the impotence of a gene correlation with other existing genes in the process of gene selection. That is, a gene is rejected if it is not in a significant correlation with other genes in the dataset. Furthermore, in order to improve the reliability of this approach, the process is repeated several times in these experiments, and the genes reported as the result are the genes selected in most experiments. This chapter reports test results on five datasets and analyzes the achieved results from biological perspective. DOI: 10.4018/978-1-60566-717-1.ch009","PeriodicalId":399104,"journal":{"name":"Strategic Advancements in Utilizing Data Mining and Warehousing Technologies","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130570141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Strategic Advancements in Utilizing Data Mining and Warehousing Technologies
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1