Algorithm for Producing Rankings Based on Expert Surveys

Indra Overland, Javlon Juraev
{"title":"Algorithm for Producing Rankings Based on Expert Surveys","authors":"Indra Overland, Javlon Juraev","doi":"10.3390/a12010019","DOIUrl":null,"url":null,"abstract":"This paper develops an automated algorithm to process input data for segmented string relative rankings (SSRRs). The purpose of the SSRR methodology is to create rankings of countries, companies, or any other units based on surveys of expert opinion. This is done without the use of grading systems, which can distort the results due to varying degrees of strictness among experts. However, the original SSRR approach relies on manual application, which is highly laborious and also carries a risk of human error. This paper seeks to solve this problem by further developing the SSRR approach by employing link analysis, which is based on network theory and is similar to the PageRank algorithm used by the Google search engine. The ranking data are treated as part of a linear, hierarchical network and each unit receives a score according to how many units are positioned below it in the network. This approach makes it possible to efficiently resolve contradictions among experts providing input for a ranking. A hypertext preprocessor (PHP) script for the algorithm is included in the article’s appendix. The proposed methodology is suitable for use across a range of social science disciplines, especially economics, sociology, and political science.","PeriodicalId":345692,"journal":{"name":"Political Methods: Experiments & Experimental Design eJournal","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Political Methods: Experiments & Experimental Design eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/a12010019","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6

Abstract

This paper develops an automated algorithm to process input data for segmented string relative rankings (SSRRs). The purpose of the SSRR methodology is to create rankings of countries, companies, or any other units based on surveys of expert opinion. This is done without the use of grading systems, which can distort the results due to varying degrees of strictness among experts. However, the original SSRR approach relies on manual application, which is highly laborious and also carries a risk of human error. This paper seeks to solve this problem by further developing the SSRR approach by employing link analysis, which is based on network theory and is similar to the PageRank algorithm used by the Google search engine. The ranking data are treated as part of a linear, hierarchical network and each unit receives a score according to how many units are positioned below it in the network. This approach makes it possible to efficiently resolve contradictions among experts providing input for a ranking. A hypertext preprocessor (PHP) script for the algorithm is included in the article’s appendix. The proposed methodology is suitable for use across a range of social science disciplines, especially economics, sociology, and political science.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于专家调查的排名生成算法
本文开发了一种自动处理分段字符串相对排序(ssrr)输入数据的算法。SSRR方法的目的是根据专家意见的调查,对国家、公司或任何其他单位进行排名。这是在没有使用评分系统的情况下完成的,由于专家之间的严格程度不同,评分系统可能会扭曲结果。然而,最初的SSRR方法依赖于手动应用程序,这是非常费力的,并且还存在人为错误的风险。本文试图通过利用链接分析进一步发展SSRR方法来解决这一问题,该方法基于网络理论,类似于Google搜索引擎使用的PageRank算法。排名数据被视为线性分层网络的一部分,每个单元根据网络中位于其下方的单元数量获得分数。这种方法可以有效地解决为排名提供输入的专家之间的矛盾。本文的附录中包含了该算法的超文本预处理器(PHP)脚本。所提出的方法适用于各种社会科学学科,特别是经济学、社会学和政治学。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Do American Voters Really Not Punish Overt Undemocratic Behavior at the Polls? Natural Experimental Evidence from the 2021 Insurrection of the U.S. Capitol Absolute versus Relative: Asymmetric Framing and Feedback in a Heterogeneous-Endowment Public Goods Game Improving Studies of Sensitive Topics Using Prior Evidence: A Unified Bayesian Framework for List Experiments Are More Children Better Than One? Evidence from a Lab Experiment of Decision Making Financial Vulnerability and Seeking Expert Advice: Evidence from a Survey Experiment
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1