K. Imai, Zhichao Jiang, D. James Greiner, R. Halen, Sooahn Shin
We thank the Research Section of the Royal Statistical Society for providing us with a valuable opportunity to present our paper and receive feedback from many scholars. Despite their diverse perspectives, we believe that all of our discussants are in agreement about the need to develop new statistical methodology to better analyze algorithm-assisted human decision making. While the use of algorithms has become ubiquitous in today’s society, we — humans — still make many consequential decisions with the help of algorithms. As Kumar and VanderWeele noted, such a hybrid decision-making system may allows one to combine human experiences and knowledge with algorithmic recommendations, possibly leading to improved decisions. Moreover, even if fully algorithmic decision-making is more optimal than a hybrid system, we may still prefer the latter because we want to hold humans, rather than algorithms, accountable for the consequences of decisions. The importance of algorithm-assisted human decision making motivated us to develop a set of methodological tools to evaluate and understand how algorithmic recommendations affect human decisions. As echoed by Cruz Cortéz and Gosh, our study sharply contrasts with much of the existing studies whose focus has been the accuracy and fairness of algorithms themselves. We hope other researchers follow up on this important research agenda. Below, we respond to specific comments raised by the discussants.
{"title":"Reply to the discussants of “Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment.” Journal of the Royal Statistical Society, Series A, Forthcoming","authors":"K. Imai, Zhichao Jiang, D. James Greiner, R. Halen, Sooahn Shin","doi":"10.1093/jrsssa/qnad023","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad023","url":null,"abstract":"We thank the Research Section of the Royal Statistical Society for providing us with a valuable opportunity to present our paper and receive feedback from many scholars. Despite their diverse perspectives, we believe that all of our discussants are in agreement about the need to develop new statistical methodology to better analyze algorithm-assisted human decision making. While the use of algorithms has become ubiquitous in today’s society, we — humans — still make many consequential decisions with the help of algorithms. As Kumar and VanderWeele noted, such a hybrid decision-making system may allows one to combine human experiences and knowledge with algorithmic recommendations, possibly leading to improved decisions. Moreover, even if fully algorithmic decision-making is more optimal than a hybrid system, we may still prefer the latter because we want to hold humans, rather than algorithms, accountable for the consequences of decisions. The importance of algorithm-assisted human decision making motivated us to develop a set of methodological tools to evaluate and understand how algorithmic recommendations affect human decisions. As echoed by Cruz Cortéz and Gosh, our study sharply contrasts with much of the existing studies whose focus has been the accuracy and fairness of algorithms themselves. We hope other researchers follow up on this important research agenda. Below, we respond to specific comments raised by the discussants.","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"66 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90481376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Comments on the paper “Experimental Evaluation of Algorithm-Assisted Human-Decision-Making: Application to Pretrial Public Safety Assessment” by Kosuke Imai, Z. Jiang, D J Greiner, R. Halen and S. Shin","authors":"K. Kumar","doi":"10.1093/jrsssa/qnad021","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad021","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"18 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84877816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion on: Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment","authors":"P. Conti","doi":"10.1093/jrsssa/qnad027","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad027","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"482 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77791104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Commentary on “Experimental Evaluation of Algorithm-Assisted Human-Decision Making: Application to Pretrial Public Safety Assessment”. Kosuke Imai, Zhichao Jiang, James Greiner, Ryan Halen, Sooahn Shin","authors":"Efrén Cruz Cortés, Debashis Ghosh","doi":"10.1093/jrsssa/qnad017","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad017","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"30 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77901065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion on the paper titled “Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to the Pretrial Safety Assessment”","authors":"Priyantha Wijayatunga","doi":"10.1093/jrsssa/qnad025","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad025","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"14 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88171367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion of ‘Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment’, part 1","authors":"Aaron L Sarveta, Mats J Stensruda","doi":"10.1093/jrsssa/qnad015","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad015","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"303 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82898481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion of ‘Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment’, part 2","authors":"M. J. Stensrud, V. Didelez, Aaron L Sarvet","doi":"10.1093/jrsssa/qnad016","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad016","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"6 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82348809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Comment on “Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment” by Imai et al.","authors":"Peng Ding","doi":"10.1093/jrsssa/qnad013","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad013","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"1 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89385177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Seconder of the vote of thanks and contribution to the Discussion of “Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment” by Kosuke Imai, Zhichao Jiang, D. James Greiner, Ryan Halen and Sooahn Shin","authors":"P. Dawid","doi":"10.1093/jrsssa/qnad012","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad012","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"40 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86497377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment","authors":"André Python","doi":"10.1093/jrsssa/qnad024","DOIUrl":"https://doi.org/10.1093/jrsssa/qnad024","url":null,"abstract":"","PeriodicalId":49983,"journal":{"name":"Journal of the Royal Statistical Society Series A-Statistics in Society","volume":"96 1","pages":""},"PeriodicalIF":2.0,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73396210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：