{"title":"Governing by Algorithm? No Noise and (Potentially) Less Bias","authors":"C. Sunstein","doi":"10.2139/ssrn.3925240","DOIUrl":null,"url":null,"abstract":"As intuitive statisticians, human beings suffer from identifiable biases, cognitive and otherwise. Human beings can also be “noisy,” in the sense that their judgments show unwanted variability. As a result, public institutions, including those that consist of administrative prosecutors and adjudicators, can be biased, noisy, or both. Both bias and noise produce errors. Algorithms eliminate noise, and that is important; to the extent that they do so, they prevent unequal treatment and reduce errors. In addition, algorithms do not use mental short-cuts; they rely on statistical predictors, which means that they can counteract or even eliminate cognitive biases. At the same time, the use of algorithms, by administrative agencies, raises many legitimate questions and doubts. Among other things, they can encode or perpetuate discrimination, perhaps because their inputs are based on discrimination, perhaps because what they are asked to predict is infected by discrimination. But if the goal is to eliminate discrimination, properly constructed algorithms nonetheless have a great deal of promise for administrative agencies.","PeriodicalId":48724,"journal":{"name":"Law Probability & Risk","volume":"27 1","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2021-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"15","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Law Probability & Risk","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.2139/ssrn.3925240","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"LAW","Score":null,"Total":0}
引用次数: 15
Abstract
As intuitive statisticians, human beings suffer from identifiable biases, cognitive and otherwise. Human beings can also be “noisy,” in the sense that their judgments show unwanted variability. As a result, public institutions, including those that consist of administrative prosecutors and adjudicators, can be biased, noisy, or both. Both bias and noise produce errors. Algorithms eliminate noise, and that is important; to the extent that they do so, they prevent unequal treatment and reduce errors. In addition, algorithms do not use mental short-cuts; they rely on statistical predictors, which means that they can counteract or even eliminate cognitive biases. At the same time, the use of algorithms, by administrative agencies, raises many legitimate questions and doubts. Among other things, they can encode or perpetuate discrimination, perhaps because their inputs are based on discrimination, perhaps because what they are asked to predict is infected by discrimination. But if the goal is to eliminate discrimination, properly constructed algorithms nonetheless have a great deal of promise for administrative agencies.
期刊介绍:
Law, Probability & Risk is a fully refereed journal which publishes papers dealing with topics on the interface of law and probabilistic reasoning. These are interpreted broadly to include aspects relevant to the interpretation of scientific evidence, the assessment of uncertainty and the assessment of risk. The readership includes academic lawyers, mathematicians, statisticians and social scientists with interests in quantitative reasoning.
The primary objective of the journal is to cover issues in law, which have a scientific element, with an emphasis on statistical and probabilistic issues and the assessment of risk.
Examples of topics which may be covered include communications law, computers and the law, environmental law, law and medicine, regulatory law for science and technology, identification problems (such as DNA but including other materials), sampling issues (drugs, computer pornography, fraud), offender profiling, credit scoring, risk assessment, the role of statistics and probability in drafting legislation, the assessment of competing theories of evidence (possibly with a view to forming an optimal combination of them). In addition, a whole new area is emerging in the application of computers to medicine and other safety-critical areas. New legislation is required to define the responsibility of computer experts who develop software for tackling these safety-critical problems.