• search hit 5 of 5
Back to Result List

People underestimate the errors made by algorithms for credit scoring and recidivism prediction but accept even fewer errors

  • This study provides the first representative analysis of error estimations and willingness to accept errors in a Western country (Germany) with regards to algorithmic decision-making systems (ADM). We examine people's expectations about the accuracy of algorithms that predict credit default, recidivism of an offender, suitability of a job applicant, and health behavior. Also, we ask whether expectations about algorithm errors vary between these domains and how they differ from expectations about errors made by human experts. In a nationwide representative study (N = 3086) we find that most respondents underestimated the actual errors made by algorithms and are willing to accept even fewer errors than estimated. Error estimates and error acceptance did not differ consistently for predictions made by algorithms or human experts, but people's living conditions (e.g. unemployment, household income) affected domain-specific acceptance (job suitability, credit defaulting) of misses and false alarms. We conclude that people have unwarrantedThis study provides the first representative analysis of error estimations and willingness to accept errors in a Western country (Germany) with regards to algorithmic decision-making systems (ADM). We examine people's expectations about the accuracy of algorithms that predict credit default, recidivism of an offender, suitability of a job applicant, and health behavior. Also, we ask whether expectations about algorithm errors vary between these domains and how they differ from expectations about errors made by human experts. In a nationwide representative study (N = 3086) we find that most respondents underestimated the actual errors made by algorithms and are willing to accept even fewer errors than estimated. Error estimates and error acceptance did not differ consistently for predictions made by algorithms or human experts, but people's living conditions (e.g. unemployment, household income) affected domain-specific acceptance (job suitability, credit defaulting) of misses and false alarms. We conclude that people have unwarranted expectations about the performance of ADM systems and evaluate errors in terms of potential personal consequences. Given the general public's low willingness to accept errors, we further conclude that acceptance of ADM appears to be conditional to strict accuracy requirements.show moreshow less

Export metadata

Additional Services

Search Google Scholar Statistics
Metadaten
Author details:Felix G. RebitschekORCiDGND, Gerd GigerenzerORCiDGND, Gert G. WagnerORCiDGND
DOI:https://doi.org/10.1038/s41598-021-99802-y
ISSN:2045-2322
Pubmed ID:https://pubmed.ncbi.nlm.nih.gov/34635779
Title of parent work (English):Scientific reports
Publisher:Macmillan Publishers Limited
Place of publishing:London
Publication type:Article
Language:English
Date of first publication:2021/10/11
Publication year:2021
Release date:2024/01/17
Volume:11
Issue:1
Article number:20171
Number of pages:11
Funding institution:Projekt DEAL
Organizational units:Humanwissenschaftliche Fakultät / Strukturbereich Kognitionswissenschaften / Department Sport- und Gesundheitswissenschaften
DDC classification:1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie
6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Peer review:Referiert
Publishing method:Open Access / Gold Open-Access
DOAJ gelistet
License (German):License LogoCC-BY - Namensnennung 4.0 International
Accept ✔
This website uses technically necessary session cookies. By continuing to use the website, you agree to this. You can find our privacy policy here.