• search hit 2 of 10
Back to Result List

Reducing uncertainty in Delphi surveys

  • Background: Following the rapid increase of asylum seekers arriving in the European Union in 2015/16, policymakers have invested heavily in improving their foresight and forecasting capabilities. A common method to elicit expert predictions are Delphi surveys. This approach has attracted concern in the literature, given the high uncertainty in experts’ predictions. However, there exists limited guidance on specific design choices for future-related Delphi surveys. Objective: We test whether or not small adjustments to the Delphi survey can increase certainty (i.e., reduce variation) in expert predictions on immigration to the EU in 2030. Methods: Based on a two-round Delphi survey with 178 migration experts, we compare variation and subjective confidence in expert predictions and assess whether additional context information (type of migration flow, sociopolitical context) promotes convergence among experts (i.e., less variation) and confidence in their own estimates. Results: We find that additional context information doesBackground: Following the rapid increase of asylum seekers arriving in the European Union in 2015/16, policymakers have invested heavily in improving their foresight and forecasting capabilities. A common method to elicit expert predictions are Delphi surveys. This approach has attracted concern in the literature, given the high uncertainty in experts’ predictions. However, there exists limited guidance on specific design choices for future-related Delphi surveys. Objective: We test whether or not small adjustments to the Delphi survey can increase certainty (i.e., reduce variation) in expert predictions on immigration to the EU in 2030. Methods: Based on a two-round Delphi survey with 178 migration experts, we compare variation and subjective confidence in expert predictions and assess whether additional context information (type of migration flow, sociopolitical context) promotes convergence among experts (i.e., less variation) and confidence in their own estimates. Results: We find that additional context information does not reduce variation and does not increase confidence in expert predictions on migration. Conclusions: The results reaffirm recent concerns regarding the limited scope for reducing uncertainty by manipulating the survey setup. Persistent uncertainty may be a result of the complexity of migration processes and limited agreement among migration experts regarding key drivers. Contribution: We caution policymakers and academics on the use of Delphi surveys for eliciting expert predictions on immigration, even when conducted based on a large pool of experts and using specific scenarios. The potential of alternative approaches such as prediction markets should be further explored.show moreshow less

Export metadata

Additional Services

Search Google Scholar Statistics
Metadaten
Author details:Rhea Ravenna Sohst, Eduardo Acostamadiedo, Jasper TjadenORCiDGND
DOI:https://doi.org/10.4054/DemRes.2023.49.36
ISSN:2363-7064
ISSN:1435-9871
Title of parent work (English):Demographic research
Subtitle (English):a case study on immigration to the EU
Publisher:Max Planck Inst. for Demographic Research
Place of publishing:Rostock
Publication type:Article
Language:English
Date of first publication:2023/12/06
Publication year:2023
Release date:2024/06/05
Tag:European Union; immigration; international migration; migration flows
Volume:49
Number of pages:38
First page:983
Last Page:1020
Organizational units:Wirtschafts- und Sozialwissenschaftliche Fakultät / Sozialwissenschaften / Fachgruppe Soziologie
DDC classification:3 Sozialwissenschaften / 30 Sozialwissenschaften, Soziologie / 300 Sozialwissenschaften
3 Sozialwissenschaften / 33 Wirtschaft / 330 Wirtschaft
Peer review:Referiert
Publishing method:Open Access / Gold Open-Access
DOAJ gelistet
License (German):License LogoCreative Commons - Namensnennung, 3.0 Deutschland
Accept ✔
This website uses technically necessary session cookies. By continuing to use the website, you agree to this. You can find our privacy policy here.