Collective Wisdom and the Fermi Method: Improving the Accuracy of Deliberative Groups

Authors

DOI:

https://doi.org/10.56294/piii2024257

Keywords:

Collective Decision Making, Natural Language Processing, Wisdom of Crowds, Fermi Method

Abstract

Understanding the conditions under which groups of people perform better than independent individuals is a fundamental challenge in the social and psychological sciences.(1,2) A central phenomenon in this field is the "wisdom of crowds" (the aggregate of independent estimates can be more accurate than the best individual judgment),(3,4) used in various areas, including politics(5), health(6), and business(7). While previous research suggests that group deliberation improves the accuracy of crowds, the mechanisms behind this remain unclear.(8) This study addresses this question by analyzing the use of the "Fermi method" in groups (breaking down complex questions into simpler ones and combining their solutions to reach the final answer).(9) A first study with 130 groups of 4 participants interacting in chat rooms (N=520) confirmed that group estimates are more accurate than individual ones, especially in those groups that use the Fermi method. This result was obtained by analyzing written discussions, both with human evaluators and automated methods. A second study (N=240) provided causal evidence of this phenomenon by explicitly requesting that some groups use the Fermi method, while asking others to employ estimation aggregation strategies. A third study (N=160) showed that collectively employing the Fermi method leads to superior improvement compared to using it individually. In summary, these results provide causal evidence that collectively employing the Fermi method improves group estimates, promoting its application in various domains, through either explicit instructions or automated detection methods

References

Kameda T, Toyokawa W, Tindale RS. Information aggregation and collective intelligence beyond the wisdom of crowds. Nature Reviews Psychology. 2022 Jun;1(6):345-57.

Karachiwalla R, Pinkow F. Understanding crowdsourcing projects: A review on the key design elements of a crowdsourcing initiative. Creativity and innovation management. 2021 Sep;30(3):563-84.

Surowiecki J. The Wisdom of Crowds/James Surowiecki. NY.: Anchor. 2005.

Galton F. Vox Populi (1907) Nature, n. 1949, vol. 75, pp. 450-451 (traduzione di Romolo Giovanni Capuano©). Nature. 1949;75:450-1.

Mellers B, Ungar L, Baron J, Ramos J, Gurcay B, Fincher K, Scott SE, Moore D, Atanasov P, Swift SA, Murray T. Psychological strategies for winning a geopolitical forecasting tournament. Psychological science. 2014 May;25(5):1106-15.

Kurvers RH, Herzog SM, Hertwig R, Krause J, Carney PA, Bogart A, Argenziano G, Zalaudek I, Wolf M. Boosting medical diagnostics by pooling independent judgments. Proceedings of the National Academy of Sciences. 2016 Aug 2;113(31):8777-82.

Ray R. Prediction markets and the financial" wisdom of crowds". The Journal of Behavioral Finance. 2006 Mar 1;7(1):2-4.

Navajas J, Niella T, Garbulsky G, Bahrami B, Sigman M. Aggregated knowledge from a small number of debates outperforms the wisdom of large crowds. Nature Human Behaviour. 2018 Feb;2(2):126-32.

Nityananda R. Fermi and the art of estimation. Resonance. 2014 Jan;19(1):73-81.

Downloads

Published

2024-05-03

How to Cite

1.
Barrera-Lemarchand F, Lescano-Charreau V, Ruiz J, Cáceres N, Carrillo F, Navaja J. Collective Wisdom and the Fermi Method: Improving the Accuracy of Deliberative Groups. SCT Proceedings in Interdisciplinary Insights and Innovations [Internet]. 2024 May 3 [cited 2024 Oct. 7];2:257. Available from: https://proceedings.ageditor.ar/index.php/piii/article/view/228