LLMs Match Human Crowd Accuracy With Ensemble Prediction Capabilities
LLMs can rival human crowd accuracy when working together as an ensemble, demonstrating "wisdom of the silicon crowd" in tasks like surveys & decision-making.
This is a Plain English Papers summary of a research paper called Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracy. If you like these kinds of analysis, you should subscribe to the AImodels.fyi newsletter or follow me on Twitter. Overview This paper explores the ability of large language models (LLMs) to make predictions as an ensemble, and how their performance compares to that of human crowds. The researchers found that an ensemble of instruction-tuned LLMs can match the accuracy of human crowd predictions on a variety of tasks, demonstra...