Apr 27
Large Language Models Are Bad Dice Players: LLMs Struggle to Generate Random Numbers from Statistical Distributions
★★★★★
significance 3/5
Researchers conducted a large-scale audit revealing that large language models struggle significantly to generate random numbers from specific statistical distributions. The study found that while batch generation shows modest success, independent requests almost entirely fail to meet statistical requirements, leading to systematic biases in downstream tasks.
Why it matters
Systematic failures in statistical randomness undermine the reliability of LLMs for stochastic modeling and downstream algorithmic decision-making.
Tags
#llm #probabilistic sampling #statistical bias #stochasticity #benchmarkRelated coverage
- Global South OpportunitiesPivotal Research Fellowship 2026 (Q3): AI Safety Research Opportunity - Global South Opportunities
- arXiv cs.AIAn Intelligent Fault Diagnosis Method for General Aviation Aircraft Based on Multi-Fidelity Digital Twin and FMEA Knowledge Enhancement
- arXiv cs.AIPExA: Parallel Exploration Agent for Complex Text-to-SQL
- arXiv cs.AIThe Power of Power Law: Asymmetry Enables Compositional Reasoning
- arXiv cs.AIOn the Existence of an Inverse Solution for Preference-Based Reductions in Argumentation