OpenProblemBench: Benchmarking AI on Open Problems in the Foundational Theoretical Sciences
arXiv cs.AIen
arXiv:2610.11118v1 Announce Type: new Abstract: The next frontier for artificial general intelligence is tackling unresolved scientific problems, calling for benchmarks that assess progress beyond established knowledge. We introduce OpenProblemBench, a benchmark of 82 unresolved problems drawn from the mathematics and theoretical physics literature. Each problem supplies the research context, assumptions, and prior progress needed to investigate the question. We select problems whose proposed solutions admit comparatively clear checks of their decisive mathematical or computational claims. Four evaluator models independently assess the correctness, completeness, and degree of progress of eac
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Video-AI
- Forskning
Related AI news
- On the Clock: Towards Punctual and Productive Time-Budgeted AI AgentsarXiv cs.AI · October 9, 2026
- How Narrative Wrapping Affects LLM Refusal: A Cross-Language Benchmark and DefensearXiv cs.AI · October 9, 2026
- Curating Always-Loaded Context for LLM Agents: A Capacitated Assortment Model with Censored FeedbackarXiv cs.AI · October 9, 2026
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksarXiv cs.AI · October 9, 2026
- When Lower Reconstruction Loss Hurts: Distributionally Robust Refinement for Low-Bit LLM QuantizationarXiv cs.AI · October 9, 2026
- Plan-and-Patch: Diffusion Language Models for Agentic PlanningarXiv cs.AI · October 9, 2026