AI Navigate

Infinite Problem Generator: Verifiably Scaling Physics Reasoning Data with Agentic Workflows

arXiv cs.CL / 3/17/2026

📰 NewsDeveloper Stack & InfrastructureIdeas & Deep AnalysisTools & Practical UsageModels & Research

Key Points

  • The paper presents Infinite Problem Generator (IPG), an agentic framework that synthesizes physics problems with guaranteed solvability using a Formula-as-Code paradigm.
  • Unlike probabilistic text generation, IPG produces solutions as executable Python programs to ensure mathematical consistency and verifiable reasoning traces.
  • As a proof-of-concept, the authors release ClassicalMechanicsV1, a dataset of 1,335 classical mechanics problems expanded from 165 seeds featuring 102 unique formulas and an average formula count of 3.05 per problem.
  • They identify a Complexity Blueprint showing a strong linear correlation (R^2 ≈ 0.95) between formula count and verification code length, enabling controllable curriculum generation by code complexity.
  • The authors also release the full IPG pipeline, the dataset, and the evaluation report to promote reproducible reasoning research in AI.

Abstract

Training large language models for complex reasoning is bottlenecked by the scarcity of verifiable, high-quality data. In domains like physics, standard text augmentation often introduces hallucinations, while static benchmarks lack the reasoning traces required for fine-tuning. We introduce the Infinite Problem Generator (IPG), an agentic framework that synthesizes physics problems with guaranteed solvability through a Formula-as-Code paradigm. Unlike probabilistic text generation, IPG constructs solutions as executable Python programs, enforcing strict mathematical consistency. As a proof-of-concept, we release ClassicalMechanicsV1, a high-fidelity corpus of 1,335 classical mechanics problems expanded from 165 expert seeds. The corpus demonstrates high structural diversity, spanning 102 unique physical formulas with an average complexity of 3.05 formulas per problem. Furthermore, we identify a Complexity Blueprint, demonstrating a strong linear correlation (R^2 \approx 0.95) between formula count and verification code length. This relationship establishes code complexity as a precise, proxy-free metric for problem difficulty, enabling controllable curriculum generation. We release the full IPG pipeline, the ClassicalMechanicsV1 dataset, and our evaluation report to support reproducible research in reasoning-intensive domains.