Failure to Reproduce Modern Paper Claims [D]

Reddit r/MachineLearning / 4/16/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The author reports that, after attempting to reproduce several modern research paper claims, only a minority of tested claims could be replicated successfully.
  • They cite that multiple irreproducible results are associated with active unresolved issues on the papers’ public GitHub repositories.
  • The experience leads them to question the reliability and overall current state of research practices, especially around reproducibility.
  • The post implicitly highlights gaps in verification workflows, code/data availability, and issue resolution that can prevent independent confirmation of findings.

I have tried to reproduce paper claims that are feasible for me to check. This year, out of 7 checked claims, 4 were irreproducible, with 2 having active unresolved issues on Github. This really makes me question the current state of research.

submitted by /u/Environmental_Form14
[link] [comments]