Open Problems in Frontier AI Risk Management

arXiv cs.AI / 4/30/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper argues that frontier AI increases known risks while creating qualitatively new safety and governance challenges.
  • It identifies a major gap in stable scientific consensus due to rapid technology change, and notes that emerging safety practices may not align with existing risk management frameworks.
  • Using a structured literature review, it examines each stage of risk management—planning, identification, analysis, evaluation, and mitigation—to surface unresolved problems.
  • It classifies open problems by whether they stem from (a) lack of technical/scientific consensus, (b) misalignment with established frameworks, or (c) implementation shortcomings despite apparent consensus.
  • Rather than proposing solutions, it provides an agenda-setting reference plus a living repository to coordinate efforts and guide future research and governance.

Abstract

Frontier AI both amplifies existing risks and introduces qualitatively novel challenges. Not only is there a notable lack of stable scientific consensus resulting from the rapid pace of technological change, but emerging frontier AI safety practices are often misaligned with, or may undermine, established risk management frameworks. To address these challenges, we systematically surface open problems in frontier AI risk management. Adopting a problem-oriented approach, we examine each stage of the risk management process - risk planning, identification, analysis, evaluation, and mitigation - through a structured review of the literature, identifying unresolved challenges and the actors best positioned to address them. Recognising that different types of open problems call for different responses, we classify open problems according to whether they reflect (a) a lack of scientific or technical consensus, (b) misalignment with, or challenges to, established risk management frameworks, or (c) shortcomings in implementation despite apparent consensus and alignment. By mapping these open problems and identifying the actors best positioned to address them - including developers, deployers, regulators, standards bodies, researchers, and third-party evaluators - this work aims to clarify where progress is needed to enable robust and meaningful consensus on frontier AI risk management.The paper does not propose specific solutions; instead, it provides a problem-oriented, agenda-setting reference document, complemented by a living online repository, intended to support coordination, reduce duplication, and guide future research and governance efforts.