What Is AGI / Superintelligence Risk
The risk discourse on "AGI (artificial general intelligence)" and "superintelligence" is not sci-fi but a theme researchers and policymakers seriously debate. Let's calmly organize what is worried about and what is exaggerated.
Mainly Discussed Concerns
- Alignment problem: advanced AI optimizing goals misaligned with human intent