Many top artificial intelligence researchers at the world’s leading labs — Anthropic, OpenAI and Google DeepMind — fear that the technology they are busy creating could result in an apocalypse.
They call their fear the “alignment problem”: that the systems they are building will, in short order, surpass humanity in cognitive power, and that once they do, there is no obvious reason such godlike systems would continue to align with humanity’s best interest.
