Doomer's Education (9-minute read)

It raises concerns that the radical advancement of AI technology could lead to a loss of humanity. The author warns that if AI becomes smarter, faster, and cheaper than humans, the human role could disappear. In particular, the author emphasizes that AI could even transform political power structures.

The AI Alignment problem was initially expected to be solved through empirical experiments, but since the introduction of RL (Reinforcement Learning), model comprehension has declined and alignment failure cases have increased. As AI's capability growth outpaces human control and understanding, humans are becoming increasingly dependent on AI.

In the field of software engineering, the adoption of AI tools has improved productivity, but it has also led to side effects such as increased codebase complexity and a regression in industry discourse. The author points out that excessive reliance on AI may diminish human critical thinking and learning abilities.