Artificial intelligence has jumped from research labs into society, sparking anxiety about its existential risks. How concerned should we be about the AI apocalypse? The latest episode of The Ezra Klein Show explores this issue, featuring dire warnings from pioneers like Eliezer Yudkowsky along with sharp rebuttals from skeptics. The debate intensifies as society confronts the potential for artificial general intelligence to transform or even end our world.
Apocalypse or Hype? What the Experts Say in 2025
The “godfather of AI,” Geoffrey Hinton, estimates a 10–20% chance that artificial intelligence could lead to humanity’s extinction within 30 years. In The Guardian’s 2024 report, Hinton, formerly with Google, warned that “bad actors” and unchecked tech development could create catastrophic risks as AI surpasses human intelligence. Conversely, other prominent figures—such as Meta’s Yann LeCun—assert that doomsaying distracts from immediate risks like bias and misinformation. The debate isn’t new, but the stakes have escalated as large language models influence elections, commerce, and even military choices. When OpenAI released GPT-5, some claimed AI had peaked; however, a 2025 New York Times analysis shows a wide expert consensus remains elusive.
This epistemic chaos resembles divides in other transformative technologies, such as nuclear deterrence, as analyzed in crisis field reports. Doomers and boosters frequently talk past each other.
Advertisement
The Alignment Problem: When AIs Go Off The Rails
The primary technical and philosophical challenge is the AI alignment problem. This issue is not merely theoretical; real-world misalignments already surface. As detailed in AI alignment scholarship, failures vary from minor accidents involving autonomous vehicles to alarming scenarios where AIs pursue goals detrimental to humanity. Recent cases, including biased algorithms and dysfunctional safety protocols, highlight a critical flaw: current models follow reward signals that do not always reflect human values. Industry leaders from OpenAI, Anthropic, and Google DeepMind acknowledge the catastrophic risks of alignment failures, but clear consensus is lacking, and safety advancements progress slowly. Concerns about AIs optimizing for unintended consequences echo through scenario research and policy reviews, including .









