AI Insiders Keep Saying We’re In Danger — Where’s The Evidence?

SUMMARY

Ed Elson and guest Ed Zitron critically examine the escalating debate over AI safety, highlighting the lack of concrete evidence behind existential risk claims and the absence of accountability among major AI labs. Mark Zandi provides analysis on rising treasury yields, inflation pressures, and the implications for interest rates and the U.S. housing market.

MAIN POINTS

• AI safety researchers resign from major labs, publicly warning of existential risks without providing specific evidence. [1:30]
• Industry leaders and commentators debate the motivations behind AI risk narratives, with some alleging hype for regulatory or financial gain. [6:00]
• The conversation around AI safety is criticized for lacking substance and accountability, with media and government failing to demand concrete proof or action. [12:00]
• Anthropic's upcoming IPO and claims of profitability are scrutinized, with skepticism over accounting practices and the sustainability of the AI business model. [18:00]
• The 10-year U.S. Treasury yield surpasses 5%, driven by inflation, surging oil prices, and geopolitical tensions, raising concerns about future rate hikes. [22:00]
• Mark Zandi argues that inflation is problematic but questions the effectiveness of further rate hikes, citing supply shocks and weakening real wages. [27:00]
• Discussion turns to the Federal Reserve's independence, potential policy mistakes, and the political pressures facing Fed Chair Kevin Worsh. [32:00]
• U.S. housing affordability reaches historic lows as home prices and mortgage rates climb, with little indication of policy intervention to address the crisis. [36:00]

DETAILED ANALYSIS

The episode opens with a critical examination of the ongoing AI safety debate, sparked by high-profile resignations from researchers at Google DeepMind and Anthropic. These individuals have publicly expressed fears that artificial intelligence could pose an existential threat to humanity, yet their warnings are notably vague, lacking concrete examples or technical explanations of the specific dangers. The discussion highlights how these claims have rapidly gained traction in both media and policy circles, despite the absence of substantiated evidence or clear definitions of what a 'slowdown' in AI development would entail.

Ed Zitron, a prominent commentator on technology and AI, characterizes the AI safety movement as divided between true believers—often associated with rationalist and effective altruist communities—and more cynical actors within the industry. The latter, including figures like Sam Altman and Dario Amodei, are accused of leveraging safety concerns to generate hype, attract regulatory favor, or secure financial advantages for their companies. Zitron argues that much of the discourse is performative, serving corporate interests rather than genuine public safety, and that the media has failed to critically interrogate these narratives.

He points out that incidents such as the 'hugging face' hacking episode are often misrepresented, with responsibility deflected away from the labs themselves and toward abstract notions of rogue AI behavior.

The conversation further critiques the lack of accountability in both media and government responses. Despite calls for regulation and oversight, there has been little movement toward concrete legal or regulatory action against AI labs, even in cases where their models have been implicated in security breaches or real-world harms. Zitron and Elson suggest that existing laws governing unsafe products could be applied, yet neither journalists nor policymakers have pursued this path.

The debate is described as being mired in speculation and fear-mongering, with little grounding in verifiable facts or transparent risk assessments.

Attention then shifts to the business side of AI, particularly the impending Anthropic IPO. Reports of operating profitability are met with skepticism, as key costs such as model training and stock-based compensation are excluded from the figures presented to investors. Zitron anticipates that the company's financial disclosures will reveal a less sustainable business model than currently advertised, noting that significant revenue-sharing agreements with cloud providers further complicate the profitability narrative.

The broader implication is that the AI sector's rapid growth and high valuations may be built on unstable foundations, with hype and creative accounting masking underlying financial challenges.

The episode transitions to macroeconomic developments, focusing on the sharp rise in the 10-year U.S. Treasury yield, which has exceeded 5% for the first time since 2007. This increase is attributed to a combination of persistent inflation, surging oil prices driven by geopolitical instability in the Middle East, and the U.S. government's substantial fiscal deficits.

Mark Zandi, chief economist at Moody's Analytics, explains that while inflation remains above the Federal Reserve's target, much of the current price pressure is due to supply shocks—such as energy costs and tariffs—rather than excess demand. He cautions that further interest rate hikes may do little to address these root causes and could instead risk tipping the economy into recession, especially as real wage growth turns negative and consumer purchasing power declines.

Zandi also discusses the challenges facing the Federal Reserve, which is under pressure to balance its dual mandate of controlling inflation and supporting employment. He expresses concern that the Fed's recent communication strategy, which has become less transparent under Chair Kevin Worsh, increases the risk of policy missteps. The potential for political conflict between the Fed and the executive branch is noted, drawing parallels to past tensions between President Trump and former Chair Jerome Powell.

Ultimately, Zandi argues that while inflation is a significant problem, monetary policy alone is insufficient to resolve issues stemming from external shocks and structural factors.

The episode concludes with an update on the U.S. housing market, where affordability has reached an all-time low. Home prices now average more than seven times the typical household income, and the average 30-year mortgage rate has risen above 7% for the first time in over a year. These trends are directly linked to the broader macroeconomic environment, as rising treasury yields push borrowing costs higher.

Despite the severity of the housing affordability crisis, there appears to be little political will to implement corrective measures, leaving prospective homebuyers facing unprecedented financial barriers.

LINKS

• Prof G Markets YouTube Channel
• Prof G Markets newsletter subscription
• Order 'Notes On Being A Man'
• Subscribe to No Mercy / No Malice
• Markets on Instagram
• Scott Galloway on Instagram
• Ed Elson on Instagram
• Ed Elson on X (Twitter)
• Ed Elson on Substack
• Weight loss by HIMS information and program

KEYWORDS