Real Alpha
Try Pro free

MTS · 3 min · Nov 4, 2026

AI safety's deference to labs reflects fear of conflict

Richard Ngo · Researcher, OpenAI

Richard Ngo says EA has deferred to labs partly because people feared confronting prestigious firms.

In this episode

Full analysis
  1. 12:37Running a company exposes AI’s gaps in reliability4 min
  2. 19:19Alignment research should clarify what good behavior means3 min
  3. 22:31AI safety needs groups willing to challenge powerful labs5 min
  4. 5:00Rapid self-improvement timelines outrun the evidence5 min
  5. 1:39AI safety's deference to labs reflects fear of conflict3 min
  6. 10:30AGI and superintelligence are distinct concepts2 min
“And not, I think, for a particularly good reason, just because people were somewhat conflict-averse and scared of challenging, prestigious, powerful companies.”
Richard Ngoat 1:46 · MTS
1:46

Takeaways

  1. He attributes deference to conflict aversion, not a good reason.
  2. Challenging lab races is a step, but not a full analysis of lab power.
  3. He says labs cast themselves as good guys against rival labs or countries.

About this segment

Richard Ngo says EA has deferred to labs partly because people feared confronting prestigious firms. He sees opposition to lab races as progress, while warning that the movement still avoids analyzing lab power.

Richard Ngo

Richard Ngo is an independent AI researcher; former OpenAI governance and DeepMind safety researcher.

Researches multi-agent intelligence after working on AI alignment at DeepMind and governance at OpenAI.

  • Theo Jaffee, Host · Co-founder & host, MTS

    One of the first members of a16z's new media team; earlier hosted the Emergent Ventures-backed Theo Jaffee Podcast.

  • Sophia Dew, Host · Host, MTS

From “AI Cannot Reliably Run a Company for Six Months | Richard Ngo”, Nov 4, 2026. Watch the full episode

Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

  1. 1:43

    That's right. I think that EA historically has been very conciliatory towards the labs And not, I think, for a particularly good reason, just because people were somewhat conflict-averse and scared of challenging, prestigious, powerful companies. So at the very least, being willing to do that is a pretty good sign. I do think we're still not quite at the point where people are willing to actually analyze the power dynamics involved in labs and try to be honest about what's actually driving them.

  2. 2:17

    But at the very least, being willing to speak out against some of the racing that they're doing seems pretty seems like a pretty good step. Right. And similarly, Scott Alexander just wrote a post called was called against. I'm forgetting the acronym. Sura. Sura. Yes. Yes. Against Sura, which is the strategy of stop unilaterally and raise awareness. A lot of people were saying this is basically a, you know, self-deceptive defense of Anthropic, where Anthropic is, you know, against Sura itself.

  3. 2:55

    It is not stopping unilaterally and raising awareness. It is continuing to push the frontier to some extent. Do you think that this is a good thing for Anthropic to be doing? Yeah. Yeah. So interestingly, a lot of the time when people discuss this stuff, they slip into this very almost basic moral reasoning of like good guys versus bad guys. And sometimes the good guys are, you know, OpenAI cast themselves as the good guys against DeepMind early on.

  4. 3:24

    And then Anthropic cast themselves as the good guys versus OpenAI and possibly versus China as well. my sense is basically that i you know i i think there are a bunch of people who are trying quite hard to be serious about the stuff in uh many of the labs and somehow there's just this very yeah very basic in some ways almost childish reasoning about um you know like trying to beat your opponents trying to get there first i'm not saying it's it's fully wrong but But...

  5. 3:59

    It's very interesting that it's the kind of trap that we see throughout history, and I think people have reasoned their way into thinking that this case is different, that in this case, you actually need to race ahead and beat your opponents. This time, everything's up for grabs because AGI is such a powerful technology. uh so that's my rough sense of what's going on that there's a kind of um that there's some kind of like they hit the point of um the standard tribal reasoning that people get into and then they sort of stop and it's it's hard to get beyond that point right um you wrote this uh or you're