Try Pro free

MTS · 2 min · Nov 12, 2026

Erdil sees the METR report as weak evidence of AI acceleration

Ege Erdil discounts the METR report because its progress metric is hard to interpret and key evidence is redacted.

In this episode

Full analysis
  1. 0:59Frontier labs may struggle to sustain high margins5 min
  2. 9:36Long-term compute commitments could put lab equity at risk3 min
  3. 16:20Compute and data constrain how fast AI research can acceleratePro pick 3 min
  4. 21:05AI timeline forecasts need measurable real-world outcomes5 min
  5. 12:43Profitable memory stocks look safer than frontier labs to Erdil3 min
  6. 6:09Low switching costs weaken AI labs’ pricing power3 min
  7. 25:34Erdil sees the METR report as weak evidence of AI acceleration2 min
Up next · My First MillionPeer groups can become durable businesses in overlooked industriesPro pick 7:16
“I just see it as very weak evidence.”
Ege Erdilat 26:47 · MTS
26:47

Takeaways

  1. He says the metric's meaning and scale are unclear.
  2. Redacted evidence limits what outside readers can assess.
  3. He sees social influence as one source of correlated updates.

About this segment

Ege Erdil discounts the METR report because its progress metric is hard to interpret and key evidence is redacted. He says social pressure may also amplify how quickly observers update.

Ege Erdil

Ege Erdil is a research engineer at Google DeepMind; former Mechanize cofounder and Epoch researcher.

Co-authored research on algorithmic progress in language models and computer vision, and studies AI forecasting and automation.

  • Theo Jaffee, Host · Co-founder & host, MTS

    One of the first members of a16z's new media team; earlier hosted the Emergent Ventures-backed Theo Jaffee Podcast.

  • Sophia Dew, Host · Host, MTS

From “Why Frontier AI Labs Could Go Bankrupt | Ege Erdil”, Nov 12, 2026. Watch the full episode

Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

  1. 25:38

    right so um more concretely uh the thing that caused a lot of ai safety people to update in the last week was this meter report on ai r&d automation and anthropic and it was two different things. One is like the plot of the internal Anthropic ECI over time inflecting upwards slightly, potentially due to AI acceleration. Meter believes it's mostly due to AI acceleration. And then the other thing is Meter says that they had a lot more evidence that Anthropic did not allow them to disclose. And so these two things cause the AI safety community to update, I think, more strongly and more quickly than I have ever seen them update before.

  2. 26:22

    Yeah. So, like, why do you not think this is an update? I mean, I think objectively, evidence looks kind of weak. Like, I think it's just this made-up metric that someone made up, on which we don't even know what it means to make faster progress, really. And we have some evidence that progress has sped up, but we don't really understand the y-axis of that metric very well. And there's a bunch of redacted evidence by a company which has a track record of being paranoid about this topic.

  3. 26:52

    So I just see it as very weak evidence. And I think what's happening with the people updating way too much is some kind of social preference dynamic where the influential people update, and therefore other people feel like if they don't update, then they are out of step with the crowd and so on. I think often people's updates about these questions are very just socially correlated. And people care way more about what do the people I respect think, I'm like, am I going to be, am I going to be appearing like out of step, unreasonable if I just don't say, look, I don't, I just don't find this that convincing.

  4. 27:27

    I think that's a lot of what's going on. And it is happening in the other direction as well. Like, I don't know, like people updated to be more bearish end of 2025 and now they updated to be way more bullish. When I just don't see anything that is like that informative, personally. Like, I haven't updated very much since end of 2025 at all. Like, I don't think we've seen anything that is like very decisive evidence.

  5. 27:50

    in like either direction but i don't know so i don't i don't really understand what's going on