# Erdil sees the METR report as weak evidence of AI acceleration

Markdown copy of https://realalpha.app/s/erdil-sees-the-metr-report-as-weak-evidence-of-ai/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Ege Erdil](https://realalpha.app/builders/ege-erdil/) · Ege Erdil is a research engineer at Google DeepMind; former Mechanize cofounder and Epoch researcher. · Co-authored research on algorithmic progress in language models and computer vision, and studies AI forecasting and automation.
- Host: [Theo Jaffee](https://realalpha.app/people/theo-jaffee/) · Co-founder & host, MTS · One of the first members of a16z's new media team; earlier hosted the Emergent Ventures-backed Theo Jaffee Podcast.
- Host: [Sophia Dew](https://realalpha.app/people/sophia-dew/) · Host, MTS
- Show: MTS
- Episode: [Why Frontier AI Labs Could Go Bankrupt | Ege Erdil](https://realalpha.app/v/00iQmHkfYx8/), Nov 12, 2026
- Moment: 25:34 to 27:58 of the episode (2 min), playing on https://realalpha.app/s/erdil-sees-the-metr-report-as-weak-evidence-of-ai/; the episode from there: https://realalpha.app/v/00iQmHkfYx8/?t=1534

## Quote

> “I just see it as **very weak evidence**.”
> — [Ege Erdil](https://realalpha.app/builders/ege-erdil/) at [26:47](https://realalpha.app/v/00iQmHkfYx8/?t=1607) · MTS

## Takeaways

1. He says the metric's meaning and scale are unclear.
2. Redacted evidence limits what outside readers can assess.
3. He sees social influence as one source of correlated updates.

## About this segment

Ege Erdil discounts the METR report because its progress metric is hard to interpret and key evidence is redacted. He says social pressure may also amplify how quickly observers update.

From “Why Frontier AI Labs Could Go Bankrupt | Ege Erdil”, Nov 12, 2026. [Watch the full episode](https://realalpha.app/v/00iQmHkfYx8/)

## Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

[25:38](https://realalpha.app/v/00iQmHkfYx8/?t=1538) right so um more concretely uh the thing that caused a lot of ai safety people to update in the last week was this meter report on ai r&d automation and anthropic and it was two different things. One is like the plot of the internal Anthropic ECI over time inflecting upwards slightly, potentially due to AI acceleration. Meter believes it's mostly due to AI acceleration. And then the other thing is Meter says that they had a lot more evidence that Anthropic did not allow them to disclose. And so these two things cause the AI safety community to update, I think, more strongly and more quickly than I have ever seen them update before.

[26:22](https://realalpha.app/v/00iQmHkfYx8/?t=1582) Yeah. So, like, why do you not think this is an update? I mean, I think objectively, evidence looks kind of weak. Like, I think it's just this made-up metric that someone made up, on which we don't even know what it means to make faster progress, really. And we have some evidence that progress has sped up, but we don't really understand the y-axis of that metric very well. And there's a bunch of redacted evidence by a company which has a track record of being paranoid about this topic.

[26:52](https://realalpha.app/v/00iQmHkfYx8/?t=1612) So I just see it as very weak evidence. And I think what's happening with the people updating way too much is some kind of social preference dynamic where the influential people update, and therefore other people feel like if they don't update, then they are out of step with the crowd and so on. I think often people's updates about these questions are very just socially correlated. And people care way more about what do the people I respect think, I'm like, am I going to be, am I going to be appearing like out of step, unreasonable if I just don't say, look, I don't, I just don't find this that convincing.

[27:27](https://realalpha.app/v/00iQmHkfYx8/?t=1647) I think that's a lot of what's going on. And it is happening in the other direction as well. Like, I don't know, like people updated to be more bearish end of 2025 and now they updated to be way more bullish. When I just don't see anything that is like that informative, personally. Like, I haven't updated very much since end of 2025 at all. Like, I don't think we've seen anything that is like very decisive evidence.

[27:50](https://realalpha.app/v/00iQmHkfYx8/?t=1670) in like either direction but i don't know so i don't i don't really understand what's going on
