# Anthropic’s serving efficiency rose sevenfold in a year

Markdown copy of https://realalpha.app/s/anthropics-serving-efficiency-rose-sevenfold-in-a-year/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Jamin Ball](https://realalpha.app/people/jamin-ball/) · Jamin Ball is a partner at Altimeter and author of Clouded Judgement. · Invests in enterprise software and AI companies, and writes Clouded Judgement on software metrics.
- Host: [Shawn Wang (swyx)](https://realalpha.app/people/swyx/) · Co-founder, AI Engineer · Wrote “The Rise of the AI Engineer” and founded Smol AI, maker of AI News.
- Show: Latent Space
- Episode: [Why Would Anthropic Go Public Now? — Jamin Ball, Altimeter](https://realalpha.app/v/P735f1xlpL0/), Nov 7, 2026
- Moment: 17:34 to 20:48 of the episode (3 min), playing on https://realalpha.app/s/anthropics-serving-efficiency-rose-sevenfold-in-a-year/; the episode from there: https://realalpha.app/v/P735f1xlpL0/?t=1054

## Quote

> “If you compare the dollar spend in compute a year ago versus today, their compute that went towards serving models has **gone up by 2.3x**.”
> — [Jamin Ball](https://realalpha.app/people/jamin-ball/) at [18:03](https://realalpha.app/v/P735f1xlpL0/?t=1083) · Latent Space

## Takeaways

1. Serving compute spend rose 2.3x year over year.
2. Revenue rose 14x over the same period.
3. Jamin expects margins to fall as Anthropic reinvests in compute.

## About this segment

Jamin Ball compares revenue growth with compute spending on serving models and finds a roughly sevenfold efficiency gain. He says that helps explain Anthropic’s early profitability.

From “Why Would Anthropic Go Public Now? — Jamin Ball, Altimeter”, Nov 7, 2026. [Watch the full episode](https://realalpha.app/v/P735f1xlpL0/)

## Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

[17:38](https://realalpha.app/v/P735f1xlpL0/?t=1058) It's a little small. Yeah, exactly. All right, here's a chart, and this is broken down in the rest of one, that shows the percent of their compute that goes towards basically serving models. So inference, revenue generating, or internal R&D kind of training, or maybe safety and alignment, or, you know, non-serving of tokens. And what's interesting is you can see now that, I mean, they're at 27%, only 27% of their compute today is going towards serving models.

[18:06](https://realalpha.app/v/P735f1xlpL0/?t=1086) Here's why this is so interesting. If you compare the dollar spend in compute a year ago versus today, their compute that went towards serving models has gone up by 2.3x. Their revenue over the same period of time has gone up 14x. So embedded in that is basically a 7x efficiency gain in serving inference, which, I mean, this is a business that I think is almost accidentally profitable, right? Where, I mean, a 7x increase in efficiency of serving tokens, if you were if you were monetizing, you know, a megawatt at 10, 15 million dollars, now you're monetizing it at 70 to 100 million dollars. And here's, this is a little bit of like a random rant, but software companies have historically told the world and told investors, hey, we're an annuity of cash flows.

[18:57](https://realalpha.app/v/P735f1xlpL0/?t=1137) Once we acquire a customer, our net retention's high and they'll stick with us. Customer lifetime value. Exactly. And we're going to be burning a lot of money early on, but we're just in growth mode we're in customer acquisition mode once we exit growth mode we'll be more in harvest mode and that's when we'll start to become we'll flip profitable um because we're not spending a lot of money on on um on customer acquisition costs but you know the general model of a sas company was unprofitable over time then profitable what's happened with anthropic and let me pull up another chart here um i believe i have their uh here are their free cash flow margins oh my god It's so negative.

[19:34](https://realalpha.app/v/P735f1xlpL0/?t=1174) Which I had to cut the chart, right? Like negative 4,000%, negative 1,500%, super, super negative. If I actually drew the axis to scale, it wouldn't look real. And so yes, the axis is broken. But this is the free cashflow margin of Anthropic, right? 21% free cashflow margin in their most recent quarter. And so what you're seeing is a business that all of a sudden, because they were able to drive such efficiency in their compute, That's kind of why I went on that compute ramble.

[20:05](https://realalpha.app/v/P735f1xlpL0/?t=1205) They've been able to monetize at much higher rates and actually deliver positive free cash flow margins pretty early on. And so this is a business that says, hey, we've proven that we can operate highly profitably. What we've probably done is underinvested in compute and compute build out, and we need to be more aggressive on it. And so my guess is that you're actually going to see this level off and maybe go negative again as they say, hey, we're going to reinvest and we're going to invest in a lot of compute.

[20:29](https://realalpha.app/v/P735f1xlpL0/?t=1229) We're going to build out a lot of compute. because now they've shown themselves and the world, hey, if we need to, we can flip the switch and be profitable. And for listeners, a couple of things on the accounting side just because we got to educate people, right?
