The alpha, twice a week
That was 3 min.
Get the best new moments in your inbox every Wednesday and Saturday. It's free.
Check your inbox
We sent a link to your address. Click it to finish signing up. Not there in a minute? Look in spam.
or
Unsupervised Learning · 3 min · Nov 2, 2026
Agent reliability may matter more than model size
Danila Shtan sees more leverage in agent reliability than simply scaling models, with internal work on tools and task-specific harnesses.
In this episode
Full episode- 39:13Chip scarcity gave AI clouds room to competePro pick 5 min
- 25:05Open-model inference still has major room to improvePro pick 3 min
- 53:19Nebius lets engineers use AI but keeps accountability human3 min
- 15:36AI customers need shared storage built for extreme throughput4 min
- 10:12New Nvidia chips require constant iteration before launch5 min
- 21:47Prefill/decode disaggregation remains a case-by-case tool3 min
- 34:25Execution capacity is the bottleneck across AI infrastructure3 min
- 57:53Agent reliability may matter more than model size3 min
“I think a lot of future AI adoption lies in how reliable your agentic scenarios are and how reliably you reach those outcomes.”
Takeaways
- He treats larger, smarter models as a given.
- Tools and harnesses can improve task success beyond model changes.
- Long-running agents can consume CPU without constant LLM calls.
About this segment
Danila Shtan sees more leverage in agent reliability than simply scaling models, with internal work on tools and task-specific harnesses. He expects outcome optimization to shape infrastructure demand.
Danila Shtan is CTO of Nebius.

Jacob Effron, Host · AI Investor, Redpoint Ventures
Growth investor in Abridge, Ramp and Physical Intelligence; ex-Flatiron Health.
From “The Window Before AWS Wakes Up: Nebius CTO on Racing the Hyperscalers”, Nov 2, 2026. Watch the full episode
Thanks. We'll look at and fix what's off.
Transcript
Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.
- 57:57
Well, I stopped caring about the new models being larger or smarter. I just accepted that it's a given. I'm kind of trying to look out for new novel architectures and approaches, but I don't see any as of today. I hope somewhere deep down in a stealth lab, something new is cooking but for now i frankly don't see anything that like is a thing that i would be even like would place even a small bet on but i'm more and more interested in the whole outcome optimization part on the agent side right because like we are used to talking about models and size of models and families of models, et cetera, et cetera, et cetera.
- 58:51
But now that we've shifted to this multi-turn, long-running agents that we are talking not about requests, but rather outcomes, companies are talking about bidding per outcome, right? I'm very interested in how that part will shape up. And we have like a small research group internally with the neighbors that's working on this problem, actually. is like, how do you increase the chances of getting to that outcome?
- 59:18
Not by increasing the model or changing the model. That is, of course, part of the discussion. But I believe there is a lot of optimization in the part where you introduce more sophisticated or maybe more simplified tools. You introduce the harnesses that start to evolve according to a particular task. And this kind of gets us back to significant CPU consumption because a lot of modern AI workloads actually go back to becoming code.
- 59:49
It's codified, it's very formal. You see quality gates, you see sophisticated tools, et cetera, et cetera, et cetera. And sometimes your agent works for mince and mince and mince. without even issuing a backend request to an LLM because the workloads start to sit on this part. And this is the part that really interests me because I think a lot of future AI adoption lies in how reliable your agentic scenarios are and how reliably you reach those outcomes.
- 1:00:22
And I think the whole optimization loop outside the model is an important part of that. 100%. Well, this has been an awesome conversation. Really appreciate you coming on the show. And yeah, thanks so much for coming on. Thank you for having me.