The alpha, twice a week
That was 3 min.
Get the best new moments in your inbox every Wednesday and Saturday. It's free.
Check your inbox
We sent a link to your address. Click it to finish signing up. Not there in a minute? Look in spam.
or
MTS · 3 min · Nov 8, 2026
Model routing depends on explicit business logic
Angela McNeal
Angela McNeal says the hard part of routing models is defining what the business wants to optimize.
The episode’s best minutes
Full analysis- 7:13Model routing depends on explicit business logic3 min
- 25:27AI workflows improve through iteration, not instant automation2 min
- 3 more moments in the full episode
“the actual hard part, the technology behind a router I don't think is as interesting as like the application”
Angela McNealat 8:18 · MTS
Takeaways
- A router's value depends on the rules around it.
- Define what counts as a hard problem before routing.
- Decide whether cost means money, time, or both.
About this segment
Angela McNeal says the hard part of routing models is defining what the business wants to optimize. That logic must be set before a router can make useful choices.
Angela McNeal is CEO and cofounder of Thread AI.
Built Lemma, Thread AI’s orchestration platform for governed AI workflows and agents in mission-critical enterprise operations.
Theo Jaffee, Host · Co-founder & host, MTS
One of the first members of a16z's new media team; earlier hosted the Emergent Ventures-backed Theo Jaffee Podcast.
Sophia Dew, Host · Host, MTS
From “Why Full AI Automation Fails in Production | Angela McNea”, Nov 8, 2026. Watch the full episode
Thanks. We'll look at and fix what's off.
Transcript
Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.
- 7:18
So I'm very curious about what inspired you to write Every Good Decision is an ensemble because we see now, we talk a lot about model routing and how it's very important to have something that can choose what level of model based off of some sort of cost trade-off. And then you zoom out and make the argument that everything has always been this sort of ensemble and not just, like, one model or entity making decisions.
- 7:45
It's, like, whether it's, like, how the judicial system works or whatnot. So, yeah, so I'm curious, how does that connect to Thread AI? Yeah, so we were, again, I was seeing this explosion. conversation around routing, and there are real important conversations to be had, and we're seeing it with our enterprise customers of like, when is it too expensive to use this kind of model, or the latency is too high, or there are like real trade-offs around the specific nodes. And the interesting part to me is that like the actual hard part, the technology behind a router I don't think is as interesting as like the application the hard part is the application around it how the business person or the engineering teams decide what is the logic of who what models do we pick what like what are the things that we're trying to optimize
- 8:45
and then you have to pre-define all of the decisions up front saying like okay well we've decided that this is what a hard problem is. This is the shape of a hard problem is. We've decided what is expensive? How do you define expensive? Is it expensive in time, in people's time, in money? So you have to predefine all of these business and esoteric and abstract things ahead of time before you even get to, cool, now we just need something to help me route between these systems. And so we built our platform so you can build these kinds of routers natively in our product, but we spent a lot of time on those decision gates explicitly on those logic gates because we were seeing like in the real world, those were the actual barriers to putting something in production. Yeah, I see. I want to shout out our sponsor, Lovable. You know, the app you've
- 9:39
been meaning to build, the internal tool, side project, or product you'd otherwise lose a