# Local AI can work offline and route hard tasks to frontier models

Markdown copy of https://realalpha.app/s/local-ai-can-work-offline-and-route-hard-tasks-to-frontier/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Ian Weinberg](https://realalpha.app/people/ian-weinberg/) · Ian Weinberg is an AMD representative.
- Host: [Sophia Dew](https://realalpha.app/people/sophia-dew/) · Host, MTS
- Show: MTS
- Episode: [Local AI Will Take Over Within One Year | Ian Weinberg](https://realalpha.app/v/PJlTf2ACCuY/), Oct 31, 2026
- Moment: 18:49 to 23:12 of the episode (4 min), playing on https://realalpha.app/s/local-ai-can-work-offline-and-route-hard-tasks-to-frontier/; the episode from there: https://realalpha.app/v/PJlTf2ACCuY/?t=1129

## Quote

> “Right now, if I unplugged the internet, which is Wi-Fi here, I didn't have to unplug it in that manner, it would **function exactly the same way**.”
> — [Ian Weinberg](https://realalpha.app/people/ian-weinberg/) at [19:12](https://realalpha.app/v/PJlTf2ACCuY/?t=1152) · MTS

## Takeaways

1. Local AI can keep working without an internet connection.
2. Small businesses are exploring sandboxed local deployments.
3. A demo routed 70% of office tasks locally and 30% to frontier models.

## About this segment

Ian Weinberg describes offline use, business interest in sandboxed AI, and a router that sends many office tasks to local models. Local and frontier AI can work together while reducing token costs.

From “Local AI Will Take Over Within One Year | Ian Weinberg”, Oct 31, 2026. [Watch the full episode](https://realalpha.app/v/PJlTf2ACCuY/)

## Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

[18:52](https://realalpha.app/v/PJlTf2ACCuY/?t=1132) I am interested to see, though, who do you think your target customer is? Are you seeing enterprises who want this for sovereign AI? Are you seeing just the indie developers and hackers who just want to experiment with different hardware? What are you seeing? Yes. I'm so glad you asked that question. I actually came up in the security world. When you say sovereign AI, this is right up my alley, right?

[19:14](https://realalpha.app/v/PJlTf2ACCuY/?t=1154) The idea that you can unplug. Right now, if I unplugged the internet, which is Wi-Fi here, I didn't have to unplug it in that manner, it would function exactly the same way. You can vibe code on an airplane. You can 100% vibe code on the airplane. I have done this. With no star link. That's the important piece. No star link, yes. That's exactly the target. So the idea here is community of the interested.

[19:39](https://realalpha.app/v/PJlTf2ACCuY/?t=1179) So from the developers who are going to get in to try to figure out the edges of local AI to many small and medium-sized businesses that are trying to answer the question, what What if I do this locally? What if I sandbox it off and I just have people access via this? We're seeing all of those use cases exploding. And the questions around sovereign AI are just really interesting. questions. It's just such an interesting time to be alive in that space. So yes to all. And the message here is that if you are looking for a standalone platform that has high capability, that has a real good balance of compute across CPU, GPU, and NPU, and has that memory signature, then we take the constraints off about being able to use very complex models.

[20:24](https://realalpha.app/v/PJlTf2ACCuY/?t=1224) Yeah, no, that's pretty exciting. If you had to guess a little bit in terms of the market size, is where are we right now on how this market is growing? Oh, okay. So I'm a lab geek who makes demos. So you're asking the wrong person. But what I will say is this. The level of interest, if I measure it the way that I can measure it. Yeah, anecdotally, like what you're hearing from the developers themselves kind of thing.

[20:48](https://realalpha.app/v/PJlTf2ACCuY/?t=1248) Yeah, for sure. So I was at Advancing AI. But if I measure CES last year to CES this past year to what we imagine was CES two years ago this past year to the next year, the levels of question and skepticism. So two years ago, if we were talking about local AI, there'd be a lot of skeptics coming up and saying, I don't believe this. Last year, there was engagement asking, how do I get this? Now the question is, how do I get more of these? So the barriers of interest, the barriers to interest are gone. And what I'm hearing now is just people doing amazing stuff with local AI? No, I mean, I can't agree more in the past year. I would actually argue in the past few months, not even the past year, like from July to now, the conversations around local AI, the conversations around wanting to own your data, own your sovereignty, just whatever it might be,

[21:38](https://realalpha.app/v/PJlTf2ACCuY/?t=1298) you're seeing a huge influx of it. I'm actually seeing it globally, a huge rise, not just in the United States. I would actually argue maybe in the United States, of course, it's a conversation, but amongst the everyday customer, they're not worried that they'll maybe lose access to some frontier models very much my european friends are kind of worried and so they want all these things at home just in the case that one day they lose access to these models or they're ultimately restricted they want to make sure that they own their intelligence and that no matter what they always have intelligence they can just plug into that that is a global political interesting question but but but what i will say this is i think what you've pointed at is balance yeah and the the really neat thing about using local AI and using frontier

[22:22](https://realalpha.app/v/PJlTf2ACCuY/?t=1342) models because by the way it's not it's not or it's and it's 100% and right there's a whole bunch of stuff it's not or it's and that's a great way to word it it is and right and in our AMD lemonade software there is a semantic router built into it too that you can configure and it can make decisions I can tell you a few of the demos that we built at the advancing AI period when And we pointed complex reasoning tasks on it.

[22:46](https://realalpha.app/v/PJlTf2ACCuY/?t=1366) In this case, it was a general office tasks. It diverged 70% of them locally. Yeah, yeah. But those 30% really did need to go to Frontier. 100%. But that is an important distinction that 70% of it could be done locally. So imagine what happens then when all you have to do is your local compute can pay for 70% of your tasks. Super interesting what that might mean for that user, especially when it comes to their token costs.