# Software 3.0 makes some apps unnecessary

Markdown copy of https://realalpha.app/s/software-3-0-makes-some-apps-unnecessary/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Andrej Karpathy](https://realalpha.app/builders/andrej-karpathy/) · Andrej Karpathy is co-founder of OpenAI, former head of AI at Tesla, and founder of Eureka Labs. · Joined Anthropic's pretraining team; founded Eureka Labs, an AI-native school, after leading Tesla's Autopilot AI.
- Host: Stephanie Zhan · Partner, Sequoia
- Show: Training Data
- Episode: [Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan](https://realalpha.app/v/96jN2OCOfLs/), Apr 29, 2026
- Moment: 2:24 to 7:37 of the episode (5 min), playing on https://realalpha.app/s/software-3-0-makes-some-apps-unnecessary/; the episode from there: https://realalpha.app/v/96jN2OCOfLs/?t=144

## Quote

> “your programming now turns to prompting. And what's in the **context window is your lever** over the interpreter”
> — [Andrej Karpathy](https://realalpha.app/builders/andrej-karpathy/) at [3:19](https://realalpha.app/v/96jN2OCOfLs/?t=199) · Training Data

## Takeaways

1. In Software 3.0, context is a lever for directing the model.
2. An agent can install software by adapting instructions to its environment.
3. Some tasks need a prompt and a model, not an app in between.

## About this segment

Andrej Karpathy explains how prompts and context can replace traditional code, using an agent installer and a menu app as examples. The shift opens up ways to process information that software couldn't handle before.

From “Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan”, Apr 29, 2026. [Watch the full episode](https://realalpha.app/v/96jN2OCOfLs/)

## Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

[2:28](https://realalpha.app/v/96jN2OCOfLs/?t=148) You've talked a lot about this idea. of LLMs as a new computer. That it isn't just better software, it's a whole new computing paradigm. And software 1.0 was explicit rules, software 2.0 was learned weights, software 3.0 is this. If that's actually true, what does a team build differently the day they actually believe this? Right, so yeah, exactly. So software 1.0, I'm writing code. Software 2.0, I'm actually programming by creating data sets and training neural networks.

[3:00](https://realalpha.app/v/96jN2OCOfLs/?t=180) So the programming is kind of like arranging data sets and maybe some objectives and neural network architectures. And then what happened is that basically, if you train one of these GPT models or LLMs on a sufficiently large set of tasks, basically implicitly, because by training on the internet, you have to multitask all the things that are in the data set. These actually become kind of like a programmable computer in a certain sense.

[3:20](https://realalpha.app/v/96jN2OCOfLs/?t=200) So software 3.0 is kind of about, you know, your programming now turns to prompting. And what's in the context window is your lever over the interpreter, that is the LLM, that is kind of like interpreting your context and performing computation in the digital information space. So I guess, yeah, that's kind of the transition. And I think there's a few examples of that really drove it home for me, and maybe that might be instructive.

[3:43](https://realalpha.app/v/96jN2OCOfLs/?t=223) So, for example, when OpenClaw came out, when you want to install OpenClaw, you would expect that normally this is a bash script, like a shell script. So run the shell script to install OpenClaw. But the thing is that in order to target lots of different platforms and lots of different types of computers you might run in OpenClaw, these shell scripts usually balloon up and become extremely complex.

[4:04](https://realalpha.app/v/96jN2OCOfLs/?t=244) But the thing is you're still stuck in a software 1.0 universe of wanting to write the code. And actually the OpenClaw installation is a copy-paste of a bunch of text that you're supposed to give to your agent. So basically it's a little skill of copy-paste this and give it to your agent and it will install OpenClaw. And the reason this is a lot more powerful is you're working now in the software 3.0 paradigm where you don't have to Precisely spell out, you know all the individual details of that setup The agent has its own intelligence that it packages up and then it kind of follows the instructions and it looks at your Environment your computer and it kind of like performs intelligent actions to make things work and debug things in the loop And it's just like so much more powerful, right?

[4:42](https://realalpha.app/v/96jN2OCOfLs/?t=282) So I think that's a very different kind of like way of thinking about it It's just like what is the piece of text to copy paste to your agent? That's the programming paradigm now I think one more maybe example that comes to mind that is even more extreme than that is when I was building Menugen. So Menugen is this idea where you... You come to a restaurant, they give you a menu, there's no pictures usually, so I don't know what any of these things are. Usually, like 30% of the things, I have no idea what they are, 50%.

[5:08](https://realalpha.app/v/96jN2OCOfLs/?t=308) So I wanted to take a photo of the restaurant menu and to get pictures of what those things might look like in a generic sense. And so I built, I bytecoded this app that basically lets you upload a photo, and it does all this stuff, and it runs on Vercel, and it basically re-renders the menu, and it gives you like all the items, and it gives you a picture that it uses an image, you know, generator four, to basically OCR all the different titles, use the image generator to get pictures of them, and then shows it to you. And then I saw the software 3.0 version of this, which is, which blew my mind, which is literally just take your photo, give it to Gemini, and say, use NanoBanana to overlay the things onto the menu. And NanoBanana basically returned an image that is exactly the picture of the menu that I took, but it actually put

[5:55](https://realalpha.app/v/96jN2OCOfLs/?t=355) into the pixels, it rendered the different things in the menu. And this blew my mind, because actually all of my menu gen is spurious, it's working in the old paradigm, that app shouldn't exist. And yeah, the software 3.0 paradigm is a lot more kind of raw, it just, your neural network is doing more and more of the work, and your prompt or context is just the image, and the output is an image, and there's no need to have any of the app in between.

[6:21](https://realalpha.app/v/96jN2OCOfLs/?t=381) mean. So I think that people have to kind of like reframe, you know, not to work in the existing paradigm of what things existed and just think about it as a speed up of what exists. It's actually like new things are available now. And going back to your programming question, it's not even, I think that's also an example of working in the old mindset because it's not just about programming and programming becoming faster. This is more general information processing that is automatable now. So it's not just even about code. So previous code worked over kind of like structured data, right?

[6:52](https://realalpha.app/v/96jN2OCOfLs/?t=412) And you write code over structured data. But like for example, with my LLM Knowledge Bases project, basically you get LLMs to create wikis for your organization or for you in person, et cetera. This is not even a program. This is not something that could exist before because there was no code that would create a knowledge base based on a bunch of facts. But now you can just take these documents and basically recompile them in a different way and reorder them and create something that is new and interesting as a reframing of the data.

[7:19](https://realalpha.app/v/96jN2OCOfLs/?t=439) And so these are new things that weren't possible. And so I think this is something that I keep trying to get back to as to not only what can we do that existed that is fact. But I think there's new opportunities of just things that couldn't be possible before. And I almost think that that's more exciting.