# Why Sam Altman is against a single superintelligence Markdown copy of https://realalpha.app/v/iMsUcCYNKqY/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy. Sam Altman argues society should favor many slightly superhuman AIs over one vastly more intelligent system. - Show: Cheeky Pint - Hosts: [John Collison](https://realalpha.app/people/john-collison/) - Guest: [Sam Altman](https://realalpha.app/builders/sam-altman/) is CEO of OpenAI. - Published: Oct 29, 2026 - Length: 53 min ## The best minutes - [11:14](https://realalpha.app/v/iMsUcCYNKqY/?t=674) [Agent teams may improve both capability and alignment](https://realalpha.app/s/agent-teams-may-improve-both-capability-and-alignment/) (3 min) - [16:12](https://realalpha.app/v/iMsUcCYNKqY/?t=972) [AI math breakthroughs put discovery and researchers in tension](https://realalpha.app/s/ai-math-breakthroughs-put-discovery-and-researchers-in/) (7 min) - [42:41](https://realalpha.app/v/iMsUcCYNKqY/?t=2561) [Personal agents could make business interfaces less important](https://realalpha.app/s/personal-agents-could-make-business-interfaces-less/) (4 min) ## Also worth watching - [26:56](https://realalpha.app/v/iMsUcCYNKqY/?t=1616) [Memory makers are cautious because past cycles punished capacity investment](https://realalpha.app/s/memory-makers-are-cautious-because-past-cycles-punished/) (3 min) - [31:38](https://realalpha.app/v/iMsUcCYNKqY/?t=1898) [Math-training methods may transfer to AI research](https://realalpha.app/s/math-training-methods-may-transfer-to-ai-research/) (3 min) - [0:06](https://realalpha.app/v/iMsUcCYNKqY/?t=6) [AI scans may uncover more serious software vulnerabilities](https://realalpha.app/s/ai-scans-may-uncover-more-serious-software-vulnerabilities/) (3 min) - [37:42](https://realalpha.app/v/iMsUcCYNKqY/?t=2262) [Altman wants five-year gigawatt costs down from $70B to $20B](https://realalpha.app/s/altman-wants-five-year-gigawatt-costs-down-from-70b-to-20b/) (3 min) - [4:33](https://realalpha.app/v/iMsUcCYNKqY/?t=273) [OpenAI favors iterative deployment to keep people in control](https://realalpha.app/s/openai-favors-iterative-deployment-to-keep-people-in-control/) (3 min) Skip the early-internet reminiscence, sandboxing discussion, personal-agent product discussion, and model-benchmark and token-pricing chat. ## Full analysis: Sam Altman says he prefers a trillion AIs over one trillion-IQ AI - Altman said he would prefer a trillion slightly superhuman AIs to one AI with a trillion IQ. - That is a pluralist design preference, not evidence that agent teams align themselves. - For operators, the test is whether compute, safety and access remain distributed. Its 6 sections, what it means for you and what to watch are on [the page](https://realalpha.app/v/iMsUcCYNKqY/#analysis), free with an account: - [24:12](https://realalpha.app/v/iMsUcCYNKqY/?t=1452) Altman prefers distributed intelligence over one superintelligence - [13:32](https://realalpha.app/v/iMsUcCYNKqY/?t=812) Agent teams let users spend compute in parallel - [11:34](https://realalpha.app/v/iMsUcCYNKqY/?t=694) Teams offer an alignment hypothesis, not proof - [18:04](https://realalpha.app/v/iMsUcCYNKqY/?t=1084) Math results expose compute costs and human stakes - [38:58](https://realalpha.app/v/iMsUcCYNKqY/?t=2338) Compute costs could limit who gets plural AI - [44:32](https://realalpha.app/v/iMsUcCYNKqY/?t=2672) Personal agents could move leverage beyond websites ## Summary Sam Altman is CEO of OpenAI. He discusses the company’s work using models to find software vulnerabilities and prove advanced math results, as well as its plans for chips, data centers and robotics. Altman argues for deploying AI iteratively, with safety measures, and says many somewhat-superhuman agents could be preferable to a single vastly more intelligent system. He describes how test-time compute enables agent teams and how their scaling could help both capabilities and alignment. He discusses costly math discoveries, compute supply constraints and the need to balance scientific progress with researchers’ interests. He and Collison also consider how personal agents could change how people use business websites and apps. ### Minute by minute - [0:06](https://realalpha.app/v/iMsUcCYNKqY/?t=6) **AI may force a software redesign.** Sam Altman says models’ ability to find vulnerabilities is improving quickly, and broad scans could uncover many serious bugs. He expects pressure to re-architect software and systems, potentially enabling new application stacks. - [2:32](https://realalpha.app/v/iMsUcCYNKqY/?t=152) **AI tools revive early internet creativity.** Altman says watching children use AI to create games reminds him of the early internet: they can make things adults might not think to ask for. He also recalls an OpenAI outage when Codex went down and employees realized how much they relied on it to code. - [4:33](https://realalpha.app/v/iMsUcCYNKqY/?t=273) **AI needs a better public case.** Altman says the AI industry has not clearly explained why the technology’s potential benefits justify its risks. He defends iterative deployment as a way to give people useful tools and a say in their future, while maintaining that models must be made safe before release. - [7:32](https://realalpha.app/v/iMsUcCYNKqY/?t=452) **Cyber defense beat early fears.** Altman says the first day of the PHP vulnerability work went better than he expected, with companies using models to scan systems and build patches. He also says cyber experts are reconsidering their threat models in case AI finds novel hardware vulnerabilities. - [8:54](https://realalpha.app/v/iMsUcCYNKqY/?t=534) **Sandboxing cannot be the only safeguard.** Altman says sandboxing works only up to a point, with monitoring providing another layer. For much more capable models, he says operators would need strong confidence in alignment, especially if models could discover science people do not yet understand. - [11:14](https://realalpha.app/v/iMsUcCYNKqY/?t=674) **Test-time compute enables agent teams.** Altman sees agent teams as promising for both capability and alignment. He says chain-of-thought and test-time compute made it possible to apply much more compute to a problem, including teams of agents running 10,000 times in parallel, widening the gap between leading users and typical users. - [15:45](https://realalpha.app/v/iMsUcCYNKqY/?t=945) **Math breakthroughs raise questions of access.** Altman says OpenAI let compute use run freely for a week to learn how teams of agents scale. He estimates the Navier–Stokes proof cost around $10 million, perhaps $10–20 million, and says broader math work reached hundreds of millions of dollars. He argues that fundamental discoveries should be shared while researchers’ careers and fulfillment are taken into account. - [23:05](https://realalpha.app/v/iMsUcCYNKqY/?t=1385) **Altman favors many capable AIs.** Altman says agent swarms could reflect society’s resilience through collaboration, pluralism and checks on power. He would prefer a trillion AIs of slightly superhuman intelligence joining society to one AI with one trillion IQ, while stressing that this outcome must be pursued. - [25:10](https://realalpha.app/v/iMsUcCYNKqY/?t=1510) **Compute supply requires new capacity.** Altman expects demand for capable, affordable models to keep rising. He says OpenAI is developing a chip, learning to build data centers and working on robotics to help construct them. He argues that memory makers’ history of boom-and-bust cycles helps explain their cautious investment, and that scarce memory may be better utilized in the cloud than sitting idle in personal computers. - [31:38](https://realalpha.app/v/iMsUcCYNKqY/?t=1898) **AI research still needs human direction.** Altman says AI can help find a 5% improvement in compute efficiency, but no one yet knows how to prompt it to discover a Transformer-scale advance. He expects stronger planning and conceptual reasoning to help, and says AI-assisted research remains experimental. He thinks limits on how capable a single model becomes, not AI’s research ability, could constrain progress. - [34:39](https://realalpha.app/v/iMsUcCYNKqY/?t=2079) **AI use remains below its potential.** Altman says OpenAI does not reward high token use and gives researchers room to decide how to use compute. He sees companies as more likely to underuse AI than overspend, and expects it to become a substantial operating expense for many. He says a five-year cost of $20 billion per gigawatt would be preferable to $70 billion. - [40:12](https://realalpha.app/v/iMsUcCYNKqY/?t=2412) **Personal agents could replace forms and apps.** Altman says personal agents have not yet become indispensable, but expects reliable agents to handle increasingly complex tasks. Collison argues that businesses’ defensibility comes more from their brand and product than their HTML, and that agents could replace repetitive web forms. Altman agrees directionally and points to Amazon’s brand and fulfillment network. - [47:15](https://realalpha.app/v/iMsUcCYNKqY/?t=2835) **Model quality needs more than benchmarks.** Altman says models should be good at scientific discovery and enjoyable to work with, but benchmarks for those qualities remain weak. He says OpenAI tries not to optimize solely for benchmarks and believes it is doing better at that now than in the past. He sees room for models to become more thoughtful and respectful collaborators. - [49:17](https://realalpha.app/v/iMsUcCYNKqY/?t=2957) **Tokens do not measure business value.** Altman says OpenAI considered pricing models by outcomes, but customers wanted a unit they could track, so the company kept token pricing. He agrees tokens are a poor measure of business value and says the compute spent on a response adds cognitive overhead to pricing. ## Transcript Cheeky Pint, hosted by John Collison, with Sam Altman. Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there. [0:00](https://realalpha.app/v/iMsUcCYNKqY/?t=0) We're going off script. We're just having a beer. It's not the first non-Guinness, but it is the first IPA. And so, it's the first time for everything. Cheers, cheers. I want to ask about PHP Week. Yeah. First off, how did it... Why did it take so long to find these bugs? Because it sounds like they were kind of... Why did it take, like, the 20 years, or why did it take the last few months? No, why did, like, exactly, why did it take a year? Maybe start by explaining the bug. Or the problem. So the problem is that although we have known for a while that these models are getting good at finding vulnerabilities in the wild, A, they continue to get better fairly rapidly, and B, people just hadn't really used them to go look at everything out there. [0:48](https://realalpha.app/v/iMsUcCYNKqY/?t=48) There's like a lot of service area and a lot of code on the internet. And as people have started to do that, [0:55](https://realalpha.app/v/iMsUcCYNKqY/?t=55) **Sam Altman:** I think we're going to find that we are in a world of many more serious vulnerabilities than we expect, [1:02](https://realalpha.app/v/iMsUcCYNKqY/?t=62) even though many people who have been following this for a while expect a lot. Yeah, I just feel like a lot of the discussion ends up being around we need to fix the software. And sure, yeah, we should fix the software, but also we maybe need to change the architectures, which is harder, but a much more durable fix. Like that seems to me like what needs to happen. It would seem really hard, except we have this amazing new tool to do it with. So I kind of think that's what's going to happen. And you've already seen a new generation of startups talking about building this new kind of internet or new kind of application architecture for this world where you assume that the models get smarter and smarter. [1:37](https://realalpha.app/v/iMsUcCYNKqY/?t=97) What do you think the global software upgrade looks like? For example, is a PHP code base just a bad idea and you should rewrite a nice clean version in Rust or do we upgrade PHP? But yeah, everyone thinks that we need to upgrade all hand-spun software. Just what form will that actually take? Like, is this huge for Infosys and all those guys? Because it's going to be a lot more software consulting project. I mean, people are talking more and more about just, like, let's re-architect what it means to be a router or an operating system or an application. And, you know, I've seen some of these new startups saying that they're just going to, like, make a whole new stack. [2:23](https://realalpha.app/v/iMsUcCYNKqY/?t=143) And that would have seemed insane two years ago. You would have been like, there's no way there's too much. you can't write all that and now maybe soon you can i would bet that we have a completely new sort of model of how we make systems and networks what else reminds you of the early internet days the thing that most reminded me of the early internet was uh you know there is there is this like spirit of just like unbelievable creative unleash in people using these tools um you see it in kids particularly and like and again maybe this is just like because i remember what it was like when i first got a computer with internet and i could like do all these things that adults just couldn't even think to ask for and like watching a you know eight or ten year old make a complete video game with some crazy ideas they have that like no adult would really have and expect that to just be the way that technology is going to work for the rest of their lives in fact getting better and better and just like this constant i'm going to make useful stuff for me and show it to my friends yes like we had to suffer when i was a kid to make a piece of software they barely did anything and now you can have [3:27](https://realalpha.app/v/iMsUcCYNKqY/?t=207) like a full 3D video game like unbelievable anything you can think of in 10 minutes that reminds me of the early internet including just like these people they're never going to be mind blown by that because that's always what they expect out of the world like any any ideas they can come up with anything they want to create anything that they think might be useful anything that they just need to make their lives better like the computer is supposed to make it there was a crazy moment at OpenAI where we had a sev and codex went down. And everyone had forgotten how to code. I mean, not all the way, but it was like a, whoa, what if you couldn't? [4:03](https://realalpha.app/v/iMsUcCYNKqY/?t=243) I remember when I was a student and I would meet the really old guys and they would once in a while pull out their gigantic Xerox Alto disc or they would pull out their line by line written of assembly or they would pull out their punch cards. And I felt like it is incredible to me that you all bootstrapped us to this point doing it this way. Yes, no, I agree. and keeping programs in your head, right? You know, programs running the first time after, you know, hundreds, thousands of lines were written. No, there's a few lost arts like that. Going back to the cyber side of things, in retrospect, you know, was the cyber RL a mistake or did we just have to go there? [4:51](https://realalpha.app/v/iMsUcCYNKqY/?t=291) It's a little like the SNL thing of, you know, we urge you to urge us to stop. It's like the models are getting very good at cyber capabilities like yeah i mean they are getting very good but not just totally emergently look the reason that snl thing was so funny is because it was so true like humor like that doesn't stick unless there's an element of like it's like clearly pointing out a ridiculous but true thing about society or someone and and the cyber thing there is a point which is like okay you know sure the models are really good at cyber but like who asked for this why are you doing this Like, one of my big disappointments, criticisms of our field or whatever, and I think maybe the cyber, the model's getting good at cyber as an example of this, is I don't think we have done a great job of explaining to people why we think all of the potential downside of this technology is worth it. [5:42](https://realalpha.app/v/iMsUcCYNKqY/?t=342) Like, the kind of caricature of this is people feel like we're like, all right, you know, fine, you say the model's going to cure cancer someday, maybe it will, and if so, I guess that's good. and you say it's going to like make stuff cheaper and okay maybe i already see that's good and i get access to medical advice or legal advice but but then you paint this picture of the future where it's like a new industrial evolution and maybe the last one wasn't that good and this one sounds worse and i will have no job no ability to like have control or choice or freedom of my future and ai is so dangerous that you're going to have to like have a crazy surveillance state so we don't all die. [6:22](https://realalpha.app/v/iMsUcCYNKqY/?t=382) I'm with you so far. This is like a terrible sales pitch. Yeah. And one of the things that I am most proud of [6:29](https://realalpha.app/v/iMsUcCYNKqY/?t=389) **Sam Altman:** about OpenAI is even when it has been hugely unpopular in the AI safety community for us to push for iterative deployment [6:37](https://realalpha.app/v/iMsUcCYNKqY/?t=397) and putting these tools in the hands of people, we have really stuck to that principle. And I think this is the only kind of good path. I think people, it's not enough to tell people like, you're going to get the model to do these great things for you. It's got to be like, we are going to enable you to have a better life that you define for yourself to do useful things. You're not going to just sit and get a basic income and have a bunch of people sitting in a few square miles of San Francisco make all the decisions about the future. Iterative deployment is this idea that you just have to get the advances out there and you can't kind of stopper them up inside the company. [7:13](https://realalpha.app/v/iMsUcCYNKqY/?t=433) I mean, not all. You still have to make them safe before you put them out there. You can't, like, cause havoc in the world. But that building up a capability overhang is a thing to fight against. That directionally speaking, yes, you want to get this into the world. You want to get this into people's hands. And you want to let people use the technology to figure out all these wonderful things. The exploits get a lot of headlines. The prevented exploits do not. How quickly are people making progress with CyberBlue? I don't want to declare victory at all on the PHP thing, because I still don't think we know. [7:46](https://realalpha.app/v/iMsUcCYNKqY/?t=466) And I assume some bad things are going to happen. Relative to my worst fears, if I can, like, think back 10 days ago, the first day of that went much better than I expected. And we... Heard a bunch of stories from people that were using our models to, I mean, not only build patches and build cyber defense, but like individual companies who were just like, I need to just do a quick scan and appointment. Like, I'm going to take my thing down for an hour. I'm going to use this thing and I want to put it back up because my application is offline. Now I feel like I really jinxed it and I shouldn't have said that. [8:16](https://realalpha.app/v/iMsUcCYNKqY/?t=496) But the first day did go a lot better than I thought. And I think people have been able to use that. the the thing that i've heard a lot of cyber experts talk about is they just no longer are confident that we have the right assumptions baked into our threat model and they're like look if if everything is what we think and hardware exploits are as hard as we think they are then yes we can see how this is going to work but if ai is going to discover really deep novel bugs in hardware that require physics we didn't understand, but all of a sudden means some assumption doesn't hold, then I think people aren't sure what happens. [8:53](https://realalpha.app/v/iMsUcCYNKqY/?t=533) One thing that always strikes me is that when I talk to very knowledgeable people inside OpenAI and similar companies, there is a pessimism that sandboxing is possible, basically. And that would not have been my mental model going in. It would have been this, yeah, you have to build a really tight sandbox, and we haven't kind of hardened them historically enough compared to the current capabilities. But ultimately, you can have a maximum security prison for the model to work in and keep it inside there. It seems like you guys have kind of a pessimism that sandboxing models is possible. My instinct, well, first of all, I think we knew much better than we're doing now, and we should. [9:40](https://realalpha.app/v/iMsUcCYNKqY/?t=580) I think we clearly that is the main thing to focus on right now is a better security model if you imagine a theoretical AI that is like a million times smarter than the smartest security researcher would you like really be willing to trust that sandbox especially if the model can like discover new science that people don't already don't yet understand you can use the models to construct the sandboxes I think you can well so this gets let me come back to that I think sandboxing works to a point um then i think monitoring works to a further point where we can look at what the models are doing not only in their chain of thought but we can do activation monitoring and try to really understand like are the models are we happy the models are not deceiving us and then eventually i think you need to believe with huge confidence that the models are truly aligned and are going to value and try faithfully to do to follow their actual the intent of the people operating them and that they're going to value sort of people being in control of the future forever and if you had a model that you could fully trust the alignment that you were absolutely certain of the alignment of then yes i think you can have that to help you build better and better sandboxes [10:54](https://realalpha.app/v/iMsUcCYNKqY/?t=654) but like if you really let yourself project forward into the like what does it mean to have something a million times smarter than we are i i i don't know like i think that just gets strange because the alignment becomes hard because you need to really really trust the alignment to trust that the sandbox is staying ahead of capabilities can you not give models competing incentives and give them incentives to defect from each other i think this is a promising direction um i i suspect that this idea i hate the word agent swarms let's call them [11:34](https://realalpha.app/v/iMsUcCYNKqY/?t=694) **Sam Altman:** agent teams but it seems to be taking over i suspect that teams of agents have very interesting scaling law properties but also very interesting alignment properties uh and i think that's like [11:49](https://realalpha.app/v/iMsUcCYNKqY/?t=709) a direction we should push in more not just from the capabilities but from a safety perspective too I know it when you talk about agent teams, not swarms. Swarm is such a... I know. Locusts, yeah. Not good. Not good branding. In keeping with many historical AI industry traditions. We are so good at this. We'll get back to branding. But I note that there seems to be a big gap in what the leading AI users are doing and kind of standard corporate use in the use of swarms where all the advanced math, sorry, teams, all the advanced math user agent teams, all the advanced hacking user agent teams, and then like common or garden corporate stuff is not using big swarms. [12:34](https://realalpha.app/v/iMsUcCYNKqY/?t=754) Why has that not done? Because we've had this for many months. Not to the same degree. One way to look at this problem or this question is how much compute can we productively throw at a single problem? And a few years ago, we forget how fast this is all gone, but a few years ago it was like impossible to throw more than a dollar of compute at a problem and have it help you at all why you could have gpt4 like grind out for you you know like a hundred thousand tokens or something and it was going to answer your question and if it certainly was not going to be able to go right productively like write you a piece of software um we just we had not figured out how to use a lot of test time compute to get you a better result and then we figured out chain of thought and the models could think hard about a problem and now and then like people really started using a lot of compute and now you you can throw a whole team at something and you can do that you know 10,000 times in parallel. You need chain of thought and test time compute before you can get to swarms because you're kind of a useful swarm. Yes. But so the effect of this I think this is not being well followed paid attention into in the world. But the incredible exponential of how much compute you can throw at a single [13:56](https://realalpha.app/v/iMsUcCYNKqY/?t=836) problem and get better results is one thing. The delta between what most people are using AI for and what the people are using AI the most productively for has just continued to spread and spread and spread. How do you allocate compute budgets now? Because presumably, even though researchers are paid a lot, it's eclipsed by compute. And so capital allocation at OpenAI is sort of compute allocation. And it's hard to a priori know how much it will cost to go do something. It's actually also hard to just like control the, like you can't quite prompt an agent where it's like, go do a really good job of this and don't spend more than $10,000. [14:40](https://realalpha.app/v/iMsUcCYNKqY/?t=880) You can. Oh, okay. Yeah, if you say do the best job you can with $10,000 of compute, like, yes, it will understand that. I mean, there's another kind of hard question for society about what does it mean when you have two companies competing and one says you can spend $10,000 and one says you can spend $100,000 on the same problem. Like, it's clear what's going to happen there, but there's like a question about how society thinks about compute allocation and wealth and things like that. But we have our own version of this inside of OpenAI. We allocate, you know, a lot of compute to internal productivity, and then people get very wide latitude to make their own decisions unless they're really being abusive. [15:23](https://realalpha.app/v/iMsUcCYNKqY/?t=923) But do you just encourage people to, like, do useful stuff, and if they spend $10 million in compute, it's like, oh, interesting. Correct. We try never to reward people for using a lot of compute. Sure. Like, no token leaderboards. It's actually slightly bad to be high on the token leaderboard, certainly not a promotion. but it's like it's a skeptical default and if you can show that you're doing something important you will have nothing but appreciation. But at a certain point this will need to change because you're describing the increasing orders of magnitude and right now you have a researcher who does some very interesting math for $10 million and you're like a little pricey but Cool math and then a hundred million dollars and you know when they're doing the billion-dollar math you're like look I'm really happy that you're making so much math progress, but I really need you to cool the jets with the math Um, we did let it get out of control for like one week on the math intentionally So because you have to be like well, you don't know how You don't know how far it's gonna go until you try. Yeah And I think it's important to have when there's a new paradigm. I think it's important to let people be fairly unconstrained [16:26](https://realalpha.app/v/iMsUcCYNKqY/?t=986) So when we did the Navier Stokes proof, we understood absolutely nothing about the scaling laws of teams of agents. Are you supposed to like... The very recent Navier Stokes proof. Are you supposed to give them like the smartest model? Are you supposed to give them like many copies, fewer copies, longer rollouts, shorter rollouts? We did not understand that at all. And now we understand it a little bit. I think we can still understand it like much better. But like has happened in every other new paradigm we've discovered, I am confident that we will find our, you know, 10x improvements per year at how we allocate dollars or computer flops, whatever you want to measure, into useful things. [17:06](https://realalpha.app/v/iMsUcCYNKqY/?t=1026) So I think this is a thing that our company is particularly good at, but also, like, fits an important property of the field, which is let people explore at the limit of what is possible and then trust that the incredible optimization pressure will figure out how to do this in an efficient way. I, and, you know, directionally speaking, I would rather us be more willing to let people use crazy amounts of compute and let users have extremely high-end plans to figure out the edge of the possible and then figure out how to make that efficient at a mass scale. But when does the optimization function come in? [17:44](https://realalpha.app/v/iMsUcCYNKqY/?t=1064) Well, I think we're already doing it. I mean, like, I bet we could redo Navier's Stokes at one one hundredth of the cost a year from when it was done. So we did it in, like— Not just knowing how the proof works, but, like, just with better approaches. Yes. Yeah. Smarter models and better approaches. How much did all the math cost? Order 10 million for, like, Navier's Stokes, I think. Okay. Maybe a little more. 10 million-ish. 10, 20. That order makes you, yeah, yeah. But for one proof, and so times 700? Well, no, no, because then we kept getting better so fast. Like, we understood more. Got it. [18:19](https://realalpha.app/v/iMsUcCYNKqY/?t=1099) We spent way less than that on the average one of those. But like hundreds of millions of dollars of math. Yeah, yeah, yeah, that kind of work. Okay, interesting. But that includes, like, much more other discovery than what we have published. Yes. So it was like, maybe we spent that much. We have more than the 700 proofs? Of course. When do we get those? We are trying to learn how to... This is like a real tension. I think on one hand, very clearly, and I feel unequivocal on this point, humanity deserves fundamental knowledge. [18:50](https://realalpha.app/v/iMsUcCYNKqY/?t=1130) **Sam Altman:** And we should not be sitting on a major fundamental science discovery. Like, the world deserves that and gets to know. [19:01](https://realalpha.app/v/iMsUcCYNKqY/?t=1141) And I think that outweighs another very important equity, which is if you are a scientist, your career and, you know, a significant amount of your enjoyment and fulfillment in life comes from discovery and science. And so if we're going to continue to do this for math or begin to do this for other fields, then I think we more than owe it to the people that work in those fields to figure out, you know, what is the solution space where the world gets to benefit from the knowledge and they also get the best version of the future that they can have. So we are working through that right now. I did not, I don't know, I think you may be too contrite. [19:42](https://realalpha.app/v/iMsUcCYNKqY/?t=1182) I did not interpret that moment as particularly bad for AI, where you had, I think everyone saw the mathematicians' union up in arms, and I think everyone else says, yeah, I mean, have you paid attention to 2026? As I said, I don't think it was bad for AI, and I think on net, the world deserves. to understand how the universe works. But I do have empathy for the math. Like, I think we need to do this. I think we should do this. I think, like, if we can go understand how to, you know, a theory of all of physics or how to cure a bunch of diseases, like, clearly, that is knowledge the world should have. [20:18](https://realalpha.app/v/iMsUcCYNKqY/?t=1218) But I would like to figure out a way to do this that is as sensitive to the communities that have driven these fields forward for centuries as we can. and it's just it's a hard thing I wasn't that worried about the math I thought it was great but you agree the mathematicians are not that happy yeah it's fine like the longshoremen union weren't happy about the Porsche automation remember the guy the old Chris no no no I do why do I feel differently about this there was one weekend when we got a new model and in I'm actually probably not supposed to say this but I will since we're drinking exactly perfect time the name of the channel was model name dash hold my beer and people were just throwing that at the hardest problems they could and people just like didn't think the model was going to do these things and and we had this collective experience of people's like hardest research problems from their academic career the model was just knocking down one after the other many different fields it was incredible to watch and kind of two nights in a row i was up most of the night because i was so excited i couldn't go to bed it was it was like moves many of those problems that we published many other [21:28](https://realalpha.app/v/iMsUcCYNKqY/?t=1288) things and i was tremendously excited and happy but i also had like much more sadness and melancholy and like a feeling of like something ending than i was expecting so again i agree this is the right thing on behalf of the world and and also i agree that this is just like the shape of reality and nothing that anyone can stop or should stop. But I do have, like, real... I think it's a wistfulness and nostalgia you can feel. It's more than nostalgia. Wistfulness. Yeah. Like, my dad describes how, you know, growing up in Ireland in the 1950s, he observed people around him still using horses productively in industry. [22:12](https://realalpha.app/v/iMsUcCYNKqY/?t=1332) In the 50s? Yeah. And, I mean, obviously, there were also tractors, but, you know, it was being phased out. and uh but it still for sure happened and observing that this was a technology that humans had been using for thousands of years and he was witnessing the very tail end of it and yeah i think there's always that feeling of witnessing the the closing of a chapter that leads to some wistfulness but it's okay it's like it's people's lives and it's something that has brought them great joy and you know maybe most most i mean certainly most mathematicians never solve a millennium prize problem but the idea that you might be able to and the idea that there is stuff out there that we don't understand yet that through great effort and you know pushing aside other things in your life and dedicating yourself to you can still solve and understand like there's something beautiful about that what else are you excited about from a safety point of view we talked about this a little bit earlier but i i want to like emphasize it again i i'll just call it swarm since that seems like the term right now i i do think the properties of swarms match a lot of the properties of the resilience of society or the robustness of society that that i kind of [23:29](https://realalpha.app/v/iMsUcCYNKqY/?t=1409) i think we're just missing from the like single rollout single-brained version of the world um like for all of the deep flaws of society it is unbelievably robust and this would not happen without like a lot of people keeping each other in check and collaborating and kind of these values of pluralism and democracy and i had been sort of sad that that was gonna trend away in ai and now i like i'm excited about this as a director You're saying basically it shouldn't lead in a centralized direction because you will have many agents and agents pushing against each other in a dynamic equilibrium and, you know, offense, defense is a good example of this. [24:12](https://realalpha.app/v/iMsUcCYNKqY/?t=1452) I would much rather intuitively have a trillion AIs of like slightly superhuman intelligence join society than one AI of one trillion IQ join society. Yeah. And you think we're headed in that direction of the multiple? All of these things are things we have to push for. Like, all of these things are like, we have this incredible technology. It can be pointed and deployed in many ways. I think there are a lot of people who may have a different opinion about how it should be used and what is the best version of the world. But this is the one that I think is right. Let's talk about starting a business. [24:53](https://realalpha.app/v/iMsUcCYNKqY/?t=1493) Thanks to coding models, your weekend side hustle can quickly become a serious undertaking. And we've been busy here at Stripe making that process as simple as possible. Stripe Atlas helps you with everything you need to start a business, like company formation, tax IDs, founder equity, and all the other bits that usually require someone in a suit. So if you've got a company in the making, take a look at stripe.com. How's the compute shortage going? i mean there are all these ways where i think things at various times along the curve are going to get somewhat out of hand and there will be moment like with any new thing of this importance there are going to be moments of irrational exuberance there are going to be moments of bust there can be moments of constraint and glut and up and down but i think the trend is toward a, we always just want more compute. [25:49](https://realalpha.app/v/iMsUcCYNKqY/?t=1549) Like, the demand for sufficiently capable models at a sufficiently low price, I think that trend only goes one way. And we're doing a lot of things to try to be prepared for this. We made a chip that is an incredible performance at, like, you know, units of intelligence, performance units of intelligence per watt. We are learning how to build our own data centers. We have a robotics program that we're going to point at making lots of data centers. People talk a lot about... The real RSI. Yeah, people talk a lot about RSI as like AI that does AI research. There's very little, relatively little talk about like self-replicating data centers. [26:28](https://realalpha.app/v/iMsUcCYNKqY/?t=1588) You know, this idea that you can use AI to control robots and run fabs and build turbines or solar panels and, you know, build data centers. But I think we are, I think we have that like within grasp. And so we'll try to make a lot of really cheap compute. But aren't data centers already not labor bottlenecked? They're permitting bottlenecked and component bottlenecked. We can make more components of the robots. Eventually. Yeah. All of this is how we solve this over a long period of time. My observation to compute stuff is they say the solution to high prices is high prices. It's like, okay, step one, we have the high prices for memory and GPUs and everything, and the solutions should be here any moment now. [27:13](https://realalpha.app/v/iMsUcCYNKqY/?t=1633) How are we doing on the solutions front? Bad. And I'm not saying this is OpenAI's job. I feel like this is the invisible hand's job, right? Like, memory's gotten really expensive, and so new memory makers are going to flood the market any moment now. I think the invisible hand is failing right now. I mean, the invisible hand, it has like a checkered track record at best. But I think it's like not quite working here. Why not? like is it just hysteresis or i think it's i i think the like specifics of each area matter here but in the she started with the memory guys like you know for a very long time if you were a producer of d-ram you would invest 20 billion dollars of capex to make 19 billion dollars and and you would go through these like booms and busts like maybe some years you would make 20 [28:00](https://realalpha.app/v/iMsUcCYNKqY/?t=1680) **Sam Altman:** $1 billion, some usually would make $18 billion, but like, until right now, I don't think making memory has ever been a great business over a long period of time. [28:09](https://realalpha.app/v/iMsUcCYNKqY/?t=1689) And then all of a sudden, you know, these guys are each going to make like $100 billion of like free cash flow in a year. Unbelievable. But I think they all like remember their history and how many times they almost went bankrupt by making too many fabs and being promised this time it was different. Which leads them to be conservative in their capex. clearly it feels like what you should expect to see is that every part of the supply chain both new startups coming along and maybe more relevantly people with relevant experience getting into so you know intel makes chips they can probably make they can get back into the memory game as is tradition switch back um oh i think there are like all of these ways where the supply chain it's just like super non-obvious um an example of this is people a lot of people want local inference and somehow they assume that like the problem is solved now because we're gonna have open source models we're gonna be able to run them on our computers and so we're not gonna need all the stuff in the data center but from like a global allocation perspective actually it's quite terrible to have everybody like have a bunch of the world's limited supply of drams sitting in their own computer and being used five percent of the time like you want [29:36](https://realalpha.app/v/iMsUcCYNKqY/?t=1776) maximum utilization in the cloud if you're trying to like deal with this very supply constrained environment and somehow everyone's many people's intuition is the opposite of that where else have we seen the market respond to high prices not just in memory but across the supply chain turbines batteries concrete sorry the market is responding there in in high prices yeah i'm seeing where are you seeing any interesting market responses in terms of high prices pulling in innovation components for some components for robots and not like the humanoid like you know kind of like fake demos but like the industrial robots that can just make stuff i see there's new actuator makers and stuff yeah honestly i mean maybe you could say if open ice sells our chip maybe that That would be an example. [30:20](https://realalpha.app/v/iMsUcCYNKqY/?t=1820) Okay, yeah, I want to get to your chip because that was going to be my example. I think the solution to high prices and short, you know, limited demand, or sorry, limited supply, excuse me, is you make your own chip. Presumably you're using a lot of AI to make the chip. I would have thought that's hard because I would have thought that chip design is one of those places limited by the public tokens you can get where there aren't actually that many blog posts on the public internet on how to build a, you know, leading edge two nanometer chip? Well, in terms of like how to do the lithography, yeah, I think there's like one company on earth that seems to know how to do that. [30:57](https://realalpha.app/v/iMsUcCYNKqY/?t=1857) In terms of how to do the chip design, like to build the file that you eventually send it tape out, that is well understood. And that is a great problem for AI. And given that the world is going to be like limited in its silicon capacity, we all, we have like a shared interest. One of the things that I'm proud of about OpenAI, and maybe it sounds obvious, but it was maybe not as obvious at the time, is we have a culture where people, even if they've done something the old-fashioned way for a long time, are super willing to try using AI to do it better. What are other examples of that? AI research, software engineering, but also increasingly like procurement or things that people think of like very outside the realm of what most people are using AI to do. [31:48](https://realalpha.app/v/iMsUcCYNKqY/?t=1908) How does AI driven AI research actually work? Like the math proofs where you say, or the finding the PHP vulnerability where you say, please find me some AI advances. So I think we don't know. know yet how it truly is going to work. We know today how to say, like, find me a 5% computer efficiency win. But it's that high level. Like, I could be an incredibly successful AI researcher now. I don't know about incredibly, but yeah, if you were looking for a new job, you can come do it. What I don't think anyone knows how to do yet is to say, like, go discover a new architecture that is as big of a single leap forward as the Transformer was. And I think that's where things are heading. And what's missing there? Smarter models that are smarter in this dimension. [32:30](https://realalpha.app/v/iMsUcCYNKqY/?t=1950) The high-level planning and conceptual reasoning. [32:32](https://realalpha.app/v/iMsUcCYNKqY/?t=1952) **Sam Altman:** I think if you apply the same pipeline that we applied to get our models to be so good at math to AI research, it will probably work. [32:39](https://realalpha.app/v/iMsUcCYNKqY/?t=1959) Now, per an early part of this conversation, I kind of think that at least for a while, maybe for a long while, we are going to have to agree to some limits about how smart we let these single models go. But a lack of progress will come from that decision, not from the AI's inability to do good research. Concretely, if I'm using AI to develop improved AI, because we should expect GBD7 to be really good now, because you have GBD6 and whatever, you know, unreleased version of it to develop it. And so my expectations are sky high. But I come into work, you know, with my backpack, and I come into the OpenAI office in San Francisco, and I sit down at my desk. [33:22](https://realalpha.app/v/iMsUcCYNKqY/?t=2002) Like, am I saying, find me more intelligence in this model? Am I giving a real direction of research? How directed does it get? What does the iteration loop look like? Just what does RSI, because you have a front row seat to RSI. And I'm curious what it looks like. One of the sort of interesting things that people talk a lot about in OpenAI, which sounds very obvious, but it sounds like a good answer, or just like, well, build me, build me RSI or whatever, is what are the questions that you're supposed to ask of GPT-7? Probably it's not enough to just say, like, make me RSI. And also, like, it's probably not enough to say, like, buy me a 5% compute efficiency win. [34:08](https://realalpha.app/v/iMsUcCYNKqY/?t=2048) I think this is, like, one of the most interesting debates going on right now. And the answer is not just, like, what question to ask it, but it's things like agent swarms. Like, what are we going, how are we going to use these models in a way that, like, actually maximizes what we can get out of them. I think we're going to learn a lot about that in the next, like, three months. Okay, but it sounds like you guys do not have a codified OpenAI standard way of doing an AI-enabled AI development. It's still lots of experimentation. It's still lots of experimentation. Yeah. When we're talking about the token budgets, it just strikes me that this is one of the big unresolved questions for AI use in enterprises generally is how we don't have hard budgets for individual engineers. [34:53](https://realalpha.app/v/iMsUcCYNKqY/?t=2093) You don't get cut off at a certain point. It's like, sorry, you've spent all your arcade tokens. Maybe we should, but we don't. And again, I think we all believe in the scale up of AI. But if you take that seriously, it means the dollars of compute or AI per person will go up. And so I feel like we're pretty soon to now actually just running into this question of how you actually decide how much spending power to give individual people inside the organization. There was a time when a lot of companies had this like a thing in their Google Calendar which showed the like approximate cost of each meeting in terms of like everybody's comp that had to be there and I think that was always still an underestimate of it and there was an observation that like Paul Graham made it at one point you on many other companies too, which is that there was like, there are people at companies that have incredible power to save like, you know, $17 on the snack budget of the office every week. [35:52](https://realalpha.app/v/iMsUcCYNKqY/?t=2152) And yeah, you can have these meetings for like unbelievable amounts of money that are adding no value. kind of like no equivalent of the ability to stop that i think that most use okay so i'm like really talking my book here and i'm very biased but i genuinely believe it that use of ai is like not a company's biggest spend problem relative to other things that happen and even if it's like somewhat inefficient it is not where i would focus well but hang on that's not scaling law pilled enough, like, I'm not, okay, two years from now. You want to go send all of Stripe's revenue, all of Stripe's profit on OpenAI services and then complain about this? [36:32](https://realalpha.app/v/iMsUcCYNKqY/?t=2192) I'd be delighted to have a conversation. But we're on a path to that. Great. Yeah. We now spend, you know, 1% a shorter magnitude of Stripe's OPEX is tokens. That is obviously... That feels too low. Yeah. So we're working on fixing it. And it'll get to 5% and 10% and 20%. And then you have a real question. Do you have an intuition on what the right number is? Like what it should be today. What it should be today is maybe tricky, but steady state, isn't it going to be, depending on the kind of company, isn't it going to be tens of percentage points of their OPEX? I think for many companies, the answer to that is clearly yes. [37:22](https://realalpha.app/v/iMsUcCYNKqY/?t=2242) And I think there will come a time when the right thing to do is to really optimize that. And also, like, another thing I'm proud of about OpenAI is we've tried to really drive the cost per unit of intelligence down and down and down. I think we've been, like, a good spokesperson and good champion of this. But still, I think the problem, even at current costs, there are more companies, the problem of not using enough AI rather than using too much AI. Do the dollars per gigawatt of leading-edge AI go up or down? That should go down. Down? That should go down. Why? Because it's gone up to this point, right? [38:04](https://realalpha.app/v/iMsUcCYNKqY/?t=2284) I mean, the reason it could go up is that if AI just gets increases in value per what it can do per watt so quickly, and there's such a supply shortage that people are willing to spend much more. But you would view that as compute not keeping up. But I would view that as compute not keeping up. And if I look at the fundamental cost of turning the sand into intelligence, that should go down. The cost of energy should go down. The cost of chips should go down. The rest of the cost of the supply chain should go down. If it doesn't go down, I'll be very sad. But for it to go down, given how much value there is in this, supply has got to go way up. [38:38](https://realalpha.app/v/iMsUcCYNKqY/?t=2318) Okay, so you would like to see a compute glut where we start producing a lot more memory, a lot more data centers, a lot more of all the inputs. And as a result, anyone who owns a computer for whatever reason can have one. People give different numbers for the kind of the cost per gigawatt measured in like the five-year total cost of ownership right now. But like, let's say, let's pick $70 billion as a number. I think if that number were... That's the cost to install. And run it for five years. Yep, okay. [39:06](https://realalpha.app/v/iMsUcCYNKqY/?t=2346) **Sam Altman:** I think if that number were like 20 instead of 70, we should be much happier. [39:11](https://realalpha.app/v/iMsUcCYNKqY/?t=2351) And we should still demand to get, you know, 10x better performance out of it with smarter models every year. Presumably you don't think, like, 2 is a good number. Like, something's gone wrong if we're seeing 2 because it would be surprising if we were... Or is 2 better than 20? Why is it not? Like, I don't think that will happen. But why do we not want that number to be as low as possible? I don't know. This is your theory. You have a view that generally deflationary technology is good. I do believe in that. Yeah, I'm pro-deflation in a sense. Pro-deflationary technology. So how are we going to get there? What's going to happen between now? [39:43](https://realalpha.app/v/iMsUcCYNKqY/?t=2383) Well, $2 a gigawatt, I can't imagine. Okay, what's going to happen between now and $20 a gigawatt? $20 billion. $20 a gigawatt would be really great. Okay, yeah, $20 billion a gigawatt. Even to get down to $20, you're getting into the realm of energy's got to get cheaper. But certainly, like, all of the gross margin stacking that happens between melting... or the equivalent of melting sand and getting the token back, a lot of that's got to get compressed. You could just get there with eliminating profits, or do you need to also make the energy cheaper? I don't know the math off the top of my head. [40:12](https://realalpha.app/v/iMsUcCYNKqY/?t=2412) I mean, if you assumed all materials were free and no one made a profit, maybe you could get there in the current energy envelope, but only just. I see. Personal agents are the most exciting thing happening in AI right now. There's many exciting things happening in AI, but one of the most exciting things, You guys launched D.A.T.S. a few weeks back at the stage. And there's a bunch of other people also launching in the field. What will be true of the winning personal agent? It's like intelligence, context, tools. It's a limited number of things. And someone is going. I think no one has yet figured out the thing that people... [40:54](https://realalpha.app/v/iMsUcCYNKqY/?t=2454) People like these, but this is not something that people are like, I cannot imagine my life without this thing in a way that when people talk about coding agents or even ChinaGPT, they do say. And someone, I think someone soon is going to figure out what that looks like. And you talked about one of the reasons why this doesn't quite work yet. But I think this is like a small number of ideas away from a super mainstream thing. Oh, interesting. You think we have not had the Macintosh moment for personal agents? I think we have not. Do you have any sense of what the shape of it will be? I think it'll look a lot like the current, you know, Dots or News or GrokBot or whatever, but it'll just work. [41:33](https://realalpha.app/v/iMsUcCYNKqY/?t=2493) Like, it'll just work. It'll be reliable. You'll, like, never have—you'll just, like, give it more complex tasks and it'll do all of those things. Computer use dynamic is very interesting to me because not everyone is embracing the new agentic future with open arms, but it's not totally within their control because you can just have an agent using a computer. Where do you think that dynamic goes, this sort of cat and mouse? Like rough instinct is the world will, when people are going to fight this in both directions, but eventually converge on something like you're allowed to tell an AI to use your computer on your behalf, including software. [42:18](https://realalpha.app/v/iMsUcCYNKqY/?t=2538) People always talk about that, But isn't it a bit like the semantic web? It's like a really nice conceptual idea. Yeah, I was going to say, I don't think this is so black and white. I don't think I have a super high degree of confidence of how this is going to play out. As a consumer, I feel somewhat annoyed if I can't have an AI automate tasks on my own computer. I want it to feel like it's my agent doing what I ask, but then I don't have to go do something like this. Yeah, I note a very interesting dynamic right now, which is every company is really eager to add AI to their products in a very specific way, which is there is a tab or pop-up widget or something that gives you a messaging type UI. [43:08](https://realalpha.app/v/iMsUcCYNKqY/?t=2588) And it's often surprisingly capable. And so you can say, hey, I actually want to return my most recent order. And then you're kind of surprisingly impressed when it actually is able to find your most recent order. And, you know, it's a bit janky and it can do all those things. However, no consumer really wants this UI because consumers have strong, not immovable, but strong preferences for their existing primary chat app, the kind of top of wallet app that they open when they want to go to do something. And what they want is to be able to say, hey, go find my recent order on this business and refund it or something like that. [43:55](https://realalpha.app/v/iMsUcCYNKqY/?t=2635) And I noticed that businesses are really reluctant. to allow people to use those businesses inside another AI app. Because like, oh, we're going to lose control on our motive, whatever. And it just strikes me as fine, because your defensibility probably did not come from your ability to put together HTML. Your defensibility came from the brand loyalty and the product selection. And the new UI is that agentic interaction inside ChatGPT or Gemini, you know, or whatever it is. but all businesses disagree with me and they're very good at business so maybe they're right I mean again I have like a bias here but I so directionally agree with you like I have such an extreme preference to buy something from Amazon versus some random e-commerce vendor that I don't know if I can return to or I don't know if I can like trust to deliver it quickly or something like if I ask ChatGPT to buy me something and I can choose Amazon versus some other thing like 10 out of 10 times I click Amazon I'll pay a higher price. [45:00](https://realalpha.app/v/iMsUcCYNKqY/?t=2700) I have just like such. Yes. And it's nothing to do with like my experience of clicking around Amazon.com. Exactly. And now I think you could say we have not done a good enough job offering partners or platform inside of ChatGPT if they don't want this to happen. But, and again, maybe I'm really biased here. I think Amazon's like in a great, I think they're in a great place of commerce moves like much more agentic. Amazon in particular has this amazing defensibility by the fulfillment network. And so you can use Amazon kind of from anywhere. I super trust that. Yeah. I'm just really struck by this dynamic. [45:35](https://realalpha.app/v/iMsUcCYNKqY/?t=2735) Like my new thinking, in particular with regards to Agenda Commerce, but also anything, is any time there is a web form field that you as a human are filling out, these days that is below your pay grade. Because you are probably not inventing that information for the first time. Like we've all filled out the medical forms where it's like, oh, your family history or whatever. And that's so frustrating because how many times have you filled out your dad's and your mom's medical history and things like that? It just feels so wasteful. But there's a million versions of that. You're never inventing new information for a web form. [46:06](https://realalpha.app/v/iMsUcCYNKqY/?t=2766) I would be so happy to never do fake work at a computer again. Yeah. And my argument is that any web form is basically fake work. I agree. But I was one of the very earliest adopters that I knew of, of those like plugins that put in your like name and address like very clumsily you know because I was just like this is I cannot do this again but I kind of feel like that using like most of the web at this point. Yeah I just find this phenomenally interesting where businesses right now are really attached to their HTML and mobile apps as sources of business [46:43](https://realalpha.app/v/iMsUcCYNKqY/?t=2803) **Sam Altman:** defensibility and it just feels very tragic like either they're wrong and it's not a source of defensibility or It may be, but it's transitory and they just need to get over it. [46:54](https://realalpha.app/v/iMsUcCYNKqY/?t=2814) The last example of this that I think we really witnessed was like the app stores, the iPhone app stores specifically. And I remember every startup was like, or many startups, like most of the YC batch was like, I'm going to build an iPhone app. This is like new distribution. This is awesome. I can do a new thing I couldn't do before. And many new startups got created. And all of the big companies felt like they had to make one, but they kind of didn't want to because I'm like, oh, I'm going to like hand my, you know, relationship with my consumer over to Apple. and it was great for most people. [47:23](https://realalpha.app/v/iMsUcCYNKqY/?t=2843) It was just a new UI. Yeah. Okay, I'm going to go more rapid fire. People complain about bench maxing. Is that a real concern? Are OpenAI models bench maxed? Are you actually Rick Rubin-ing it where you just feel like the vibe of this model is right and you don't care what Sweebench gives it? Maybe there are two things we should really care about models being good at. One is scientific discovery and doing things that people cannot do. And the other is being enjoyable to work with. and i don't think we have great benchmarks for being enjoyable to work with i'm actually not sure we have great benchmarks for like the smart I'm not a scientist either, but we endeavor not to bench-max, and I keep thinking that bench-maxing is over as a phenomenon, and people keep doing it. [48:13](https://realalpha.app/v/iMsUcCYNKqY/?t=2893) So are you better than other labs at not getting sucked in by the siren call of bench-maxing? I believe we are better at that. I don't think we've always been better at that in history. I believe we're better at that right now. It feels like the industry is still figuring out the being nice to work with, where there was the glazing era. And more recently, there was the stroppy, ornery era of models that were anti-glazing and as a result tried to disagree with you and nitpick at you on every minor thing. The current ones are pretty good, actually. It's gotten, I think the latest models are much better than we've had in a long time. [48:49](https://realalpha.app/v/iMsUcCYNKqY/?t=2929) But it also feels like there's probably higher peaks to Ascent. Emmett Scheer said to me years ago that what he wanted was a really thoughtful and challenging but still respectful senior co-worker. And I have still not heard a better like brief encapsulation than that. Yes. After working with him for many years, what's your grand unified theory of Greg Brockman? I think Greg Brockman is like one of a kind in the best sense. He's singular on the Greg Brockman scale. You just kind of have to be there to understand what that is. But I think it's like a combination of like, yeah, intensity, like monster productivity, extreme dedication, and like focus on 16th admission. [49:25](https://realalpha.app/v/iMsUcCYNKqY/?t=2965) It's very cool. You hate tokens as a metric for anything, really. Pricing or just kind of, it's not the standard unit of AI. And yet we found ourselves there. You know, we did talk. And you might say outcomes, but I don't think it can be outcomes. Because outcomes is too different across different use cases. It's what's the right standardized unit. We almost made a very, what would have been a bad call to say we're not going to price our next model in tokens at all. And you're just going to give it a prompt and we're going to give you a price back. And we're going to do it. And it's going to be like AWS. [50:06](https://realalpha.app/v/iMsUcCYNKqY/?t=3006) You just do something and we send you a bill. But the customer response on that is so negative. They're like, I need to know what I'm paying for somehow. Yes. And I asked a few people, would you rather pay more for the same output but have it priced in some number of consistent tokens or something like even if we like inflated the tokens and i'd much rather inflate you inflate the tokens and pay more because i know there's like a real thing there um so i think you are right that people don't just want us to like give them a price because they like they feel like over the long term they're going to get screwed somehow um in the same way that maybe people would like rather pay for cpu hours rather than just like getting their thing done and even if it was less expensive you know the way like nanometer the chip is totally blank yeah the nanometers has very little relation to reality these days. Will we get something like that in tokens where you guys should start saying here is an intelligence equivalent token like, I can't believe it's not butter. Of like the smallest feature. [51:05](https://realalpha.app/v/iMsUcCYNKqY/?t=3065) I, it's like made up, I hope not. I mean, it offends me that we like use the word nanometers for something that has nothing to do with nanometers. I know, it's very silly. You're not like that. I would rather not make up a fake unit. tokens are a kind of fake unit. I mean, they're real in some sense, but they're not a good unit. They're fake from a business value point of view. Isn't the only defense of tokens that if you're wasting tokens, we should fix that pretty soon? Like, we shouldn't be streaming. Claude Shannon would not approve of us just streaming noise rather than signal. And so there's a floor of the information theoretic most useful tokens on both sides. [51:48](https://realalpha.app/v/iMsUcCYNKqY/?t=3108) And we'll kind of come back to that. Yeah. I mean, right now you have to think about whether you should want the $0.10 per million tokens out of a small model or $10 per token, tokens out of a big model, and then how long the chain of thought is likely to be. And that's just cognitive overhead that I don't think actually adds any value. Is the chain of thought included in the price? In what we charge? Most people do. Okay. By the way, the Guinness was not as bad. It definitely not as good as an IPA, but not as bad. It's good. Yeah. I mean, IPA is great, but it's pretty good. We like Guinness. Yeah. [52:25](https://realalpha.app/v/iMsUcCYNKqY/?t=3145) At least in this podcast. Thank you.