# What AI insiders say off the record | Jasmine Sun Markdown copy of https://realalpha.app/v/kLAawZ9x1nQ/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy. Jasmine Sun says AI insiders expect major disruption but keep building, while public distrust makes safe, broadly supported AI policy harder. - Show: 80,000 Hours Podcast - Hosts: [Rob Wiblin](https://realalpha.app/people/rob-wiblin/) & [Luisa Rodriguez](https://realalpha.app/people/luisa-rodriguez/) - Guest: [Jasmine Sun](https://realalpha.app/people/jasmine-sun/) is a writer and journalist covering AI. - Published: Jul 21, 2026 - Length: 1 h 6 m ## The best minutes - [2:19](https://realalpha.app/v/kLAawZ9x1nQ/?t=139) [AI insiders expect job losses but feel the race is unavoidable](https://realalpha.app/s/ai-insiders-expect-job-losses-but-feel-the-race-is/) (5 min) - [14:04](https://realalpha.app/v/kLAawZ9x1nQ/?t=844) [A few personal beliefs can set the direction of major technologies](https://realalpha.app/s/a-few-personal-beliefs-can-set-the-direction-of-major/) (5 min) - [32:47](https://realalpha.app/v/kLAawZ9x1nQ/?t=1967) [Public backlash grows when workers lack a way to bargain over AI](https://realalpha.app/s/public-backlash-grows-when-workers-lack-a-way-to-bargain/) (8 min) ## Also worth watching - [6:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=418) [Fear of losing leverage is drawing talent into AI labs](https://realalpha.app/s/fear-of-losing-leverage-is-drawing-talent-into-ai-labs/) (7 min) - [44:02](https://realalpha.app/v/kLAawZ9x1nQ/?t=2642) [AI companies need visible benefits to regain public trust](https://realalpha.app/s/ai-companies-need-visible-benefits-to-regain-public-trust/) (8 min) - [22:09](https://realalpha.app/v/kLAawZ9x1nQ/?t=1329) [Safety work has different status inside and outside AI labs](https://realalpha.app/s/safety-work-has-different-status-inside-and-outside-ai-labs/) (6 min) - [52:49](https://realalpha.app/v/kLAawZ9x1nQ/?t=3169) [China's AI adoption reflects pragmatism more than optimism](https://realalpha.app/s/chinas-ai-adoption-reflects-pragmatism-more-than-optimism/) (6 min) - [40:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=2416) [AI populist coalitions can crowd out frontier safety priorities](https://realalpha.app/s/ai-populist-coalitions-can-crowd-out-frontier-safety/) (4 min) Skip the doomer-label discussion, the profile of AI populist groups, and the closing sections on AI reporting and career opportunities. ## Full analysis: Jasmine Sun says half a friend’s cohort decided to graduate early - A close friend told Sun that half her PhD cohort had decided to graduate early. - That is evidence of a talent pull, not proof of mass job losses. - Leaders should track hiring outcomes and whether independent safety work can retain people. Its 7 sections, what it means for you and what to watch are on [the page](https://realalpha.app/v/kLAawZ9x1nQ/#analysis), free with an account: - [12:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=778) Half of one cohort decided to graduate early - [3:43](https://realalpha.app/v/kLAawZ9x1nQ/?t=223) Insiders expect displacement, but the forecast remains unverified - [15:10](https://realalpha.app/v/kLAawZ9x1nQ/?t=910) A small builder class makes personal beliefs consequential - [26:08](https://realalpha.app/v/kLAawZ9x1nQ/?t=1568) Safety work gets uneven support across institutions - [39:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=2356) Workers lack bargaining channels over AI adoption - [49:54](https://realalpha.app/v/kLAawZ9x1nQ/?t=2994) Public trust needs demonstrated gains and visible sharing - [1:04:38](https://realalpha.app/v/kLAawZ9x1nQ/?t=3878) Policy interest is rising faster than concrete proposals ## Summary Sun is a writer and journalist who focuses on AI and Silicon Valley. She describes her work as documenting the cultures and beliefs of people building frontier AI through interviews and time spent in the community. Sun says many AI researchers expect mass job displacement in the next few years, yet keep building because they hope for abundance, believe the race is unavoidable or want a stake in the future. She argues that the beliefs and status norms of a small group of builders can shape what gets built, while safety work outside labs faces weaker support. She sees AI populism as a backlash against concentrated corporate power and says public distrust is reinforced by limited everyday benefits and little perceived control. Sun argues that visible material gains and economic sharing could help, and sees growing opportunities in AI policy and philanthropy. ### Minute by minute - [1:19](https://realalpha.app/v/kLAawZ9x1nQ/?t=79) **AI insiders expect disruption but keep building.** Sun says almost everyone she interviewed struggled to advise a typical 17-year-old, and many expect mass job displacement in the next few years. The host cites a 10% chance of everyone being killed, which Sun says is not an uncommon belief among lab researchers. She says some builders accept these risks for a future of cures, abundance and leisure, while techno-determinism and a desire for equity also keep people in the race. - [6:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=418) **Some insiders question human control.** Sun says a smaller group of influential insiders express indifference to, or even preference for, a future where AI rather than humans makes major decisions. She says these views, including arguments that more intelligent beings may deserve to rule, make agreement on basic safety principles harder. - [11:23](https://realalpha.app/v/kLAawZ9x1nQ/?t=683) **Memes move talent toward frontier labs.** Sun says permanent-underclass language can be edgy, but the beliefs behind it affect career choices. She describes a Berkeley PhD cohort in which half had decided to graduate early for lab jobs, as well as independent writers and policy advocates moving into labs. She says these choices drain talent from non-corporate work. - [14:04](https://realalpha.app/v/kLAawZ9x1nQ/?t=844) **A few builders can set technology's course.** Sun argues that a small number of researchers have outsized influence on what gets built, sold and diffused. She points to early internet architects' commitment to open protocols and to DeepMind's early funding from an investor who backed the idea of AGI when other investors passed. - [18:42](https://realalpha.app/v/kLAawZ9x1nQ/?t=1122) **Doomer labels can lower safety's status.** Sun says some Silicon Valley accelerators use Doomer as an insult for people who would slow AI progress, portraying safety concerns as low-agency or anti-progress. She also describes vice signaling, in which companies promote extreme positions such as automating all labor or cheating on everything. She says these norms can shape what young builders see as prestigious. - [24:09](https://realalpha.app/v/kLAawZ9x1nQ/?t=1449) **Independent safety work has less support.** Sun says technical safety remains relatively well-funded and respected, in part because capabilities researchers care about alignment and safe models fit companies' business incentives. She worries more about independent journalism and policy advocacy: people employed by labs may be seen as shills, while those outside lack comparable jobs and professional support. - [28:06](https://realalpha.app/v/kLAawZ9x1nQ/?t=1686) **AI populists oppose concentrated corporate power.** Sun describes labor advocates, social conservatives, environmentalists and states' rights advocates bringing their existing causes to AI. She says these groups are less focused on technical risks than on wealth and corporate power concentrating at ordinary people's expense. - [32:47](https://realalpha.app/v/kLAawZ9x1nQ/?t=1967) **Backlash may enter campaigns and workplaces.** Sun says public anger is understandable when people see technology leaders accepting major risks but have little democratic influence. She cites the St. Louis Fed's figure that data centers and AI accounted for 39% of growth in 2025, and expects candidates in the 2028 campaigns to use AI as a political issue. She adds that many workers lack collective channels to shape workplace automation. - [40:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=2416) **Populist alliances can distract from safety.** Sun says safety advocates may build bridges with populist groups through issues such as child safety or the environment. But broad backlash can also direct limited political attention toward issues such as data-center water use rather than frontier risks. She sees a possibility for broad public politics and more targeted policy to coexist. - [44:02](https://realalpha.app/v/kLAawZ9x1nQ/?t=2642) **Public sees few benefits in AI's promises.** Sun says years of warnings from AI companies can make later reassurance look like a reversal, while many people encounter AI as low-quality output, job-application friction or cheating rather than productivity gains. She adds that Silicon Valley's enthusiasm for UBI and leisure does not match many Americans' desire to work. Earlier company messaging, she says, mainly targeted recruits and investors. - [49:51](https://realalpha.app/v/kLAawZ9x1nQ/?t=2991) **Trust may require visible economic sharing.** Sun says visible medical and scientific gains could improve public views, but health advances alone may not address distrust rooted in inequality. She argues that people need a legible share of the economic upside and says public funding or distributions could help. - [52:49](https://realalpha.app/v/kLAawZ9x1nQ/?t=3169) **China's AI adoption reflects pragmatic resignation.** Sun describes Chinese attitudes as pragmatic rather than simply optimistic: many people see AI adoption as unavoidable amid government support and a competitive job market. She notes some protests and incremental regulations, including a court ruling that AI replacement would not by itself justify firing a worker. She also says state-owned employers have promised not to lay off workers solely because AI can do their jobs. - [58:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=3538) **Journalists should test claims across sources.** Sun says some journalists discount AI companies' claims because of skepticism shaped by the crypto era. She recommends checking claims with independent experts rather than assuming that company statements are false, and speaking with stakeholders across industry, academia, policy and politics. - [1:03:03](https://realalpha.app/v/kLAawZ9x1nQ/?t=3783) **Policy and philanthropy offer openings.** Sun says more politicians and donors are taking AI seriously, creating greater demand for proposals than there are organizations and solutions to fund. She sees opportunities for policy workers who build relationships across groups such as labor and environmental advocates. She also points to billions of dollars that could go toward AI-related issues in the next few years. ## Transcript 80,000 Hours Podcast, hosted by Rob Wiblin and Luisa Rodriguez, with Jasmine Sun. Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there. [0:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=0) Most people in the world do not have the opportunity to like get themselves out of the permanent underclass by getting a job at OpenAI. Sure, you could call it like a normal amount of people like money, but I think the scale of how much talent is flowing into a few specific labs really has to do with the fact that the AI community itself is promoting these widespread beliefs that if you do not have a stake, if you do not have literal equity in frontier AI, you are not going to have economic leverage in the future and you and your kids are going to be Screwed. Today I'm speaking with Jasmine Sun. Jasmine's a writer who's focused on the AI world in Silicon Valley and she lives in San Francisco, spends lots of time with the AI community that's based there and she describes her work as an anthropology of disruption. So basically she's documenting the cultures and the beliefs of the people who are building Frontier AI. [0:56](https://realalpha.app/v/kLAawZ9x1nQ/?t=56) that means basically she's going to all the parties seeking out people from all the different factions in this world interviewing them learning what makes them tick now if that sounds interesting to you jasmine's got a sub stack that i highly recommend checking out and she's also a guest contributor for the atlantic jasmine thank you so much for joining us thanks for having me so you wrote this opinion piece recently for the New York Times, which opened with this really striking observation that most people you know in AI think that the median person is screwed. Now, I'm assuming what you mean by that is sort of on the more moderate end of things, people are anticipating serious short-term disruption, things like job displacement and so on. But for some people, in some cases, people are talking about more extreme things like existential scale threats that affect all of humanity and the idea of a permanent underclass. The people that you're talking to in these circles, you know, they talk about these things, but they don't really have a solution. And yet they're still going ahead and building the technology. Can you help us get into their heads a bit here. So like, do they feel guilty or worried about the costs that they might [2:22](https://realalpha.app/v/kLAawZ9x1nQ/?t=142) impose on society if they mess things up? I've been super interested in these questions. And part of the reason I wrote that New York Times piece is because, you know, I was doing this little personal project where I was doing almost these long form AI ethnographies, where I'd sit down with a random researcher at one of the frontier labs, sometimes in a friend, sometimes an acquaintance or a stranger, and I just asked them for an hour about their very broad views about AI, its impact on the world, and how optimistic and pessimistic they were all off the record. And one thing that I noticed is one of the questions I ask is what advice would you give to a normal 17-year-old? So not like a super crack, like brilliant coder, but just like pick a random state in America, normal 17-year-old, they're getting bees in school, they're not like thinking about AI that much. Like how do you think that they can prepare for the future? And what was really shocking to me was almost everyone I spoke to, regardless of their personal political beliefs, some of these are more libertarian types. Some of these are more leftist types. Some of these don't care about politics at all. Some of these have a wide range [3:20](https://realalpha.app/v/kLAawZ9x1nQ/?t=200) of beliefs about even AI itself. Most people just told me, honestly, I have no idea what I tell that [3:25](https://realalpha.app/v/kLAawZ9x1nQ/?t=205) **Jasmine Sun:** 17-year-old. It's a really scary time. I don't think there's going to be a lot of jobs for them left. I think they're caught in this painful transition. And on the economic front, it did [3:33](https://realalpha.app/v/kLAawZ9x1nQ/?t=213) become clear that there was sort of this quiet consensus that regardless of your future beliefs about whether there will be a permanent underclass or more jobs than ever, the vast majority of people I know in the AI industry believe that in the near term, in the next few years, we are going to see mass job displacement. It's going to be especially hard for a lot of young people, and a lot of current knowledge work jobs are going to be disrupted and displaced completely. And so then, of course, it kind of goes to the other thing you said, which is... For me personally, I just feel that if I thought that the technology I was building was going to, had a very high chance of, you know, displacing millions of jobs and maybe also like a 10% chance of killing everybody or something like that, which is also not an uncommon belief from researchers at the labs, I probably wouldn't build it. [4:17](https://realalpha.app/v/kLAawZ9x1nQ/?t=257) And so, you know, then I go and ask, like, so like, why are you doing this? Does that feel dissonant at all, you know? And, you know, you hear a range of answers to that. I think that for a lot of people, for some people, I would say the probably more common belief among researchers at the labs is, yes, there are harms. Yes, there are risks. But if we really get this AI thing right, we are going to enter a world that is better than ever. We are going to get the end to all disease because AGI is going to help us find the cures to diseases and humans will be immortal. we're going to have all consumer goods and services be cheaper than ever because the space factories or whatever it is mean that like we're not going to have to pay for a house or a car maybe it'll be better when the AIs can do all the jobs and we're able to live off UBI and we can sort of engage in these lives of infinite leisure and focus on our relationships and our communities instead of having to engage in like demeaning wage labor or something like that and this vision I think is genuinely inspiring to a lot of people who work in AI they do believe that technological progress for all of its bumps and disruptions ultimately leads us to a world where we live [5:23](https://realalpha.app/v/kLAawZ9x1nQ/?t=323) longer and happier lives. And so I think one is that a lot of folks are willing to take the risk or sort of weather this near-term disruption in order to get to that future. The other thing that I noticed, though, which is in some ways a little bit more disturbing to me or challenging for me, is a pretty broad sense of techno-determinism. So I think a lot of people in the AI industry and in tech more broadly do think that the path of technology is sort of preset, that somebody is going to build AGI, somebody is going to build superintelligence, especially at this point with how fierce the race has become between the frontier labs. [5:59](https://realalpha.app/v/kLAawZ9x1nQ/?t=359) There is a sense of, well, if I don't do it, they're going to do it. So maybe I'm at Anthropic and I actually am really worried that, you know, the thing I'm building might have all these negative consequences. But if Anthropic exits the race, you know, OpenAI, XAI, Google, They're going to stay in the race and they're going to keep competing. And then you might think, well, at least if I was involved, I could help make it go better. I could build a better product, a safer product, you know, a more technology that cares more about human welfare. And in addition to that, I might as well, you know, get my bag and make sure that I have a stake in the future is the other thing. [6:37](https://realalpha.app/v/kLAawZ9x1nQ/?t=397) I do think a lot of people, if they believe that this huge disruption is coming, do care somewhat also about securing their own spot through financial upside in the future. And so that one's a little bit more worrying to me because, like, sure, maybe I get it and I'm happy for them. But most people in the world do not have the opportunity to, like, get themselves out of the permanent underclass by getting a job at OpenAI. And so, you know, that's what I worry about. But you've also described coming across, and this is probably from a smaller subset of people, but some kind of nihilism about AI. [7:12](https://realalpha.app/v/kLAawZ9x1nQ/?t=432) So this kind of idea that it actually doesn't matter if technology serves humans at all. And I guess like a related idea that actually maybe we should be handing over the reins of the future to AI and away from humans. So in that sense, it's not just, you know, that it doesn't matter if technology doesn't serve humans. It might actually be a good thing if it's sort of not serving humanity, but serving AI as our successor. Can you tell us a bit more about those views and sort of how you see them influencing the AI scene these days? for sure um yeah i'll share your caveat that um i would say that these what i call like successionist light views are more niche and definitely less common than the sort of previous set that I described. [8:04](https://realalpha.app/v/kLAawZ9x1nQ/?t=484) But I have been worried in hearing in just casual conversation, fairly prominent and influential people within the AI community express sort of an indifference or even a preference to a world where AIs are making most of the decisions in society rather than humans. I mean, one of them, these are, I won't disclose people's identities because they were Chatham House or sort of off the record contacts. But, you know, like I'd be having a conversation with somebody at a conference workshop and they would say, you know, like everyone at this conference is so worried about what's going to happen to humans in the post-AGI world. But frankly, I'm more worried, what if the monkeys are still running the show? And in this case, the monkeys refers to the humans. He was more concerned that humans would still be in charge of governments, of corporations, of society, because he sort of had this view that AIs by in their super intelligent existence were more deserving and more important to preserve a future world for. Or I was, you know, talking to another very influential person in the AI scene and we were just on a walk and musing about, you know, like if all labor gets automated, what are people going to do? And he was like, [9:15](https://realalpha.app/v/kLAawZ9x1nQ/?t=555) maybe it'll be like Nozick's experience machine and we're all going to be, you know, know, wearing these VR headsets and watching perfectly personalized AI slop. And so we don't have any leverage in society, but in a way it's very pleasurable and people are very happy. And I was like, I don't know, like, do you think that's actually the world we want? Like, we're sort of going back and forth on it a bit. And he's like, honestly, Jasmine, like, I'm a lot more interested in what the AIs are going to do with each other a thousand years from now than I am in what's going to happen to humans next year. And so in a way, I think that there are people, uh, influential and prominent people in the AI community who, whether for intellectual reasons or for like intellectual reasons, as in like a belief that like the more intelligent species is more deserving, or simply because it's a more interesting thought experiment have sort of arrived at an indifference towards whether humans stay in control. [10:07](https://realalpha.app/v/kLAawZ9x1nQ/?t=607) Um, and I find that quite worrying. I don't think it's, you know, the majority belief or common belief within the AI labs or something like that. But I do think that it makes it very hard to have to move forward policy action, to move forward the safety conversation if we're not able to agree on even very foundational concepts such as humans should stay in control of our governments. And it is possible to decide what technologies we build and don't build. And our conversations should center what happens to people. And so I find that a little bit troubling. I think maybe I'm just like a jaded person. But when I hear you talking about people expressing these nihilistic beliefs or these deterministic beliefs, in my head, I'm just like, but surely these people like they don't genuinely believe what they're saying. You know, it's just like a bunch of tech bros who are doing some kind of mixture of like posturing, like edgy humor, irony, that kind of thing. And I wonder if through this conversation we are paying too much attention to what's essentially just like an aesthetic choice that they're making rather than like a real set of beliefs. What do you make of that? I think it's fair. And I think that, you know, when I try to report, I try to have an eye [11:34](https://realalpha.app/v/kLAawZ9x1nQ/?t=694) for some of the hyperbole, like in the permanent underclass piece, like I try to make pretty clear that in a lot of ways it is an edgy joke. And most people do not literally believe in a permanent underclass, even if they believe in mass job displacement and increasing inequality, which I also think is somewhat concerning and worth talking about, even if it's expressed in more extreme ways. But in general, like I like paying attention to these cultural quirks and these memes because I think they are a release. for things that you can't say or things that feel almost sometimes taboo or inappropriate. [12:04](https://realalpha.app/v/kLAawZ9x1nQ/?t=724) Like I would not have written that permanent underclass piece if I have not had, you know, lots and lots of conversations with young workers in Silicon Valley who have decided to try to get a job at an AI lab rather than doing a variety of other things specifically because they were specifically worried about being trapped in a permanent underclass. And maybe you could say, oh, they were actually just worried about having, being poor or being, having less money when AGI comes and returns to labor, stop working. But it's true that these memes, silly as they may sound, are shaping people's individual behavior. I mean, I've been thinking a lot specifically about this question of where people choose to work and brain drain in particular, because for example, one of my close friends is a PhD student who studied NCS in AI at Berkeley. And she was telling me how like half of her cohort has decided to like graduate early within just a few years of beginning their PhDs in order to get jobs at AI labs. And they've actually curated their PhD dissertations for research that would be most likely to get them a job at an AI lab. I've seen [13:14](https://realalpha.app/v/kLAawZ9x1nQ/?t=794) **Jasmine Sun:** in my own community, tons of people who were independent writers or independent policy thinkers and policy advocates decide to leave those roles behind in order to get jobs at AI labs. [13:25](https://realalpha.app/v/kLAawZ9x1nQ/?t=805) And these views, sure, you could call it like a normal amount of people like money, but I think the scale of how much talent is flowing into a few specific labs really has to do with the fact that the AI community itself is promoting these widespread beliefs that if you do not have a stake, if you do not have literal equity in frontier AI, you are not going to have economic leverage in the future and you and your kids are going to be screwed. And I've just heard in enough private conversations, these are motivating people to make such decisions. And it's clearly draining talent from the non-corporate independent ecosystem that I do start to take those memes somewhat seriously. [14:02](https://realalpha.app/v/kLAawZ9x1nQ/?t=842) So if you're trying to understand what the future of AI is going to look like and how AI is going to shape the future, the most natural thing, at least from my perspective to do, would be to kind of focus directly on thinking about the technology itself or or maybe on surrounding policy issues. But you do something kind of different. So you take this anthropological approach where you're focusing on the cultures and beliefs of the people who are building these technologies. What does that lens capture that other lenses might miss? Yeah, I certainly think it's important that other people are, you know, focused on just the policy or just the technology itself. But one thing that I think a lot of the community or even outside observers underestimate is that there are really very few people who are building and shaping the trajectory of frontier AI. There are not that many researchers at these labs. The reason they're getting paid these crazy $100 million packages to get poached from here to there and back again is because there are only so many people who have this much leverage, right? And so what that means is that personal idiosyncratic belief systems can be quite load-bearing for really big decisions [15:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=916) around how the technology, what technology is built, who it gets sold to, how it gets diffused. I mean, in many ways, I think the existence of Anthropic is a bet on this thesis. It's the fact that if there's only one lab that is building the best enterprise agents or coding models or whatever it is, then they can actually make principled decisions based on, say, Dario Amodei's personal beliefs that we don't want mythos to be used for mass surveillance or for autonomous robots right now. We actually don't want to sell to Chinese companies in the Chinese government, even though market incentives would dictate that we ought to, because we have these principled beliefs around whether authoritarian governments ought to have access to frontier AI. And so like, I think that in a world where there are just not that many actors and not that the players, understanding the particular philosophies and motivations of the few people who can decide actually is pretty predictive of some of these decisions that are made. [16:10](https://realalpha.app/v/kLAawZ9x1nQ/?t=970) Yeah. For people who are still skeptical at this point, it would be helpful, I think, if you could give some historical examples or indeed recent examples where the values or culture or like idiosyncratic beliefs of people building a technology have actually like tangibly impacted how that technology has, as you say, how it's been built, how it's been deployed, how it's affected the world? Yeah, I mean, I think one example is just looking at the history of the early internet, right, which was not actually built, like AI was primarily in these private megacorporations, but by a guy at DARPA and a guy at Stanford working on these like TCP IP protocols, building these, building out ARPANET, building these versions of the internet where it was decided from the beginning that it should run on open protocols, that it should be this open ecosystem, that different networks between countries, between institutions ought to be able to communicate with each other. And if you read sort of the interviews or the writings of these folks like Vint Cerf, they were very clear that they believed that the internet ought to be open. The whole point was this sort of interconnectedness that would transcend [17:21](https://realalpha.app/v/kLAawZ9x1nQ/?t=1041) borders. And to this day, we are using the same internet based on these open architectures, right? Similarly, you know, I've been reading Sebastian Maliby's biography of Demis and Google DeepMind. And one of the things that I find so fascinating is how in the early days of DeepMind, which is, you know, very arguably the first serious AGI lab, they could not get any funding at the beginning because no venture capitalist was willing to back a bunch of these weirdo scientists who insisted that you could build super intelligence in like, you know, 2010 or [17:50](https://realalpha.app/v/kLAawZ9x1nQ/?t=1070) **Jasmine Sun:** whatever, who had no business plan, refused to commercialize, had no product, et cetera. And they were running out of money until Luke Nozek from Founders Fund, simply out of his personal belief that AGI ought to be possible, that the invention to end all inventions would just be in some ways [18:05](https://realalpha.app/v/kLAawZ9x1nQ/?t=1085) the coolest thing ever, that it was worth a multi-million dollar bet, even while Peter Thiel and many other venture capitalists were like, you're freaking crazy for even considering funding these guys without a business plan, you know? And so I think when we look at the history of these frontier technologies, when there are only a few people who have, frankly, like the technical abilities to make them possible, those people's idiosyncratic beliefs in this thing or another, believing that artificial general intelligence, for example, might be possible at all, believing that the internet ought to be an open thing that transcends borders, they set these precedents and they make these fundamental architectural decisions or funding decisions that sort of lay the groundwork for everything else that comes after. [18:45](https://realalpha.app/v/kLAawZ9x1nQ/?t=1125) Something I was really interested to read on your Substack is how the word Duma has sort of become like the lowest status label that you can wear in Silicon Valley. And that just like, that really surprised me just because, you know, AI company leaders are very much acknowledging the plausibility of doom scenarios. And in fact, that kind of sense of doominess is so pervasive that, you know, people on the outside think it's a form of marketing. They're like, they're not serious. They're just like, it's just hype, you know? And I'm kind of wondering how you think, You know, this idea of doomer as an insult meshes into that picture. [19:32](https://realalpha.app/v/kLAawZ9x1nQ/?t=1172) Yeah, in this case, I'm talking a lot more, I think, about classic Silicon Valley and the VC startup corporate ecosystem around tech, which is still the majority of the tech industry. It's somewhat true. I would say it's less true at the AI labs just because there are a lot of people who are, as you mentioned, doomers who are employed at, who are working at Frontier Labs. when you ask like what is silicon valley's political philosophy or what is this what is its ideology in general you can identify a bunch of little tribes like You can identify the effective altruists here and the progress studies people over there and the EACs over here. [20:05](https://realalpha.app/v/kLAawZ9x1nQ/?t=1205) But one of the things that a lot of them share is a sort of very firm belief that technological progress is necessarily a good thing. And so I think that when people, when, you know, some of the more accelerationist types have turned Doomer into this slur almost against people who want to slow down or to regulate AI or other technologies, they're sort of presenting a group of people as being anti-progress or as being in opposition to this core belief in silicon valley that technological advancement is the only thing that has ever brought us growth prosperity equality etc and if the and if in all of history in spite of again the industrial revolution like automation like every every wave of technology has brought on its own wave of disruptions um but if one were to believe so firmly in these apocalypse scenarios that you would be willing to slow down the only thing that might again bring us this future utopia that would keep the progress engine going, then you must be this kind of like pessimistic, low agency, like tech skeptical kind of person, I suppose. And so again, I would say that this belief is more of the VC startup crowd. But I think that the idea that like we as humans are, first of all, not powerful enough to be able to control our own technologies. The idea that we [21:29](https://realalpha.app/v/kLAawZ9x1nQ/?t=1289) should stop progress just because there might be some marginal side chance of harm. I think people are seeing AI in the context of all the previous technological revolutions and thinking, yeah, these doomers would have still be on the farms being peasants. They would never have allowed the industrial revolution to happen. I think what I want to understand more is what the practical consequences actually are of, you know, having safety concerns, being associated at least in these kind of VC startup-y circles and, you know, which is a like big part of culture in the area, sort of being seen by these people as like kind of embarrassing, call those status. Yeah, like how does that actually affect what's going on in the labs? Yeah, I would say again, to me, a huge part of this is the talent flows question. Just because talent is so scarce, as we see from the salaries that people are willing to pay, talent is incredibly scarce. And so when you have these cultural beliefs, the main thing that they influence is actually really what young people decide to do with their lives and how many people decide to say work on safety versus working on capabilities. One thing that I've noticed rise over the past few years, even outside of AI, [22:47](https://realalpha.app/v/kLAawZ9x1nQ/?t=1367) but in Silicon Valley broadly is the rise of vice signaling. This idea that actually the edgy and cool thing to do is to build a startup like Mechanize where the tagline is that we're going to automate and replace all human labor or to build something like Cluely where the tagline is cheat on everything. I think that the idea that trying to be careful and trying to be careful, trying to be constrained about the way that you build technology by labeling that as Doomer-y or low status or like as not being sort of a pioneer and a serious builder, you're basically preventing a bunch of very impressionable young people from going into a field that they otherwise would. And that's to say nothing of obviously the policy conversation in DC where Doomer has been employed as an extremely effective insult. I think one important thing actually also about the Doomer insult is that it's coming mostly from the tech right that has pretty effectively tied Doomerism and AI safety to, quote unquote, like woke identity politics and previous attempts to regulate technology by alleging discrimination, civil rights concerns, labor concerns, et cetera. [23:53](https://realalpha.app/v/kLAawZ9x1nQ/?t=1433) And so the folks like Marc Andreessen and David Sacks were using the Doomer label most loosely. building this perception on the American right in particular, that to be interested in AI safety is the same as being a woke regulator who wants Facebook to like censor all non-liberal content. I think what I'm interested in here is that, I mean, at 80,000 hours, right, we see a lot of people who are very attracted to careers in like the Bay Area, at AI companies and the general kind kind of like AI ecosystem, specifically because they like really genuinely want to positively influence the trajectory of AI development. I wonder in this environment, like how much you think, like how optimistic you are that safety focused people can actually succeed at pushing forward what they want to push forward? I think that folks who are working on technical safety work, there are still a lot of opportunities and a lot of support, both like socially, financially, et cetera, professionally, professional ecosystems towards doing that kind of work. I think that there is a well-developed enough ecosystem of AI safety organizations. There's the fact that actually most people who work on capabilities at the labs [25:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=1516) really care that their models are aligned. It's also very hard to sell unaligned models. It sort of coheres with the business incentives of these companies that like you can get made fun of a little bit by like Mark Andreessen in order to do work that you think is really important, really well respected by a lot of other technical people in your community. Like one thing that I sometimes tell folks who are not an AI is like, you know, what's really notable is actually the, a lot of the, a lot of the researchers who have made the most, the biggest breakthroughs in AI, people like, you know, Jeff Hinton are some of the ones who are raising the alarm the most on AI safety being an important thing to work on. And I think that affords working on technical safety quite a lot of status, at least within those technical research communities. [26:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=1560) I think where I start to worry a little bit more is on types of work outside of that core safety work, which is the technical safety work, which is more well-funded. Again, maybe it's just because I'm a journalist, but I think a lot about how much incentive there is for people to go into [26:19](https://realalpha.app/v/kLAawZ9x1nQ/?t=1579) **Jasmine Sun:** these fields that are where, one, I don't think that you can do them inside a lab. So I don't think that you can do especially credible either journalistic work or policy advocacy work if you are employed by a lab. You are going to be seen as a shill. You are sort of correctly seen as a [26:34](https://realalpha.app/v/kLAawZ9x1nQ/?t=1594) shill. You are basically doing marketing and lobbying for that company. And so if you completely 100% align with that company's overall position, then like, okay, great, go do that work because you'll help your firm win. But for the most part, I really wonder and worry about how many positions there are for very AGI-pilled and very safety-concerned people to work in these sort of independent roles. Even the journalism community has sort of appropriated these words to make fun of people who believe in things like existential risk. In the journalism and media world, people will make fun of you if you are seen as an effective altruist, if you are seen as someone who believes in existential risk, if you were seen as, quote unquote, buying into the Doomer hype, like you mentioned, of these AI companies. And so it's actually like kind of low status in journalism to believe in these things. It's low status in the policy community. I mean, Politico, I think last year or the year before, sort of was running these stories, attempting to like weed out and witch hunt anyone who has any connection to effective altruist fellowships within the AI policy community so that people would then go and discredit them. I've had, again, senior media [27:43](https://realalpha.app/v/kLAawZ9x1nQ/?t=1663) people tell me very similar things where they're going after all the Tarbell fellows and saying these people are just anthropic shills or these people are shills for like some crazy Silicon Valley billionaires. And so especially because these are the roles that I already think are less supported, like they are not as well remunerated as roles at the lab. you don't have this like social and professional ecosystem. I tend to worry more so about people who are in academia and research and policy and in journalism who take AI really seriously and whether they are supported to do their work. Let's move on now to talk about another group of people that you've been observing. So you've spent a bunch of time with, I guess, a group of people that you would describe as AI populists. Can you tell us more about who these people are, what their views and motivations are, and so on. Yeah, I've been tracking sort of the general anti-AI backlash and the political backlash in the United States, and I've been curious about that. [28:38](https://realalpha.app/v/kLAawZ9x1nQ/?t=1718) So I made two trips to Washington, D.C. in February and March of this year. And one of my core goals during these trips was to talk to some of these advocates and interest groups who were basically anti-AI advocates in various forms. And I specifically really wanted to talk to folks who are not part of either the industry or the sort of classic AI safety community, but people who are actually coming from other factions and factions within American politics who have only recently begun engaging on AI. And so this includes maybe labor groups who are labor union advocates who are worried about the job stuff. [29:17](https://realalpha.app/v/kLAawZ9x1nQ/?t=1757) This includes maybe social conservatives who are very concerned about AI replacing sort of human relationships with AI companions and AI relationships. It might include environmentalists who are worried about data centers' energy use impacts or states' rights advocates who are worried about things like federal preemption. And so one of the big trends that I've noticed in the U.S. over the last few months is that AI is no longer sort of the remit of these few sort of technocratic, very AI-focused policy wonks who are very concerned with the specific characteristics of AI as a technology. And rather you have all these other interest groups that have long histories in Washington lobbying for this and that, who are now realizing, wait a second, AI intersects with my issue, usually in a way that makes us not like AI very much. [30:04](https://realalpha.app/v/kLAawZ9x1nQ/?t=1804) And now they're actually banding together and forming these, in some cases, bipartisan or like cross-issue coalitions to support things like whether a data center moratorium or fighting preemption or things like that. And that was just like a really interesting trend to see people who, again, probably two years ago, had no clue what an LLM was, to now be focusing so much of their time and political energy on organizing against AI. And so some people have asked, like, why do I call these folks the AI populace? Like, where does that term come from? And I think it comes from me trying to understand the difference between these political factions that are anti-AI versus, say, the AI safety types of researchers who we talked about earlier. And the main thing that I realized was that of these new AI populists, they are not primarily concerned with the technical characteristics of AI that might make it uniquely risky or uniquely dangerous. Rather, they see AI as an extension of a broader concern that they have that a small number of wealthy and powerful corporate elites are concentrating control in society at the cost of everybody else. And so when the AI populists are trying to do things like impose data center moratoriums or regulate AI, it's often less, [31:19](https://realalpha.app/v/kLAawZ9x1nQ/?t=1879) again, about the specific nature of the technology and where it's going, and much more about a broad backlash, a pre-existing populist backlash against billionaires, against tech companies, against corporate concentrations of power that hurt workers and hurt ordinary Americans. Yeah, yeah, yeah. So these people right there, their hatred of AI is like very deeply entrenched and their sort of their distrust of the people who are building it um yeah to the extent where like it doesn't seem to matter to them like how useful chat tpt gets as a tool um you know there's something fundamental about what's going on here that they they feel like like inherently skeptical off um yeah i think that's like interesting interesting. [32:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=1920) Because, you know, based on what we've heard so far about the attitudes of people who are building the technologies, I mean, as we've seen, they're quite varied. But ultimately, we've got a group of people who are aware of the risks, aware that the things that they're building could cause a lot of at least short-term disruption, if not worse, longer-term harms. And they're building it anyway. They maybe have a sort of automate or be automated mindset. and some some group of them maybe a small group even has a belief like technology doesn't even need to serve humans um with all of this kind of stuff in mind i guess it's not wholly surprising to me that like some large part of the public feels pretty mist like distrustful um of this group of people um i'm wondering how much sympathy you have for these views overall um frankly quite a lot i think mainly for the reasons that you just described is like Like, you know, I think that people are correctly assessing that there are some folks in Silicon Valley who are taking a gamble on their futures, whether, and like you said, maybe the gamble is their jobs. [33:11](https://realalpha.app/v/kLAawZ9x1nQ/?t=1991) Maybe the gamble is their literal survival. Maybe the gamble is if they believe that AI is a bubble, it's like a giant economic bubble. It's true that like the AI is propping up American GDP growth, like, and it has been for the last year or so. So I think the St. Louis Fed said that 39% of growth in 2025 came from data centers and AI. And so when people sort of understand that they have no capacity for democratic control or having a voice over the direction of the technology, when the leaders of those technologies are being very open about the risk that they think it's going to pose and saying, hey, we're going to do it anyway, for normal people, they actually have no leverage, right? [33:47](https://realalpha.app/v/kLAawZ9x1nQ/?t=2027) They don't know anyone who works in an AI lab. They can't just tell them like, hey, like you should worry about this. Most policy action has been extremely limited. Most people don't know anyone in AI policy anyway. And so I think that when I see things like data center protests or booing at college graduations or whatever, I don't necessarily think that they're the smartest levers to make AI safer or whatever. But I think that they are the only levers that people feel that they have access to, right? And like, again, like, yeah, maybe Waymo is a little bit safer. Maybe Chachi BD helps me write my emails faster. I think people are willing to cop to those particular things. But when write my emails faster is sort of positioned against this might take my job and kill us all. It just doesn't feel like that good of a trade. [34:37](https://realalpha.app/v/kLAawZ9x1nQ/?t=2077) And yeah, you know, then the AI people will say, but it also might cure cancer. And they'll say, where is the cancer cure? Like, I hear this all the time. It's like the AI CEOs keep talking about curing all diseases. Where are the cures to the diseases, right? At a certain point, you're just not a credible actor anymore. And so I understand why the populist backlash is happening. I would like to see it funneled towards like maybe more what I see as productive policy aims and protesting data centers and booing people at graduations and whatever. But it kind of makes sense to me. Yeah. Yeah. Something else that we're seeing, right? Well, we're already beginning to see these kinds of AI populist type attitudes beginning to escalate. So recently there have been some attacks on Sam Altman's house and also on the house of, I think, a councilman who had just approved a data center project. [35:36](https://realalpha.app/v/kLAawZ9x1nQ/?t=2136) Obviously these things are extremely horrific. Yeah, I think what I wanna know from you is what you think the natural trajectory is for these kinds of attitudes and behaviors. Are you anticipating that AI populism is going to start influencing political campaigns a lot more? Are you sort of envisioning that there'd be some kind of like, I don't know, like Luddite style revolt in which like rather than smashing looms, people are attacking data centers. Like, how do you see this playing out? All of those things seem pretty possible to me. So like in the U.S., we have the midterms this year and we have a big presidential campaign in 2028 where we're expecting both a very crowded Democratic and Republican primary. And one is like, I think that there's going to be a lot of political opportunism, some of it justified and some of which centers AI probably even more than it needs to be. Because I think AI is kind of a perfect political boogeyman also. One interesting thing I noticed is like, while I do believe in a lot of the AI risks being very serious, you also notice that politicians will use AI as a justification for the thing that they already wanted to do. So like for Elizabeth Warren, it's like, oh, [36:49](https://realalpha.app/v/kLAawZ9x1nQ/?t=2209) I want to tax the companies and we should do it because of AI, you know, or for people who wanted to regulate how much kids had access to technology for social conservative reasons. They're like, and we should do it because of AI. And so I'm already seeing some of the candidates who we expect to be running in 2028, whether it's like Mark Kelly or Ro Khanna on the Democratic side, maybe Josh Hawley on the Republican side, they're already sort of announcing these like big, bold AI action plans because they see AI as a new issue that Americans are extremely scared about, And that creates an opportunity for them to define their campaign. [37:23](https://realalpha.app/v/kLAawZ9x1nQ/?t=2243) And so because they're all going to be running these ads and talking about these AI companies, because AI companies are also, like, frankly, not very sympathetic to most Americans right now, I actually expect populist backlash and public salience of AI to increase quite a lot as these campaigns kick into motion. Because politicians have an incentive to talk about AI more in order to justify their policy proposals. The other thing that I think about is these more diffuse and volatile forms of backlash, such as political violence, as we've sort of seen against these actors, such as even things like sort of these witch hunts. [37:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=2278) So like in creative communities among artists and among writers, there are kind of informal cancellation witch hunts against any writer or artist who is suspected of using AI, who partners with an AI company, et cetera, et cetera. One thing that I think about is in, you know, the 20th century, we had a big wave of factory automation where a lot of the factories went from primarily humans on factory lines to humans managing machines more so. And part of the way that this was negotiated, such that there was not a massive backlash and there weren't waves of violence by workers who were being automated, was that these factories were mostly unionized. [38:36](https://realalpha.app/v/kLAawZ9x1nQ/?t=2316) And so when they were mechanized, the people coming with the machines would meet with the union leaders sit down at the bargaining table and say, okay, like, first of all, we're going to pitch this to you as it actually makes your job safer. You guys are really worried about workplace accidents and this is going to reduce that. So it gets at this issue that you guys are really worried about. We're going to actually tie wage increases for workers to the increased productivity of these factories. And also you had just had this new social contract that FDR introduced to introduce like, you know, better working legislation in general. But more importantly, I think that there was a bargaining table and there were these sort of mediating institutions of the unions between the people who were impacted by automation and the people introducing the [39:16](https://realalpha.app/v/kLAawZ9x1nQ/?t=2356) **Jasmine Sun:** automation. One really interesting thing I think about today is that there are no mediating institutions of that form. If you are a white collar worker in most industries, you are not part of any sort of organization that is any sort of union or whatever. And so when your boss [39:37](https://realalpha.app/v/kLAawZ9x1nQ/?t=2377) decides to maybe introduce AI, consider eliminating your job, there's not actually anything that you can do about it. There's not like a particular democratic or collective channel to express how you want AI to be incorporated into your life or your workplace. And I think that means that when people are really pissed off, they start going for social media cancellation and stochastic violence and all these more diffused forms of political backlash. I think I just have a view that like people, public sentiment will find an outlet. And right now, we're just going to see quite a lot of it from very different directions, at least until people feel sort of credibly reassured that they will have the downsides cap, that they will share in the growth that AI gives, etc. [40:19](https://realalpha.app/v/kLAawZ9x1nQ/?t=2419) I guess like a reflection that I have, I mean, besides AI populism contributing to like scary, violent things in the near term, it also seems like potentially longer term, it might kind of be bad overall for AI safety, I guess in a couple of senses. Like one thing that you've mentioned, one effect that you've mentioned, right, is that because AI has kind of become the new, like because China, like politicians kind of using it to push whatever thing they were already trying to push for. Another thing is just like this misguided focus on things like banning data centers, which, you know, I can understand the sort of the fact that that's kind of coming from feeling kind of powerless about what else you can do. [41:11](https://realalpha.app/v/kLAawZ9x1nQ/?t=2471) And then you also have this like very deep lack of belief and trust in the AI company leaders who are saying that the technology is going to be a really big deal and pose like like potentially pose like kind of like life altering transformative effects. Um, I feel like all of these things, um, seem like bad news for the safety, like, like getting, getting like good safety policies in place, um, and making sure things go well. Um, what do you make of that? It seems to me that like the safety community is somewhat divided on this question. Um, I've, I've talked to, yeah, like I've talked to folks on both sides. I'm not quite as much of a policy expert here compared to a lot of folks are. But there are clearly some folks from Future of Life, et cetera, who have actually really leaned into the idea that you can build coalitions and build bridges with some of these AI populists because they have existing networks, they have existing relationships with policymakers, they have bases who they can activate around the issue of AI, where a lot of people were probably never going to quite grok a lot of frontier safety issues, but maybe they could be sort of brought on board through some of these other issues like [42:26](https://realalpha.app/v/kLAawZ9x1nQ/?t=2546) kid safety or the environment that they otherwise cared about. And so there are clearly some folks who think it's a good idea to forge these alliances. I'm also, however, like, I think what you're saying is very compelling. Like, I do think that by making AI a much more mainstream political conversation, and because AI is such a broad-reaching technology with all these different [42:48](https://realalpha.app/v/kLAawZ9x1nQ/?t=2568) **Jasmine Sun:** axes of potential policymaking. It's a real question as to whether the people who are now the most activated around the AI backlash are focused on the set of issues that the experts would prefer, like you said. I think that the fact that the AI water use issue is still as salient [43:05](https://realalpha.app/v/kLAawZ9x1nQ/?t=2585) in conversations as it is, that is something that's an extremely widespread belief among, say, college students, is pretty crazy because I think it would be a total misallocation of legislative energy for us to focus on legislating data center water use, right? And it is true that I think a lot of folks are going to be distracted in an ecosystem where there's limited political capital and limited attention by sort of marginal issues if one believed that some of these frontier safety risks are actually the ones that need to be worked on most. I will say that it's possible that the politics of the issue and the broad politics of the issue can coexist with more precise and technocratic policymaking at the legislative level, especially now that mythos and the Pentagon fiasco have sort of gotten a lot of the... [44:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=2640) policy and expert community much more worried about the existential risk side of things. Yeah. I think another dynamic that we're seeing with AI populism that seems worth unpacking a little bit is that AI companies are just spending like lots and lots of money on things like PR, And yet, somehow, public hostility about AI, populist ideas and so forth are still very much rising. Yeah, what do you think is going wrong here? Is the AI community misunderstanding something fundamentally about its audience? Yeah. I had a conversation about this recently at a roundtable with some of the AI executives. And it seems to me that we are past the point where marketing and nice ads and AI for good stuff can get the public back on board. [45:03](https://realalpha.app/v/kLAawZ9x1nQ/?t=2703) I mean, a huge part of it is just that so much of the messaging coming out of the AI industry for the past five years has been focused on the risks. And so even if we turn around now and say, Sam Altman says, actually, I don't want AI to replace you. I want AI to be a tool. And, like, you know, there are still videos and, like, on-the-record statements from all of these executives about the risks that AI poses. And so people see it as a sort of flip-flopping. And I think the other issue is just that, like, most people are not seeing tremendous benefits from AI in their personal lives. Yes, again, they may be able to write emails faster. [45:41](https://realalpha.app/v/kLAawZ9x1nQ/?t=2741) They may get something that they consider 50% better than having access to Google in terms of, like, looking up little things here and there. But the way that AI shows up in most people's day-to-day lives is also equivalently slop, finding it hard to apply for jobs, finding it hard to review job applications, their kid cheating on all of their homework or maybe having an AI companion that they talk to 24-7. The way that AI shows up in people's day-to-day lives is the median experience is not necessarily that good. And again, most people aren't yet getting the tremendous benefits from something like Cloud Code for software engineers, where they're actually seeing in their own productivity their job get easier, faster, being able to output more. [46:24](https://realalpha.app/v/kLAawZ9x1nQ/?t=2784) And so I think in a world where AI actually has diffused quite a lot, like most people encounter AI quite regularly in their lives, then there's only so much that your marketing can do. Because again, if your marketing's like, we're going to cure cancer eventually, or we're going to go to the moon eventually, and people are just looking at their lives and the way that they use AI in the present, I just don't think that the marketing is that persuasive yet. Mm hmm. Yeah. I mean, this does seem like one way in which the insularity of the AI community is like having an effect. Right. So, I mean, this is not true across the board, but in lots of cases, we've got sort of people who are living together, reading the same books, going to all the same parties, using all the same jargon. [47:10](https://realalpha.app/v/kLAawZ9x1nQ/?t=2830) Um, and I wonder how much you think that's kind of creating a divide with the public or like, yeah, how much that's sort of reinforcing this, this gap that you're observing. I think it's a big part of it. I mean, um, even when you ask people, like, what do they look forward to in the, when AI goes well, what do you look forward to in the post-AGI utopia, right? A lot of folks who I know in San Francisco in the AI research community, they're really excited about UBI and they're really excited about this sort of infinite [47:36](https://realalpha.app/v/kLAawZ9x1nQ/?t=2856) **Jasmine Sun:** leisure point of view. When you test UBI with the public, it's extremely unpopular because most Americans really want to work. They really want to have a job. Maybe they don't want the job to [47:44](https://realalpha.app/v/kLAawZ9x1nQ/?t=2864) be 40 hours a week. Maybe they don't want the job to be this or that. But like fundamentally, people really want to work. Or when you ask people, do you want to live forever? I think it like is actually quite a controversial poll. Like a lot of people don't want to live forever. And so when there's a very, the utopia, that sort of Silicon Valley and they industry is outlining is not actually a very compelling utopia to a lot of the other people in society. And they don't realize that because they are in these very insular communities. Then like even your attempts at positive storytelling don't really land. The other thing that I think about sometimes is that, especially as the companies are going to go public soon, like for the first, you know, five years of these AI labs existence, all the messaging is really focused on recruiting and investors, right? Like you want to get the best technical talent to join your lab, and you want investors to give you a lot of money and take you really seriously. And so you're actually marketing to the end group, right? Even somebody who may not actually, say, care very much about AI safety, an executive might pretend to really care a lot about AI safety because they know that a lot of the researchers do, and they're not going to get [48:45](https://realalpha.app/v/kLAawZ9x1nQ/?t=2925) the best researchers if they don't pretend to care about safety. We saw this with the acquisition of DeepMind into Google. Google made a bunch of promises about an ethics board and AI use in the military. I think arguably a lot of Sam Ullman's communications about safety have this flavor where he knows a lot of the people who are very important to him care about it. And so he's happy to say the words. But when you have people saying words in order to recruit more in-group people, and these words are on the record and they're on Twitter and they're on video, and then they get shared out to the broad public. And it's like, oh man, Sam Ullman says that most people are probably going to be worse off. Or like she says that like there might be like an X percentage a chance that we all die. Then they're like, whoa, what the hell are these guys doing? Like, we're not into that. And so I think that the insularity is also reinforced by some of the market incentives of the first five years of their existence. And so now that the companies are trying to pivot into messaging to the public, it's a much harder task. [49:39](https://realalpha.app/v/kLAawZ9x1nQ/?t=2979) Yeah. Yeah. I'm curious what you think needs to happen to get these groups, i.e. the AI community and the public to, I don't want to say reconcile because they may never get on, may never like sort of agree, but, you know, at least start sort of speaking the same language. I frankly think that at this point, in order to get the public back on board, you're going to need to start giving people real material benefits. Or maybe it does look like the long-awaited cancer cure. I think if people see medical breakthroughs that are actually happening as a result of AI, then they are going to have a much more positive view on things. [50:15](https://realalpha.app/v/kLAawZ9x1nQ/?t=3015) When you look at David Shore's Blue Rose polling, health advances and scientific advances as a result of AI are some of the highest polling things among the public. And so if it also looks like more investment is shifting towards domains that people are really excited about AI being a part of, and those are visible, those are well marketed, then I think that that could also really work. But again, when we talk about scientific and health advances, it can't be these advertisements about plausible future things. I think we actually have to show that we are able to access cheaper or better or whatever it is, whatever cures, treatments, et cetera, as a direct result of the AI companies and their wealth. Yeah, I'm wondering how that view squares up with the phenomenon that you've noted where people, like at least in the sort of AI populist category that you've sketched out, people are so fundamentally mistrustful of the elite groups who are building these things that it kind of doesn't matter to them how useful the tools are. [51:18](https://realalpha.app/v/kLAawZ9x1nQ/?t=3078) Like what needs to happen? Like how did getting these sort of material benefits sort of change their psychology around the mistrust of the elite? In this case, I think that's where like I'm, I think the economic redistribution stuff is actually really important. Like I'm actually not sure that say the health advances alone would do something here because I think the mistrust of the elite is fundamentally based in rising levels of wealth inequality and concerns over affordability and corporate concentration of power in the U.S. in the sense that wage growth hasn't kept up with corporate growth and labor share of income is declining and all of that kind of stuff. And so I think because so many of the populist concerns are wrapped up in economic inequality. [52:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=3120) Unless there is a clear sort of economic benefit, the sharing of the pie in a highly legible way, we're not going to sort of smooth over that set of concerns. Which is why, like, sometimes, like, I'm half joking that, like, you need the big gold Trump check in the mail that says Trump X OpenAI. But I actually think something like that would do quite a lot to persuade people that there was some deal made to share OpenAI wealth or OpenAI equity or OpenAI cash or whatever it is with the public. But, you know, I'm actually like cautiously optimistic about things like, you know, the OpenAI Foundation, if they can be independent from the corporate side of that, the corporate side, and they are able to fund like an incredible amount of public goods, community programs, research, etc. Maybe it'll help. I think they're good people. They're doing their best. [52:52](https://realalpha.app/v/kLAawZ9x1nQ/?t=3172) I want to move on here because you've also spent a lot of time in China where I think public attitudes towards AI at least seem on the surface to be like very different to what they're like in the US. You know, you've got this situation where people's grandparents in nursing homes are just like exuberant users of DeepSeek. And also when you have, I think, some survey results, you can see that in China, most people see more benefit than drawback to AI, which is like a very different picture in the US. How do you explain this contrast? Is what's going on here just some sort of culture of techno-optimism in China at play? I was there for a couple weeks meeting with them, both people in the Chinese AI industry, as well as just other random people around. [53:48](https://realalpha.app/v/kLAawZ9x1nQ/?t=3228) Yeah, so I went for two weeks a little bit ago, and I spent a lot of that time asking people about whether there was an AI backlash, whether people were worried about risks, worried about jobs, all of this kind of thing. And I think my view of it is it's less a techno-optimism than it is a kind of techno-determinist pragmatism. I actually see a lot of the same techno-determinism in China, as I do in Silicon Valley, where there's a sense that progress and modernity has a particular direction. Like, we are always going to see the economy and technology march forward. The CCP has been very clear about the need for technological advancement in order to advance China itself as a country and as an economy to its next stages of growth. And given that, people sort of see it as the only choice you can make to get on board. There's not a culture of protest or a culture of resistance in China. I think that's just part and parcel of being in an authoritarian society where there's a lot of government repression of any contrary speech or any attempt to organize in some form or another. And what that means is just like ordinary people, like when I talk to my family members, the idea of resisting AI or protesting is almost [54:58](https://realalpha.app/v/kLAawZ9x1nQ/?t=3298) unfathomable to them because you're going to get crushed because you know the government is very supportive of AI diffusion. You're not going to win. Second of all, with things like jobs, it's like every, there, China already has a lot of white collar unemployment. It's already a very competitive job market. It's sort of, if I don't use open claw, I'm going to fall off. And somebody else who is using open claw is going to take my spot. And so a lot of the attitudes around AR are just much more practical. There's no choice economically and politically except to get on bored with AI. And so people are more open to it. And I think more open to adopting AI and focus more on the economic value it provides. But I would say that a lot of this does have to do with almost this resignation that there is no choice. Yeah. Interesting. I mean, I wonder how much what you're seeing here tracks the reactions to sort of previous waves for automation in China. I don't know how much you know about this. [56:00](https://realalpha.app/v/kLAawZ9x1nQ/?t=3360) I mean, one example that kind of slightly goes against the grain of what you're saying is that I know there has been some backlash to technology in China. I mean, there was definitely some public scrutiny and reaction to, I believe, delivery driver algorithms some time ago. I know this is just one example. Yeah. Do you have a sense of whether this is the classic trend you see in previous waves of automation in China or if it's a little bit different? Yeah, I mean, I wouldn't say that there's like no dissent or no backlash at all. Like you mentioned, I think like delivery drivers have engaged in some forms of organizing. There were actually protests around robotaxis that were introduced in Wuhan. So Baidu has a robotaxi outfit. They started rolling them out and there are like some like protest light type things. [56:47](https://realalpha.app/v/kLAawZ9x1nQ/?t=3407) I will still say that these are very marginal compared to the level of like public dissent and protest in the U.S. There are many, many, many fewer Chinese people who are willing to engage in these high-risk actions because it is just extremely politically high risk to do so. At the same time, the China scholar, Matt Sheehan, who's been tracking some of the AI regulatory conversation in China really well, he did note that some of he heard in his conversations with the Chinese policy community that the robo-taxi protests were part of what inspired Chinese policymakers to be more active on the labor legislation front in particular. [57:22](https://realalpha.app/v/kLAawZ9x1nQ/?t=3442) **Jasmine Sun:** And so the other thing that I'll say is that the Chinese government, while overall still being a promoter of AI and a promoter of technology very broadly, they are more willing to introduce lots of little pieces of iterative legislation around the potential societal harms of AI. [57:40](https://realalpha.app/v/kLAawZ9x1nQ/?t=3460) So there's a recent court case in Beijing that ruled that firing, it wouldn't count as sort of just cause, basically, to fire a worker because of AI. Or China has also legislated companion chatbots quite aggressively. They obviously have a lot of speech regulations. When I was talking to my aunt, who works at a state-owned enterprise in China, she mentioned, like, yeah, I use Doubao, which is their chatbot, and it can probably do the job of two employees. but like they're not going to lay us off like because there's sort of been a promise to at least the state-owned enterprise workers that we will not lay you off because of ai that's not a good enough reason and so for some people there is also a slight sense of security that the government by being much much more active than the u.s and attempting to regulate ai uses is going to protect people from the worst downsides but overall i think the main thing i would say is just that China has seen a lot of, a lot of both tumult in the last 50 years, but also a lot of progress where, you know, like if you ask a middle-aged or an older Chinese person, they've seen revolutions in their lifetime and they've also seen their standard of living just like [58:51](https://realalpha.app/v/kLAawZ9x1nQ/?t=3531) increase dramatically year on year on year on year. And so, yes, they may not like this or that about AI, but fundamentally there's a sense that this is the way that progress moves and you better get on board or you're going to fall behind. I want to talk now about media coverage of AI because you are someone who works in media and I know that you've observed some effect where in an attempt not to play too much into hype, other media professionals and critics are maybe just not engaging as they should be with the things that advanced AI could do in the future and more speculative things that haven't happened yet. [59:35](https://realalpha.app/v/kLAawZ9x1nQ/?t=3575) I'm wondering what your perspective is on how to report about these things without falling into this trap of generating too much hype. Yeah, it's really interesting. I think that journalists are still trying to figure out how to cover AI because there is this competing skepticism of any large institution and particularly one where they have marketing goals to talk about how. powerful and capable their technologies are, while also being serious about potential future possibilities. I mean, one is like, I do think there's a pretty prominent bias I've observed in the mainstream media to avoid giving almost ever taking the AI companies at their word or taking any claim even about the technology itself at their word. I think a lot of this comes from almost PTSD from the crypto era, where a lot of folks made a lot of promises about how crypto was going to change the world and replace the global financial system. And none of this really materialized and there was a lot of scam and fraud. And so journalists felt burned and frustrated by that such that now, even when I'm writing about AI capabilities, I almost always get a question from my editors that says, but isn't it just marketing? Can they really do that? I'm pretty [1:00:48](https://realalpha.app/v/kLAawZ9x1nQ/?t=3648) sure it's just marketing. You should include a caveat about that. And so I understand the sort of default skeptical role that journalists have to play in society, particularly when the entity on the other side is like a really powerful corporation. But, you know, for me, one is like, you should never just talk to the companies. You should always, like, if you're reporting on the company, sure, ask them what they think about AI progress, but make sure that you also spend a lot of time asking independent experts about the same exact questions. And so when I report on the economics of AI, I interview people at the companies. And I also spent a lot of time talking to actual economists with a wide range of views and other policy professionals. And if there's an issue that actually it looks like a lot of these entities agree on, like for example, like I feel like cyber risk and buyer risk are things that you can find a lot of people both inside and outside of the companies to say like, we're all pretty worried about this. And like, this is a real serious thing that might happen. Then it's probably not hype because a bunch of people who don't have financial incentives to say so are saying it too. And so rather than this sort of, you know, very, [1:01:49](https://realalpha.app/v/kLAawZ9x1nQ/?t=3709) I mean, this is all very simplistic, but like rather than this attitude that if the companies say it, it must be wrong. My request is just like, go talk to some independent experts and see if they also think it's wrong. And if they don't like, you know, like maybe, maybe there's something to it. But I don't know. I think I, I think I basically try to spend quite a lot of time trying to talk to every party or every tribe on an issue when possible. So like I try to talk to both Republicans and Democrats. I try to talk to academia as well as people in the industry as well as people in policy. And anytime I reported an issue, I'll try to make sure I'm like hitting every like stakeholder bucket to avoid a sort of tribalism. And also like I even have like a Claude prompt that I'll use sometime where I feed it a draft of something I've written and I say, do you think that every party that every stakeholder group or every party I've represented and quoted would consider this like a fair interpretation, which fair, again, being different than flattering. I think flattering is super different. But I try to basically make sure that I'm having conversations with and attempting to see my story from every possible side, rather [1:02:57](https://realalpha.app/v/kLAawZ9x1nQ/?t=3777) than just neglecting entirely some of a group of people. Like, again, there are journalists who will not talk to people at a company. There are others who will not talk to some AI skeptic. So, yeah, through this conversation and from reading your sub stack, it does feel like we kind of have unearthed a lot of uncomfortable truths about the AI world. So, yeah, are there any reasons to be hopeful that you want to highlight? I actually think that it's a really great time to be working in and around AI, even and maybe especially if you are concerned with safety, concerned with societal impacts, concerned with some of these broad public issues. [1:03:37](https://realalpha.app/v/kLAawZ9x1nQ/?t=3817) And that's partly because as I've started to engage a little bit more with the policy and the political conversation, it's clear to me that the Overton window in one policy and two actually philanthropy both seem to be expanding extremely quickly. Like literally between my trip to D.C. in early February and late March, I noticed in a month and a half how some of the same people who are saying like. Yeah, I don't think policymakers even, you know, believe that these things are more than stochastic parrots. We're starting to go, oh, it looks like a lot of people in my constituencies in my voter base are really worried about AI. Guess I got to start taking this seriously. [1:04:13](https://realalpha.app/v/kLAawZ9x1nQ/?t=3853) I think that Mythos was a big update. I think that Cloud Code was a big update and Cloud Cowork. I think that for people, for a lot of these more legacy institutions in the policy world or in the philanthropic world or in civil society who have spent kind of years shutting their eyes to the possibility of advanced AI progress, that is starting to fall away. People really are starting to take AI seriously. And what that means is we're actually in this kind of funny scenario where there are a lot more politicians looking for ideas of what to do about AI than we actually have compelling ideas and solutions. [1:04:48](https://realalpha.app/v/kLAawZ9x1nQ/?t=3888) So I think for anyone who wants to work, for example, in AI policy, who is willing to actually branch out and like, say, build relationships with labor groups or like environmentalists or whether it's on the right or the left or whoever, and spend some of the time to get some of these people who are brand new to AI, but who actually really want to do something on it because they believe it's important and they believe it could be politically helpful to actually get some like good, serious ideas in their hands. I just like the number of times that I've had conversations with congressional staffers, very influential people in Congress who are saying like, yeah, like my representative really wants to do something on this. [1:05:23](https://realalpha.app/v/kLAawZ9x1nQ/?t=3923) They're just still in the process of learning what to do. And so I think the potential for impact in policy is really high. And then the second one I mentioned was philanthropy, of course, which I think a lot of folks are aware of. There's tons of money, both individual donations from people who are about to get really wealthy off these IPOs, there's things like the OpenAI Foundation, but also the traditional philanthropic actors, whether Gates or Rockefeller or whatever, all of them are starting to build out their own AI plans. And so there are, you know, billions of dollars in the next couple years that could go towards tackling AI-related issues. [1:05:52](https://realalpha.app/v/kLAawZ9x1nQ/?t=3952) And once again, I think that there is more desire to spend the money than there actually are organizations and solutions to fund. So I think there's a ton of opportunity if you're a young person looking to make your career right now to be working on AI issues. Yeah, awesome. Thank you so much, Jasmine. I think that's all we've got time for, but you've been a pleasure to have on the show. Thank you for coming. Thanks so much for having me. This was fun.