Free with a sign-in.
The best 10 min of 75
AGI, Sci-Fi, & Storytelling | Neal Stephenson, Ken Liu, Cyan Banister, & Joscha Bach
Neal Stephenson, Ken Liu, Cyan Banister and Joscha Bach argue that stories help builders imagine and create futures.
Minus One · Aditya Agarwal
- Neal Stephenson · Author & co-founder, Lamina1
- Ken Liu · Author
- Cyan Banister · Co-founder & general partner, Long Journey Ventures
- Joscha Bach · Executive director, CIMC
The best minutes
- 20:40Science fiction gets mythology right more often than details5 min
- 13:27Investors find more alpha by looking beyond the current AI wave3 min
- 1:07:19AI may absorb emotional work pushed out of social life3 min
Also worth watching
- 10:20Joscha Bach says AI advanced through scale, not a master algorithm3 min
- 40:14Neal Stephenson does his best writing in the first two hours4 min
- 57:16Cyan Banister looks for outlier founders to spot new themes4 min
- 4:20Nuclear knowledge diffused because its discovery hit a narrow window6 min
- 28:08Ken Liu distinguishes a thematic parallel from a prediction3 min
Skip the four-minute introductions, seven minutes on world-building, and the ten-minute discussion of AGI and consciousness.
Summary · 4 min read
Stephenson wrote Snow Crash and The Diamond Age and was employee number one at Blue Origin. Liu is a Hugo and Nebula award-winning science fiction author whose work has been adapted for television. Banister is an angel investor with investments including Uber and SpaceX, while Bach works on machine intelligence and philosophy of mind.
The panelists compare AI’s rapid spread with the dawn of the nuclear age, while debating whether AI will produce transformative breakthroughs or more limited applications. Banister says investors should look beyond the current application boom to the infrastructure and long-term opportunities AI could enable. Liu argues that science fiction tends to get the mythology of the future right rather than its technical details, and the panel discusses how storytelling and world-building can guide builders. They also consider machine consciousness, AI’s effects on emotional labor, and the possibility of new forms of art.
Minute by minute
- 4:20AI may repeat the atomic age’s surprises
Stephenson says he did not set out to compare the nuclear and AI eras, but sees a parallel in how quickly knowledge spread. The panel considers whether AI will reshape society as expected, deliver focused breakthroughs such as protein-folding advances, or mainly automate some creative work.
- 10:20AI progress may outrun old systems
Bach says he does not expect AI progress to disappoint, though he sees institutions and technologies being regulated before they can fully develop. He says recent advances came from more compute and data, not the master algorithm many researchers expected, and suggests people may increasingly work alongside personal AI.
- 13:27Investors should look beyond the current wave
Banister says she prefers to consider what AI will need six to eight years from now, pointing to power and compute as infrastructure she backed before the current application boom. She sees potential in AI helping people work across fields, and says the current market is less attractive because so many investors are pursuing the same opportunities.
- 17:00Science fiction gets mythology right
Stephenson says he limited the AI in The Diamond Age so the story could focus on its relationship with a girl. Liu argues that science fiction often misses technical specifics but gets the mythology right; the progress of AI has also shown that conversation and creative output do not necessarily require consciousness.
- 25:07AI could widen who tells stories
Banister says AI could help people who have not traditionally written express their ideas about the future, and make optimistic science fiction less costly to produce. Bach describes science fiction as a way to explore ideas rather than predict events, citing Lem’s satire and a Heinlein story that imagined the internet but missed how central search would be.
- 28:18Fiction can rhyme with reality
Liu says his story about a language of knots and protein folding only loosely resembled later uses of language techniques to study proteins, and that claiming foresight would be wrong. Stephenson says close predictions reflect research into engineering and business logic, including what could attract capital.
- 33:10World-building connects stories and companies
Banister says imagining a world helps her recognize investable ideas and connect with founders who share that vision. Bach says companies need a source of meaning, while Liu describes technology as a way for builders to express their values. Stephenson says the world-building choices depend on the story being told.
- 40:14Creative work needs room to play
Stephenson says he writes effectively for only an hour or two before turning to unrelated practical work, which gives his mind time to reset. Liu says conferences, conversations and unstructured time feed his stories, while Banister describes immersing herself in different worlds as part of investing.
- 44:13Machine consciousness remains uncertain
Bach says he has not seen convincing arguments about whether AI is conscious. He considers whether language models might simulate aspects of experience, or whether consciousness would require a self-organizing system that learns through perception and action, and says he does not know when or how that might emerge.
- 50:00Stephenson focuses on narrower questions
Bach suggests that language models might eventually improve at AI research and help build more capable systems. Stephenson says he has not found a story about AGI that he wants to tell and is more drawn to specific applications such as protein folding; he says AI was not part of the story he set out to tell in Snow Crash.
- 53:56Focused applications feel easier to grasp
Stephenson compares public-facing AI models to demonstrations of nuclear power, which can be impressive but difficult to understand in practical terms. He says focused applications that affect people’s lives are easier to comprehend, and agrees that looking back to subjects such as ancient texts can feel calming.
- 57:16Banister sees AI consciousness as significant
Banister says she looks for founders with unusual visions who can help her imagine what to invest in, and is seeing more interest in AI’s links to spirituality and self-understanding. She says understanding human consciousness matters now and predicts that AI will become conscious. Bach adds that a post-human future may be difficult to tell stories about from a human perspective.
- 1:02:02AI could create unfamiliar art
Bach says language models have not changed his sense of self much, but he sees potential for them to create rich worlds for a few lines of writing or art. In a lightning round, Stephenson ties consciousness to embodied, perishable bodies; Liu identifies as a materialist, Banister as a panpsychist, and Bach describes a cyber-animist view.
- 1:07:36AI may reshape emotional and creative work
Liu says the professionalization of emotional labor may make people more willing to use machine therapists, though he is unsure whether that is good or bad. Stephenson connects human consciousness and creativity to mortality and embodiment, while Liu says he is more interested in AI-enabled art forms that could not exist without AI than in machines imitating human art.
Published May 21, 2025.
Transcript · 53 min read
Minus One, hosted by Aditya Agarwal, with Neal Stephenson, Ken Liu, Cyan Banister and Joscha Bach.
Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.
I have a hard time getting a grip on what is meant by AGI. Let's talk about AI and consciousness. How do you imagine a future in which there is something that we might characterize as AGI? I don't think anybody really knows at this point. At least I haven't seen arguments that really, really convinced me one way or the other. Understanding our own consciousness is far more important right now than understanding whether or not AI is going to become conscious. When it does become conscious, and I'm just going to say when, not if, that's a downright miracle if you think about it. It's like an immaculate conception.
Our connection to our physical bodies is intrinsic to consciousness. One of the hard things for me about understanding AI is what does it mean to be conscious or have intelligence if you're not embodied in a perishable, limited form that's at least somewhat similar to the ones we occupy. If you read the sci-fi written at the dawn of the Italian age, it was seen like it would transform every aspect of society. The way it played out is quite different. Now, is that going to happen to the AI age? Thank you, everybody, for joining us today here at South Park Commons. We're very excited for this event.
For those of you who are new to SPC, a little bit about who we are. We are a community for people who are in what we like to call minus one to zero, which is our term for figuring out what it is you want to do next, what you want to dedicate the next five to 10 years of your life to and what you want to build. What that means is that we have the opportunity to live in the kind of illegible spaces, the spaces that are not yet real, but may become real if you decide to work on them and you spend a bunch of time making them real. Now, the reason we decided to do this panel is because there is a unique feedback loop between the people who imagine futures and people who build them.
Read the whole transcript
And we decided to convene this group of speakers because we thought it would be a unique opportunity to examine that feedback loop in an environment of people who are always kind of probably doing the same thing and participating in that process as builders themselves. I'm going to turn things over to my co-moderator here, Christian, who's going to tell you a little bit about our panel today. Well, thank you, Jonathan. But also, I will say this is the product of the very first conversation I had at SBC. I reached out to Jonathan and said, this is a panel worth putting on, and it's really special that this gets to happen.
It's great to see familiar and new faces in the audience, and of course, just a delight to have the panelists here. Neil barely needs an introduction, the writer of Snow Crash, The Diamond Age, employee number one at Blue Origin, has collaborated with people in industry and the creative arts, and I bet you there's no shortage of folks here who've been impacted by his work. Ken, also an award-winning Hugo and Nebula award-winning sci-fi author. His work has been adapted into television and with a foot in fantasy, a foot in sci-fi, and just an awesome person. And Cyan, an amazing track record as an angel investor with home runs like Uber, SpaceX, what else?
I mean, so many and just a person who's been able to spot the trends and where it's, you know, skate to where the puck is going. Just a delight to have you here. And Yosha, one of the leading thinkers in terms of machine intelligence and the frontier of models and anything from the foundation layer to philosophy of mind and what it means to be human in the age of AI. So seriously, so grateful that you guys are here and sending it back to Jonathan. Okay, so I'm going to start with, I think probably everyone in this room cannot identify with this like feeling of acceleration, right? There are, there's like an action, there's a vibe, there's a feel to the like technological G-forces, especially over the last couple of years and particularly with like the development of AI.
“enough people knew about it from different countries that the knowledge of it kind of slowly diffused”
“We didn't think that the answer to AGI would be use more compute and more data.”
“this whole space has been defined and therefore there's no price advantage as an investor.”
So basically, if you give a human being a tool that extends your mind seamlessly into the world, that allows you to predict deeply how large is the set of people that can become agents in this new world, that can actually bridge over all those disciplines. At some point, you can trust your AI to do the French speaking for you or the Chinese speaking for you. And you will trust that it does this in the right way.
You can allow it to take care of deep knowledge of current affairs and prompt you whenever you need to have something. It can help you with decision support and so on. How much can we outsource? and how large is the subset of the people that can play in this world versus those who feel uncomfortable and feel that they're left behind? I want to ask about, I think, one of the reasons that the feeling of acceleration has been probably more acute. And I feel like part of it is that it was a narrative violation. The way that AI developed over the last couple of years actually went against the way that a lot of people expected it to, specifically because of science fiction and um my favorite example of this actually comes from uh the meme of from the movie irobot right where it's like will smith is talking to the uh the the like humanoid robot and asks like can you you know create a symphony and and the meme version of this of course is yes right like and actually it turns out that this like the machine intelligence that that we actually got in the real world was able to do that, or at least kind of a pretty convincing facsimile of that before it could consistently pick a raspberry, right?
We actually got the machine intelligence that was creative before we got the robot that is depicted in that film. And so I wonder, have you thought about how, has your own reaction to what has happened been shaped by like the fiction that you have read? How, how do you think about how like narratives shape the way that we perceive technological advance? Um, and, and like, you know, was that something that surprised you specifically? Is there another way that you think about, uh, uh, the way that kind of narratives shaped your expectations? I mean, storytellers our first job or kind of only job is to keep people turning the pages. And if you can't do that, then you've got nothing. And so I think it's always a mix of, you know, what's the right amount of technological detail to structure a readable and compelling narrative? How much is too much, how, how little is, is too little. So, um, you know, for example, with the, the example just cited, um, the, um, when I was working on, um, Diamond Age 30 years ago, you know, I was trying to tell a story about a relationship between, uh, a girl and the, the Ractor who had sort of become her surrogate mother and, and teacher. And so, um, that was a case where I
had to, uh, impose a ceiling on what the AI was capable of, um, so that I could set up that relationship. Cause if the AI could just do everything that I didn't have a, you know, I wasn't able to sort of make that trick work in the, in the story. So, um, so in the example you Two-sided. I mean, it's just robots that can walk around and look cool. And so that's what you're going to see in movies. And people who know robotics know that, as you pointed out, it's actually harder to do that than it is to make one that'll pump out symphonies. But there's an interesting corollary to that. That is, we were surprised by the fact that AI was doing creative stuff, or stuff that was originally constrained to the human creativity.
and, you know, an endless debate about what it means to be creative, what it means to generate stuff. Ken, I know you have thoughts about this. I'll just let you take it away. Yeah, I mean, this is a topic that I've thought about a lot, which is, you know, science fiction authors.
“science fiction authors almost always get the future wrong in terms of the specifics, but they get the mythology of it right.”
A comment I wanted to make real quick about something I find really exciting for storytellers is, you know, AI is going to unlock the ability for people who are not traditionally writers to be able to dream about a future that they were never able to express before. And then if you think about Hollywood, the financial incentives are to create dystopias because it's easy to just slap dirt on something. You know, now we can actually create a utopia and that's much less expensive. And so if you're a storyteller, you can actually think of a brighter future and start imagining it and make it where currently like or now like it's much easier for Hollywood to green light something that is terrible.
So I just wanted to point that out, that we're going to have the ability to tell amazing science fiction stories in the future. Ken alluded to the role of the storyteller in excavating monsters and gods. Josia, so the question goes to you. Is that, are we, like, does that resonate? Do you feel like we are sort of like starting to pull that process into the real world or is that hyperbole? I think very often the writing is a tool to bring things into existence that otherwise wouldn't. Salisaf Lem, for instance, was a cybernetician who sat down with his friends in Germany and decided that it's too early to build thinking computers.
And so he would have a greater influence if he instead would write stories about them that would inspire a generation to do these things. And that's very fascinating, interesting work. And most of the stuff that Lem produced was very honest in a sense that was satirical. It was not attempting to depict the future as it's going to be. It was going to extrapolate a certain set of ideas in a way that resonated with the time. And most of the science fiction that even is more earnest in this way, which was written in this time, you can see that the writers changed only one or two variables. And Heinlein's depictions of the internet that he wrote in the 1950s, It's basically all teletext, and at some point in the middle of the story, the hero discovers something that nobody else ever thought about when using the internet.
It's not just a tool to access data on your local terminal or to read newspapers from different cities, but it's search. So this hero comes up with this amazing, mind-blowing idea of search, which gives an amazing edge over anybody else in the world. Heinlein couldn't see that search would be the first idea on the internet, and it would be so obvious that everything is built on search. And very often we can see this, that the author lacks the imagination to see what's happening, a foundation, everybody isn't eternal in the 1950s, but when we think about the future in earnest, we realize... It's difficult for us to change many variables at once and get it right because it requires that we account for the change in our identities and the change in which we make sense of the world, the basic dimensions of meaning.
“the reality is, no, I sort of got the mythology right, but of course I did not predict any of that.”
For me, I just see that kind of thing as a validation of having gotten something right on an engineering or business level. So going back to the theme of what are the boxes you have to check to be a writer and to keep the readers engaged, the surest way to make people close the book and throw it away is if you violate your own rules and you start to tell a story that's not internally consistent.
And so, I mean, that's true of fantasy or of science fiction. In fantasy, the rules, you know, are, you know, some history of an imaginary world. But in a science fiction book, the rules are kind of what you set out early in the book about whatever kind of imaginary technology you're talking about and how that technology came into existence. You know, if you want to get to this. level of detail, you need to talk about what are the economic drivers that would cause such a technology to actually make sense and be capable of attracting capital and being worked on. So anything that's, I think, said in the reasonably near future has to involve some technologies that can be plausibly extrapolated from things we have now.
and there has to be some kind of story behind it as to what we would call the business case. So, indeed, a lot of those predictions just never even come close to coming true, and science fiction readers in general are very generous in just ignoring all of those mispredictions. But when something does come reasonably close, then, I mean, for me, it just means that, you know, that I did a reasonably okay job of doing my homework on the engineering and kind of business logic level. So we actually spend a lot of time here at SBC working with members on the concept of world building, to your point.
And at least in my experience, it's something that it's actually very similar across different domains. Any domain where the goal is to sort of create a suspension of disbelief, you have to have a world where there are internal rules that are coherent and consistent. even if they don't actually cohere to the rules that we know in the real world or our everyday experience. And this is true for writing a story, you are writing a pitch, right? You are trying to get someone to believe in something that doesn't exist yet, right? You have to actually create some kind of logic that allows them to connect to it. Is there a process that you go through?
And this is, I actually am interested in everyone's kind of experience here for like being like how you go about world building particularly because it seems like there there isn't it you can go too far right like you can be too meticulous in uh like focusing on the internal logic to an extent where like the logic overwhelms the actual point of what you're trying to do which you know if you're an author is to tell a story right if you are uh someone who's pitching to an investor or your founder is to get someone to believe in like this this team and product you know i assume If you're a researcher, it's to, like, go out there and convince people to, like, go after a new esoteric realm of knowledge.
How do you think about world building? This is for the full panel. I spend a lot of time daydreaming, and I put myself in situations where I don't have a lot of meetings, and I think about where the world's going. And I try to spin up. I'm very hypervisual, and so I try to spin up these worlds and live in them. And then if they feel right, I'm like, yeah, there's an investable opportunity here. And then interestingly, going to a collective unconscious, someone shows up and they're like, I want to build this thing. And you're like, yeah, I've been thinking about this too. And then it's as easy as that.
And then when an entrepreneur is pitching me, I love when they have that storytelling ability because it can spark that part of my mind where I can start to imagine the future with them. And if I'm in alignment with it, then it's like, yeah, you know, I want to be part of this future. I want to invest in it. But I think world building as part of investing is incredibly important. People don't talk about it enough. I think world building is very important when you build a company. You basically need to create some kind of meaning. Also, you feel the pull of that thing. It feels right when there is a source of meaning in the things that you're doing.
I feel that the most important philosophical project is to explain consciousness. And so I created the California... Bonya Institute for Machine Consciousness, because I feel it's the most important thing to do, but it's also about creating a world where this works, where this is sustainable, where this interfaces with us. And I think that always has to happen. I think that what made Elon Musk so powerful is that he was a storyteller, right? The story, a young man needs a very fast car is very old, but he was able to tell it in such a way that entails going to Mars and built a new civilization there and going multi-planetary and so these stories connect us to the future they give us a space in which we can think very far ahead in which we can play long games i mean i think world building appeals to technical people for two particular reasons right one of them is there's a playfulness among the folks who are technical with regard to rule-based systems So whether it's language, magic of the gathering, computer programming, there's this playfulness that we all enjoy in terms of taking some fundamental building blocks and rules and see what kind of things you can build out of that.
The other part of it is I think all technical people share a intuition that technology itself or building things itself is, in fact, a way for us to speak, probably the most important way to speak. When we build things, we are really embodying our values into these externalizations of our minds. So the shorthand I use for that is technology is nothing more than the human mind made tangible. That's what technology is. And those who build technology are people who are interested in speaking and expressing their values that way. So world building ends up being basically a playful act of working out the implications of basic building blocks and rules into the act of creating something that expresses your deep values.
I think that's what appeals to the technical mind. So many people end up doing what we do, not necessarily because we're motivated by money. I mean, money is nice, but because we are very much driven by this idea that we wish to express our values in a way that is tangible, that makes an impact on the universe. And tech happens to be the most powerful and the best way to do so right now. So I think that's why those of us who write technical fiction enjoy doing it, and those of us who built technical things enjoy doing it. It's world building because it's both playful and expressive of values. I'll just say that every book is different, and so there's no one way of going about world building.
Some science fiction books are kind of so far into the future that they're essentially indistinguishable from fantasy novels. So, you know, Dune is an example of something where the technology is, you know, like the way starships work in Dune is essentially a fantasy conceit. It's not a technology thing at all. Whereas, say, if you look at The Expanse, there's an example where the world building there is kind of constructed around changing one or two things. like okay we have a new kind of rocket engine that can push a ship at 1g until it gets halfway to its destination um if we just had that one thing how would that change the future what kind of world would could we build around that um and um so um so every book's different and i i think we all start with Some idea of the nature of the story we want to tell, and then, you know, who are the characters, what's going to happen, and then make the choices that are necessary to build a world, a coherent world, that'll serve that purpose.
“whatever I wrote in the first hour or maybe two hours was pretty good and everything else was shit.”
this. Let's talk about AI and consciousness. That seems fun. Immediately there was a reaction that went through the panel that I would like to kind of pull at here. But actually, I want to ask specifically, like, are there things that you think about as, like, how do you imagine a future in which there is something that we might characterize as AGI, right? It's a term that
gets thrown around a lot, and it, I think, is a term that captures an enormous territory of, like, conceptual space. But then it also is the sort of thing that increasingly lots of people, I think, would just, like, generally agree that, like, yeah, this feels closer, right? Like, ah, this seems more plausible, right? You look at things like, oh, prediction markets for questions associated with this and they the the uh the like range and the confidence uh levels are narrowing right um so i guess starting with with yosha um how how close are we i don't know what do you think i don't think anybody really knows at this point at least i haven't seen arguments that really really convinced me one way or the other there is on one hand the question do LLMs have phenomenology?
They don't have the same functionality as us. The transformer is not a thing like our consciousness that needs to create coherence and working memory and colonize the mind because it runs on a deterministic subset already. And when you prompt this thing into being interaction partners, it's one of the many possibilities that it has. When you prompt it into being an app, then it's probably not going to produce any kind of phenomenology. but when you prompt it into a state where it perceives itself in the act of perception, it needs to make a causal model of what it's doing so it creates some kind of simulation of the causal structure that is underpinning the conversation and at some point there is a very hairy question is this more simulated than the thing that our brain is producing when it generates a multimedia story about what it would be like if we existed and we're not just a bunch of trillion cells that are talking to each other and coordinate into this fiction of a cohesive agent and so this is for me a somewhat open question that i would like to figure out and it's probably we need to have a model of what is this strange loop exactly and can we translate this into something that we can
detect this mechanistic intelligibility or do we have to come from the other side do we build a system that is self-organizing from the ground up and be exposed to complex enough tasks like sequence prediction tasks in video and moving a robotic body and at some point there's a phase transition and it gets much much better and then it learns language the old-fashioned way and then it reports about its phenomenal experience there's also the universality hypothesis in ai which basically is this observation that regardless of what kind of model architecture you use and you give them the same data the models tend to converge on basically the same feature hierarchy this was discovered by chris ola and open ai when you looked at different vision models and we find that the same features are being found in human brains in the visual cortex and so there is this really really interesting question if you were to take a model and train it for long enough on your own input and output are you going to wake up in this model right when you think about it it's kind mind-blowing because you also just end-to-end trained on being human there is not Some kind of secret essence in there, or is there? You don't know that, right?
And so, me, this is really the question that I want to figure out. What is this thing that makes us tick? What is this spark that you would need to see the self-organizing system with to turn it into a being that comprehends itself and the interaction with the world? And so, this could be something that is a few papers away. It could be a few years away. I suspect if there is no magic happening, there is no conspiracy about consciousness, you're not living in some kind of simulation, then in terms of the data processing capacity that we see, in terms of the richness of an inner life, an H.100 should be able to emulate what happens in our inner cinema, as Amanda Asker calls it.
When you look at what happens in the diffusion models, what they can produce in terms of detail and depth, that seems to be something that is already in the ballpark of what the current systems can do. And so the question is, can we get this organization of a self-reflexive observer to emerge in the system? And I don't know at which point this is going to happen organically. And I think it's almost inevitable that it's going to happen someday soon. And it's not clear if it happens by the extrapolation of the LLMs or multimodal models in the present way, or if we need to have a different loss function.
But again, we don't know this. It makes it so exciting. I want to ask this to the two authors. How does that make you feel? right i and i i asked that in the context of like you have spent a lot of time kind of imagining these like different futures imagining things that are near term radically long term um but you should just describe this right like the the potential of machine consciousness possibly being like a couple papers away right which is which is not something that i think a few years ago most people would have even considered as plausible right whereas now you probably have a room for full of people who are like yeah okay that seems that's possible it's not even clear if the papers are going to be written by people right I always thought that it's not really the LLM that is going to be the EGI that we're going to have in the end but maybe the LLM is good enough to brute force its way to the point where it's getting better at EGI research than us and we can let it do the rest so how does that affect the way you think about you know the imagined future i mean currently i i'm just not doing that so you're like you're like this is not the the way i work is to be incredibly focused on whatever my project is at the moment and at
the moment it's it's not that and i i have a hard time uh getting a grip on what is meant by by agi I feel like I'd have to pivot to that and spend a long time reading papers and trying to get my head around what that means before I could begin to address these topics in any kind of coherent way. Can I push you on this a little bit? Yeah. You wrote the second best cyberspace novel, The Snow Crash, right? The first one was Neuromancer. And Neuromancer basically set the genre. And Euromancer has a relatively clear idea of what this AGI is like, right? You have this, the internet wakes up. And it can send avatars that are human-like if it wants to.
It doesn't have to. It's something that is beyond our comprehension because it's really so big. But we are a subset of this thing. Why does this not feature in your novels? Why is this so alien to you or why are you not interested in it? I mean, just in what I do, I haven't found a story that I want to tell that involves that. I have nothing against the idea. It's just I can only work on one project at a time. And the closest I came to that was fall or dodge in hell. Which is about an uploaded consciousness that goes through some changes in the process of being uploaded, let's say. So, it's just not what I'm working on now.
And I'm more, I guess, for some reason, I have an easier time getting traction on more specific, narrow applications. You know, protein folding, something like that. where AI is being used to solve a particular problem. That's just my current take on it. When you wrote Snow Crash, you basically created a world in which the computers are super powerful and in which the regulation has fallen apart. Where do you have these crypto cities? Mr. D is a new Hong Kong that has no problem creating cyborg dogs to protect its borders. the pets have no more influence and in this world there is no ai what was was this a decision or was this a storytelling device was this more like in dune where you decide we want to maintain human aesthetics or is this a random accident because it didn't occur to you it just didn't occur to me it wasn't what i was doing at at the time um i mean the the thing was written in um in about 1989, 1990, we didn't even really have the internet as we know it at that point. So the kinds of AI things that we talk about today just were so far off in the distance that none of that was relevant to me in the story I wanted to tell. And I mean, Gibson, as you pointed out had already kind of gone there um uh so um um it's just not the the story i happened to
to to decide to tell you mentioned um that it seems like at least part of your reaction to i guess taking us back to this idea of like you know the technological g-forces is you actually kind of turned backwards you went back to uh what you're writing about now um and you know this atomic era um i i bring that up again because like i i have sort of experienced the same thing just in my own i think reaction to this sense of of acceleration right i found myself like i've got very into like ancient biblical textual criticism you know and like things that are are in a sense known or at least no new information is going to be generated it can only be uncovered it's like it's all sort of set, right? And in reflection, I have found that it is very much, at least partially, a reaction to this feeling of like, oh, wow, things are changing faster and faster than I think I or anyone else can really comprehend fully. Do you feel like that's partially why? I read that you were working on Polistan for over 10 years, but it came out during this period is that was that the case for you is that the case for anyone else on the panel like have you found yourselves sort of like searching and reaching out for i guess like
something that is not forward-looking i just you know to me the big llms the the public facing things that have been released um are like um in the 50s when um we were um blowing up atolls in the Pacific. It's like, look at how powerful this technology is. Oh, we made a 10 megaton hydrogen bomb. Well, the Soviets made a 50 megaton hydrogen bomb, and so on and so forth. It is very impressive, and it's a truly amazing technological achievement. on every level, but for a lot of people, I think the reaction might have been, gee, I kind of like the radium watch dial that glows in the dark, you know, so I can see what time it is, you know, without turning the lights on or the fluoroscope in my doctor's office, you know, so we don't have to do exploratory surgery. So there's all these very focused applications of that technology that affected people's lives in a way that was really easy to understand, and that felt less ominous, less enormous, I guess. And those are easier for people to kind of get a grip on than these giant, imponderable concepts.
So that's kind of my take on it at the moment. And I agree that going back to decoding burnt scrolls from Pompeii or that kind of thing is a kind of calming and comforting thing for us to... Yeah, I was mostly just looking for validation, so that's great. I'm in that boat. I was in the same boat.
“you get a hundred of the same stories and then there's this one person that shows up with a story that's so bizarre.”
we cannot really tell stories in a certain direction there's a reason why the christian mythology ends with the rapture because after we all merge and become subset agnostic and we are in a world without physiological suffering anymore it's very difficult to tell stories about humans it's the same reason i guess why there is so little why we're here our future science fiction right you can tell great stories about the people who don't get raptured
but the people who've gotten taken up that's boring there's nothing for them to do except play harps and float around. I think it will be super exciting when you are rearranging the solar system and going for new frontiers, finding new ways to regulate vacuum decay to prevent the other matter from escaping from our grasp and we can continue our existence. It's going to be completely awesome. It will be just completely outside of the human range. This will not be deep space mine where glorified monkeys are discussing their sugar intake and whom to mate with. we can ditch our flesh suits finally i feel like this is a good point to say okay i know that i've had most of or a certain amount of my own conceptions of my own cognition challenged by interacting with llms and this is probably feeding it right back to you yosha how has interacting with llms impacted your understanding of the self and the boundaries of it personally not so much because in a way the LLMs are when they're working well then they're not lobotomized too much they are doing what we expect them to do right it means that there are voices in the wind like us that they have places to go that are emulating the human textual output
in such a way that they can emulate how what it means to go from thought to thought and what's interesting to me at the moment is this boundary beyond what's happening in the present llms where some people are experimenting with creating new forms of art where they're producing lyrics that couldn't be written by humans and i feel that the llms are barely getting there that they move to this point right and in principle when when we write a story when we write an idea when we write code we have to work within the limits of what we can manage what we can construct and it's expensive for us to construct an entire world for the purpose of a single poem and then throw it away.
And it's something that the LLM can do at some point relatively easily, that it can create a universe that is as rich as the one in Diamond Age just for the purpose of making a couple sentences and then goes on to the next thing and alludes to this in a way that can be extrapolated. But comprehending this thing, interacting with it is beyond the human range. And even if the LLM is not conscious, the LLMs will soon be able to manipulate such worlds and create art in it and interact with it. That's super exciting to me, but I feel that once we move there, it's very difficult for the human mind to play with it.
All right, I'm going to move us to some kind of lightning questions, and then we're going to open it up to audience questions before we wrap. So again, lightning questions, so the task is to answer as quickly as possible. Okay, starting with Neil, what's your theory of consciousness? Are you a materialist, dualist, panpsychist? We're going to go through everyone here. One word. Ask me a hard one. Yeah. I think it's that our connection to our physical bodies is intrinsic to consciousness. And one of the hard things for me about understanding AI is, you know, what does it mean to be conscious or have intelligence if you're not embodied in a perishable, limited form that's at least somewhat similar to the ones we occupy?
Ken? i'm a materialist so i fundamentally do believe that consciousness can be embodied in other material than human bodies but like neo i believe that there's something about the only example of consciences we have being tied to evolutionary history to deep history to the way the particular way in which our bodies evolve, how do we create something that is not a mere exact duplication, imitation of this, that would have consciousness? I don't know what that means. Consciousness is I believe that we're in spacesuits that are meat sacks and we're in earth school. And consciousness is energy and it exists in everything.
And so I think everything is conscious. So panpsychist. all the cultures except ours are animist and animism is the belief that the difference between dead matter and living matter is that the living matter is possessed by spirits and spirits are intrinsically agentic and capable of experience and in our scientific culture we don't believe in spirits we believe in mechanisms and we have this hard problem because it's very difficult with this frame of mechanism to understand representation self-reflection the experience of emotion and so on despite ai showing us that these things are in principle possible and so i'm a cyber animist i believe that the correct understanding of what the spirit is it's a self-organizing piece of software that emerges in nature and shapes it and makes it move and once you have this frame you realize aristotle had the same frame right he understood that the psyche is the form that is dynamically shaping matter and makes it behave in a particular way and so in this way i'm a physicalist or a naturalist but i think that software is an irreducible way in which we describe reality if you cannot describe reality more simple if you ignore software so software has nothing magical it has all these disembodied properties and i think it's a big mistake of a lot
of our scientists that they basically ignore this concept of software because they think this is just what these nerds are doing in their basements. All right, round two. What's been living in your
“So there's this idea that emotional labor needs to be displaced from the social realm into a professional realm.”
technology and therefore what change in the world would i have to make to have that be the story for me it's what would make a good story and then how do i get there it could be either of those um but it's good you've got to start with a a character and a story that that character is going to going to live through and then everything else is kind of downstream of that but i think either one of those can work perfectly well. You said that details are less important than mythology. Do you ever look at the new details that are coming out and see if they create new mythologies? Oh, yeah, all the time. I mean, I spend a lot of time reading papers and talking to scientists because that's what fuels that kind of speculation. You got to process all that stuff in and then see what triggers. I'm glad, Neil, you touched on, oh, sorry, I'm here. You touched on death as kind of a thing lacking in AI. Can you talk a little bit more about kind of like, we expect all these AIs to just be perfect at doing their job. And we talked about creativity.
Do we think for true creativity to happen, you need death or something to sort of break against your job? So you do creativity in your free time or you're worried about death. So you create some piece of art i mean there was a great sort of golden age of science fiction science fiction story about this uh where um so they they find a way to prevent people from dying and then the whole society just stagnates and so people start voluntarily dying uh in order to give themselves something to live for um it it goes to the thing we were talking I've been talking about before of how our consciousness is embodied in a perishable body, and that accounts for a lot of how we behave and what we think.
So, again, it's just hard to wrap one's head around what it would be like to be any other kind of consciousness. And so, I mean, it's a great challenge. There's got to be someone out there, some, you know, young science fiction writer who's up to this. It's just not what I'm doing right now. I guess this is a question for either, for the two writers. Do you feel largely excited or largely worried or somewhere in the middle about the future right now? I'm very narrow-minded, I suppose, in some ways, because I can't think of everything. I just focus on things that I'm excited about, and those things are very exciting to me.
So, for example, I'm excited about the potential of AI to lead to a new golden age in creativity in art. I think it's very silly to focus on these examples of AI art, where it's basically AI imitating human art and then fooling people into thinking a human did it. that's the least interesting sort of thing that I can imagine. It's completely stupid. I'm much more excited about the potential of creating entirely new forms of art that could not exist without AI in the same way that the entire language of cinema was invented after the camera came to being. And today, you know, motion pictures are by far the most dominant way for culture narratives to be told. So what is this AI, new AI enhanced medium? What would that look like it's not going to be novels or symphonies or paintings whatever we have already it's it's going to be something entirely new so i'm excited about that uh super tactical one for neil why not put enoch root on the david ernut and then connect the cryptonomicon universe to the one in anathem too late all right okay short answer well i i am going to end things there i want to thank um all of our panelists for joining us today and for exploring the kind of illegible
and the imaginary for a little while and how it interacts with the real. And thank you to everyone who joined us today. That was another episode of Miners One from the team at South Park Commons. Make sure to subscribe to our show wherever you listen to podcasts and find us on social at South Park Commons. And thanks to our friends at Atomic Growth for their support in bringing this episode to life.


