Human agency must remain central as AI advances

Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

1. 20:51

   So my last question here is about human capital. So superintelligence has been called the last invention humanity will ever make. As it could automate eventually every process, we'll see if it automates discovery, we'll see how much of creation automates, but in a world where the Strategy, science, and economic decisions are being made by machines at some point. What is the ultimate irreplaceable function of human intellect and leadership?

2. 21:23

   What are humans innately going to be left with in 10, 20 years? Well, in 20 years, we will enjoy watching each other compete in human sports, knowing that the robots can beat us 100% of the time. but if you go to formula one you're going to want to see a human driver not an automated car yes so humans will always be interested in what other humans can do and we'll have our own contests and perhaps the supercomputers will have their own contests too but the your reasoning presumes many many things it presumes a breakout of intelligence in computers that's human-like unlikely probably be a different kind of intelligence. It presumes that humans are largely not involved in that process, highly unlikely. All of the evidence, and Fei-Fei said this very well, is going to be human and computer interaction, that basically we will all have savants. Going back to what you said about

3. 22:26

   eight billion people with smartphones with Einstein on their phone, the smart people, of which there's a lot, will use that to make themselves more productive. The wind will be teeming between a human and their judgment and a supercomputer and what they can think. And remember that there is a limit to this craze, that supercomputers and superintelligence need energy. So perhaps what will happen at some point is the supercomputers will say, huh, we need more energy, and these humans are not building fusion fast enough. So we'll accelerate. It will come up with a new form of energy. Now, this is science fiction, but you could imagine at some point the objective function of the system says, what do I need? I need more chips or more energy, and I'll design it myself. Now, that would be a great moment to see.

4. 23:18

   I do want to say it's so important as we talk about AGI and ASI that the most important thing that we keep in mind is human dignity and human agency our world unless we are going to wipe out the species which we're not has to be human-centered whether it's automation or collaboration It needs to put human agency and dignity and human well-being in the center of all this, whether it's technology, business, product, policy, or any of that.

5. 23:51

   And I think we cannot lose our focus from that. Amen. Everybody, ladies and gentlemen, Fei-Fei Li, Eric Schmidt, thank you all. Thank you.