Real Alpha
Try Pro free

Silicon Valley Girl · 4 min · Oct 13, 2026

AI risks include connected systems and unequal access

James Manyika · Senior vice president of research, labs, technology & society, Google

James Manyika says model-by-model tests can miss risks in connected infrastructure, such as AI managing electricity grids.

In this episode

Full analysis
  1. 0:45AI is changing jobs faster than it is eliminating them8 min
  2. 11:43AI productivity does not guarantee higher wages3 min
  3. 27:27AI is already supporting cancer detection and flood warnings6 min
  4. 44:18Safety work needs to keep pace with AI capabilities3 min
  5. 47:57AI risks include connected systems and unequal access4 min
Up next · MTSCustomer demand convinced Daytona to pivot to agentsPro pick 2:45
“I think often we think about AI models in isolation, but keep in mind that we're now connecting these systems”
James Manyikaat 48:23 · Silicon Valley Girl
48:23

Takeaways

  1. AI-linked grids and infrastructure raise security and safety questions.
  2. Assess connected systems, not only individual models.
  3. Limited access can keep communities from AI's potential benefits.

About this segment

James Manyika says model-by-model tests can miss risks in connected infrastructure, such as AI managing electricity grids. He also recounts concerns that communities may lose out if useful AI never reaches them.

James Manyika

James Manyika is a Senior Vice President of Research, Labs, Technology, and Society at Google.

Leads Google and Alphabet’s efforts to responsibly shape ambitious innovations for the benefit of people and society.

  • Marina Mogilko, Host · Host, Silicon Valley Girl

    Co-founded LinguaTrip and built Linguamarina, an English-learning YouTube channel with almost 9M subscribers.

From “Top Google Exec: AI Moves Fast, Jobs Move Slow. Use the Gap”, Oct 13, 2026. Watch the full episode

Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

  1. 48:08

    We're talking a lot about 10% chance of destroying humanity. That I've heard so many times in the past few weeks. We're talking about systems escaping. Is there anything else we're not talking about enough? We're trying to spend a lot of time thinking about this. I think one of the things we don't spend enough time on is, just at least in the public dialogue, is in how these systems are now interconnected with so many other systems.

  2. 48:35

    I think often we think about AI models in isolation, but keep in mind that we're now connecting these systems, I mean, for useful, good reasons, to grids and other things and other systems. I think there's so much benefit from that. For example, if we're able to manage grids more efficiently, manage electricity, manage more efficiently. But at the same time, that also raises some new questions about security and safety of infrastructure.

  3. 49:01

    So I think thinking about these systems, these AI capabilities as systems, I think is an important lens we should bring to this as opposed to think about, oh, if I evaluated my singular model, how's my model doing? I think we do a lot of that, but we often don't do these system-wide evaluations and understanding of the effects. also keep in mind that some of the intelligent capabilities may be the results not of a single model but a collection of models working together so i think these more systemic kind of questions i think are important both on the positive side it doesn't therefore what that could mean and think about us as humanity i think we're an extraordinary uh species mostly because of all of us, right? And all our complementary intelligences. I think it may very well be when we get to AGI,

  4. 49:52

    it won't be the result of somebody's singular model achieving that. It may be actually the collection of agents and models that achieve this. I think these more collective social components of intelligence, I think is an important area to think about both on the opportunity side, but also on the challenges and complexity side. I remember a few years ago, a couple of years ago, I was co-chairing this body, the UN high-level body, looking at AI and all the possibilities of AI.

  5. 50:20

    And I remember when we were having discussions about the risks of AI. So we went through the typical list that we all worry about, so misuse and misapplication of this technology. And I remember being struck by many of the members of the body from mostly from the global South, say we should add another risk. And we said, what's that? I said misuse. I thought that was interesting to think about misuse as a risk.

  6. 50:49

    But I quickly got it, I think, because I think what they're referring to is there are many communities, not just in the global South, but even in the US in developed economies where, you know, there's so many challenges already. Access to healthcare. I mean, if you go on a county by county assessment of the 3,000, whatever counties you have in the United States, there isn't equivalent levels of access to healthcare, to education, to all these things.

  7. 51:19

    And so if you're in some of these poor communities and how do we make sure we also don't avoid the misuse possibilities where this could actually make a dramatic difference. Absolutely, when it comes to healthcare, something we discussed today. Yeah, to healthcare, to schools. I mean, the kids were promised somebody was gonna come teach them STEM skills and all the rest of it, it never happened. But this technology can actually be useful in some of those communities to address those.

  8. 51:43

    I think that's another important kind of potential risk that's worth thinking about as well. And because we're here in New York during the UNGA, I was talking to some representatives from other countries and there was someone who posed this question and it made me think, I don't know if you have any ideas on that,