Watch modeSubscribed

Possible · 3 min · Oct 7, 2026

A two-person app used open-source tools to report 19 cases

A tiny fandom app found Coop and put it to work without Roost's help. The team's results show how shared safety tools can help even the smallest builders act on serious abuse.

CF

Camille François

Camille François is a founding president of ROOST and professor at Columbia University.

  • Reid Hoffman, Host · Co-founder, Manas AI

    Co-founded LinkedIn; one of OpenAI's first investors; Greylock partner.

  • AF

    Aria Finger, Host

About this segment

A tiny fandom app found Coop and put it to work without Roost's help. The team's results show how shared safety tools can help even the smallest builders act on serious abuse.

From “Building safety tools no one can take away with ROOST’s Camille François”, Oct 7, 2026. Watch the full episode

“And they deployed it. And in two weeks, they found 19 incidents of child sexual exploitation that they were able to report to NECMEC.”
CFCamille Françoisat 52:00 · Possible52:00

Takeaways

  1. A two-person team installed Coop on its own.
  2. It reported 19 exploitation cases in two weeks.
  3. Coop and Osprey reach an estimated 370 million monthly users.

In this episode

Full episode
  1. 17:02Discord turned a vendor shutdown into shared safety infrastructure2:22
  2. 24:58Safety teams need tools for investigation and review, not just detection3:25
  3. 51:42A two-person app used open-source tools to report 19 cases2:59

  4. 5 more moments in the full episode
Up next · Unsupervised LearningPost-training wins inference because the biggest workloads train first2:01

Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

  1. 51:46

    So I'll tell you two stories. Can I do two stories? There was a small fandom app, two people. They found Coop through LinkedIn, actually. Promise. Yeah, great. And they installed it totally on their own. We didn't know. And they deployed it. And in two weeks, they found 19 incidents of child sexual exploitation that they were able to report to NECMEC. And then they reached out saying, thank you for enabling this work. We really wanted to do that. We didn't have the tools to do it.

  2. 52:22

    Then we worked with NECMEC to say, OK, well, what does it look like to do this experience from the perspective of somebody who has a team of two? And I'm not saying an engineering team of two. I'm not saying a safety team of two. I'm saying a team of two people, everything two people. And to think about, okay, how can we make this as easy as possible for builders who want to do the right thing? That teaches us that the coalition of the willing of people who want to get this right is so much bigger than the people who are currently equipped with the tool to do this, Which, again, is good news in our ability to quickly make a dent, a real dent in protecting people online.

  3. 52:59

    Other story, actually also LinkedIn related, quite fun. One day, the lead contributor on Coop, so the formidable engineer called Juan, receives a message from Atlassian saying, hey, we're going to submit a pull request. Can you review it? And we're like, Atlassian's using Coop? We didn't know that. That's cool. They're big. We're excited that large companies are staking, you know, some of their safety infrastructure on these tools because then it's exactly what's going on.

  4. 53:39

    Then they contribute to it. So it's absolutely awesome to discover the use of your tools by amazing engineering teams knocking on the door saying, hey, actually, yes, we've been using it. Actually, we think we can improve it. But today, if I just think about Coop and Osprey, I'm not thinking about the ROOST model community and the amazing AI safety models, just Coop and Osprey. The people whom we know are using them in prod reaches around 370 million monthly active users across platforms and organization.

  5. 54:14

    That's our conservative count. I think we can do so much more. There are so many more organizations to protect. What's fun about this number is that it's both large platforms and small organizations, two people team. Or for the first time, we also had a journalism team say, hey, we're building our own community. We actually want it protected and we're going to use Coop. That's awesome.