# Safety teams need tools for investigation and review, not just detection

Markdown copy of https://realalpha.app/s/safety-teams-need-tools-for-investigation-and-review-not/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Camille François](https://realalpha.app/people/camille-francois/) · Camille François is a founding president of ROOST and professor at Columbia University.
- Host: [Reid Hoffman](https://realalpha.app/people/reid-hoffman/) · Co-founder, Manas AI · Co-founded LinkedIn; one of OpenAI's first investors; Greylock partner.
- Host: Aria Finger
- Show: Possible
- Episode: [Building safety tools no one can take away with ROOST’s Camille François](https://realalpha.app/v/RQpx17UAK9M/), Oct 7, 2026
- Moment: 24:58 to 28:23 of the episode (3 min), playing on https://realalpha.app/s/safety-teams-need-tools-for-investigation-and-review-not/; the episode from there: https://realalpha.app/v/RQpx17UAK9M/?t=1498

## Quote

> “We re-released Coop a few months ago as the world's first end-to-end tool that allows for the **detection, review and enforcement** of child sexual abuse material fully open source.”
> — [Camille François](https://realalpha.app/people/camille-francois/) at [27:29](https://realalpha.app/v/RQpx17UAK9M/?t=1649) · Possible

## Takeaways

1. Detection is only one step in responding to harm.
2. Osprey helps investigate patterns such as fraud and harassment.
3. Coop supports review and reporting of child sexual abuse material.

## About this segment

Camille François explains why safety work continues after a harm is detected, then describes open-source tools for investigations and content review. Shared infrastructure can help more services act on abuse reports.

From “Building safety tools no one can take away with ROOST’s Camille François”, Oct 7, 2026. [Watch the full episode](https://realalpha.app/v/RQpx17UAK9M/)

## Transcript

Transcribed by machine (Whisper) from the episode’s audio, so a word may be off here and there.

[25:03](https://realalpha.app/v/RQpx17UAK9M/?t=1503) If you think of detection, investigation, review, and enforcement as sort of a pyramid, right, or an iceberg, rather, the exposed part, the thing that everybody sees and likes to comment on is detection, right? So the question is always like, oh, do we know how to detect this harm? It's a helpful, fun conversation. I'll get back to it in a second. But in fact, once you've detected a harm, there are a number of things you have to do to be able to take action.

[25:28](https://realalpha.app/v/RQpx17UAK9M/?t=1528) And at ROOST, we focused on sort of building those boring tooling infrastructure pieces so that people have the means to take actions when something is detected. So we talked about Osprey. Osprey is an investigation tool. tool. It allows you to say, oh, I can describe an activity that I don't want on my service by its pattern. Please, real time, go find a pattern and help me take action. Super helpful, for instance, if you want to root out fraud or if you're dealing with sadistic online exploitation and you have a signal that you want to be able to detect at scale. So that's Osprey. And as I was sharing, this is coming from Discord.

[26:16](https://realalpha.app/v/RQpx17UAK9M/?t=1576) The other big tool that we have and that people are using is called Coop. Coop tackles review. Now, Coop came into a ruse through also a bit of a bizarre story, which is we bought a startup, which is a funny thing to do when you're a nonprofit. I love it. Yeah. Nonprofit and university. Exactly. There were two super talented engineers from Meta who had built a super little startup, which was a really good console that you can use for review and some enforcement, right?

[26:45](https://realalpha.app/v/RQpx17UAK9M/?t=1605) Because, for instance, say you want to detect if child sexual abuse material is uploaded on your services. If you do detect some, you actually have to be able to review to ensure that you know what is going on. And so for that, you really want wellness features. And then if you do find that indeed this has happened, you have an obligation to report it, if you're in the U.S., to the National Center for Missing and Exploded Children, NECMEC.

[27:09](https://realalpha.app/v/RQpx17UAK9M/?t=1629) And that report is actually quite hard to do. So we bought this startup and we spent a lot of time working to open source the core technology and to really add on to it. It was quite lucky for us that some of the former customers like Notion decided that they were in it with us on the open source journey and really helped sort of like take that seed, that base and sort of grow it into what it is. We re-released Coop a few months ago as the world's first end-to-end tool that allows for the detection, review and enforcement of child sexual abuse material fully open source.

[27:48](https://realalpha.app/v/RQpx17UAK9M/?t=1668) that's amazing because it means that now people who've always wanted to do this work can do it without having to knock on 99 million doors and pay lots of budget and what we're hearing is that it has sort of met its audience of again like people who were willing to do that and didn't have the tool so I can go into into many sort of stories for what this looks like in practice but And the point is, we often underestimate the tooling needs that are not just detection.