# More than ten image references are hard to review

Markdown copy of https://realalpha.app/s/more-than-ten-image-references-are-hard-to-review/ on Real Alpha, the best minutes from long interviews with the people building AI. Cite and link the page, not this copy.

- Speaker: [Dustin Podell](https://realalpha.app/people/dustin-podell/) · Black Forest Labs
- Host: [Shawn Wang (swyx)](https://realalpha.app/people/swyx/) · Co-founder, AI Engineer · Wrote “The Rise of the AI Engineer” and founded Smol AI, maker of AI News.
- Show: Latent Space
- Episode: [Why FLUX 3 Trains on Images, Video and Sound — Andreas Blattmann & Dustin Podell, Black Forest Labs](https://realalpha.app/v/8cGfJOU3AlQ/), Nov 16, 2026
- Moment: 1:05:17 to 1:10:19 of the episode (5 min), playing on https://realalpha.app/s/more-than-ten-image-references-are-hard-to-review/; the episode from there: https://realalpha.app/v/8cGfJOU3AlQ/?t=3917

## Quote

> “I like to see **how people actually use** our models.”
> — [Dustin Podell](https://realalpha.app/people/dustin-podell/) at [1:09:28](https://realalpha.app/v/8cGfJOU3AlQ/?t=4168) · Latent Space

## Takeaways

1. Flux.2 was trained to handle up to ten reference images.
2. The guests say more than ten references are hard for people to follow.
3. Their evals pair models for human comparison and include real use cases.

## About this segment

Flux.2 expanded editing to ten reference images, but the guests say larger sets are difficult for people to track. They discuss building an eval around real uses and human comparisons.

From “Why FLUX 3 Trains on Images, Video and Sound — Andreas Blattmann & Dustin Podell, Black Forest Labs”, Nov 16, 2026. [Watch the full episode](https://realalpha.app/v/8cGfJOU3AlQ/)

## Transcript

From the transcript Latent Space publishes with the episode.

[1:05:23](https://realalpha.app/v/8cGfJOU3AlQ/?t=3923) I mean, yeah, I mean, I guess if like anything to track on is like okay, f- well, the one, like, thing that made me quite sad that we didn't quite get in with FLUX Kontext is that it was only single image edit because, uh, I mean, I s- it was very clear that there was like a huge need for, for multi-image. Like, people, you know, want to be able to put in many, many different images and, and relate those- Uh, references... references is a better word here. Yeah. Yeah. Many, many different references.

[1:05:44](https://realalpha.app/v/8cGfJOU3AlQ/?t=3944) Which I think Groq is, like, king right now. Or I, I, I don't know this state of it, but yeah. Yeah. I know, I know Midjourney does quite a bit on style books where you can build up references. Yeah. I mean, they, they've always been very good at like the sty- style reference, but th- this is more just like general. Like, like Flu- FLUX Kontext would only take one image- Yeah... and so it was just you can only iterate with that. So you have a bad photo of one person, that's all you have. Yeah. But- But you could have three different photos of the same person. But it was actually general enough.

[1:06:05](https://realalpha.app/v/8cGfJOU3AlQ/?t=3965) I remember it was, it was actually quite funny. People were, like, doing workflows where they were stitching a bunch of, like, images into one image to, like, emulate it. But then with Flux.2, we finally were able to, like, spend the time to, to, to kind of build out the data and actually do this larger scale training for handling, I think it was 10 reference images at the time. So essentially building up much more context to work within. Yeah. Yeah. Which is again [laughs] also a lot of a, a, to, to a large extent the data, a data, um, problem that you, you just need the data- Yeah...

[1:06:32](https://realalpha.app/v/8cGfJOU3AlQ/?t=3992) to have these many references, right? Yeah. Is there a practical limit? So, you know, let's say the industry standard is like 10 characters or 18 characters. That's it, right? Yeah, I mean- I don't need 100... obviously you can show crazy numbers- [laughs]... on, on, on how many, on how many characters you, or like, like images you can get into one image or also video, but there, there are like, that is agent work then to, to, to get me 100 references.

[1:06:52](https://realalpha.app/v/8cGfJOU3AlQ/?t=4012) [laughs] Which is the easy thing, right? It's agent work. But then I need to check it, like I, I, then I have to review 100 images if that is actually what I... It's actually also cr- [laughs] Yeah, yeah... a hard creativity problem. Like how should I, where should I put these set of- Composite these things. Yeah... 100 images, right? So I think without like, like over-indexing on the number, everything that goes up like, like over, over 10, 10 references is also hard to follow for a human, I think. Like if you, if you say- Yeah...

[1:07:14](https://realalpha.app/v/8cGfJOU3AlQ/?t=4034) okay, we want to be creating a, a video, right? I obviously can, can put in 50 people there But if you look at the mo- Like, the, the, the most important movies, how many central characters do we have? Mm. Like, five, six maximum. Unless you're- Yeah... Avengers. S- exactly. [laughs] The, the, the, that is then also it's at some point approaching the, the kind of limit of what we humans can actually- [laughs]...

[1:07:32](https://realalpha.app/v/8cGfJOU3AlQ/?t=4052) kind of process in, in, in a two-minutes clip or something. This also gets way, like, you coming back to the, I know you mentioned the evals earlier. Building evals for larger, like, contextual models- Yeah... becomes a, a much bigger process. Yeah. Like, even for, like, we, we ended up releasing a, uh, an open eval set for, um, I think it was Context Bench, which was built off the internal bench that we use to evaluate context.

[1:07:54](https://realalpha.app/v/8cGfJOU3AlQ/?t=4074) And then, as you scale up how many references- Oh, I haven't seen this. Okay. Yeah, yeah, please, please look up Conne- I'll pull it up. This was a lot of work, but it'll, kind of a... It was actually quite fun to put this together. Make the cat very fat. Yeah. I mean, it was, we lit- I remember sitting in the back room of our SF office with, like, a few of the other guys. Like, me and Tim were l- uh, were laughing. Tim Dawhorn is another one of the great, great guys I work with.

[1:08:13](https://realalpha.app/v/8cGfJOU3AlQ/?t=4093) I feel like, so, like, do you just, like, take some edibles and just go, like [laughs] Dude, I, I mean, we just, we're sitting there late- What's the process? We're sitting there late at night literally just typing in this, like, we're just pulling images and typing in the stupidest things. [laughs] I mean, it works, right? Yeah, that, that like... It, but it's, like, real. Like, I don't know. So, because, because- And in the end, you always, you need to kind of make one step to make it a kind of- And we, we-... enjoy the comedy... what is, what is ground truth?

[1:08:33](https://realalpha.app/v/8cGfJOU3AlQ/?t=4113) You, you, you need to make sure that you have a ground truth somewhere. Yeah. No, this is just a benchmark, basically. It's just inputs. Right, but where's the- How do you- Where's the-... eval the output? Yeah. Where's the eval? I mean, the, the, that is the interesting thing, right? You just ask people, this is a public bench to give everyone, like- I see. Oh, so this is- This is half of an eval... some arena for improvement.

[1:08:49](https://realalpha.app/v/8cGfJOU3AlQ/?t=4129) Yeah. Yeah, no. This, this is the eval and then you, you have two models that you want to be comparing, right? Then you judge. Yeah. Yeah, yeah, exactly. Arena style, yeah. Okay. Yeah, yeah. It's- So it's not a validation set in that sense. Yeah. It's just a eval bench. This is just Dustin sitting in a room [laughs] This is, we remove this. It, it, I, genuinely, like, 80% of this is that. Like, it, it's, um [laughs] also heavily- It's heavily influenced by our, by our, uh, I think, by our Italy offsite. Uh- Yeah. No, but- Yeah.

[1:09:11](https://realalpha.app/v/8cGfJOU3AlQ/?t=4151) Why don't you do, why don't you do, like, a Mad Libs, like, like, like, a combinatorial explosion type thing that is more structured than just random inspiration? So, so, so, I mean, now we're do- we definitely do- Oh, yeah... more stuff like this, I will say. The, so one of the thing is there were, I mean, there were certain things we had to, like, filter out for the public set on here, 'cause it's just, there were some very dumb things in the internal thing, you know, in the, in the internal set.

[1:09:31](https://realalpha.app/v/8cGfJOU3AlQ/?t=4171) But, um, I don't know. I, I spend a lot of time, I like to see how people actually use our models. Okay? And I, I'm someone that actually really likes to use our models. I, I think it's very, very important that you test and play, like, really just play. I'll say play with your models. Like- Like memes... like me. Like, yeah. Like, use it for what people actually want to use it for. Like, I came, like, like I said, I came from Discord, open source communities on this, and you see people doing the stupidest things, but it's like, this is, people are having fun with it.

[1:09:55](https://realalpha.app/v/8cGfJOU3AlQ/?t=4195) And it's, so a lot of the set, you know, besides trying to cover a bunch of actual use cases, uh, like production use cases, which, which, which are very important, I also want to make sure it's just like the models are fun to use, you know? Yeah. And so, yeah. Good, good vibe eval vibe bench. Exactly. Yeah. Well, I think it's like I, I, I underappreciated three years ago, which was like, yes, this is memes.
