The alpha, twice a week
That was 8 min.
Get the best new moments in your inbox every Wednesday and Saturday. It's free.
Check your inbox
We sent a link to your address. Click it to finish signing up. Not there in a minute? Look in spam.
or
Latent Space · 8 min · Nov 16, 2026
BFL aims to crack one-shot robot learning by 2027
Their current robot workflow needs about four hours of task data, while general pretraining cuts adaptation data eightfold in one comparison.
In this episode
Full analysis- 57:12A small dataset unlocked general image editing in hoursPro pick 4 min
- 34:53A video model learned enough 3D to fine-tune in 1,000 steps3 min
- 40:12Training should focus compute on informative denoising stepsPro pick 5 min
- 1:24:25BFL aims to crack one-shot robot learning by 20278 min
- 1:13:06Autoregression is more data-efficient; diffusion can sample faster5 min
- 27:39The SDXL refiner came from a different, unreleased model6 min
- 47:01BFL was founded to capture value its models had created4 min
- 1:05:17More than ten image references are hard to review5 min
“You should be showing a robot an action one time, and then it should be able to do this”
Takeaways
- A comparison showed eight times less data was needed.
- Their current adaptation process still takes about four hours of data.
- Blattmann predicts a breakthrough in one-shot learning by 2027.
About this segment
Their current robot workflow needs about four hours of task data, while general pretraining cuts adaptation data eightfold in one comparison. Andreas Blattmann says they aim to crack one-shot learning in 2027.
Black Forest Labs

Shawn Wang (swyx), Host · Co-founder, AI Engineer
Wrote “The Rise of the AI Engineer” and founded Smol AI, maker of AI News.
From “Why FLUX 3 Trains on Images, Video and Sound — Andreas Blattmann & Dustin Podell, Black Forest Labs”, Nov 16, 2026. Watch the full episode
Thanks. We'll look at and fix what's off.
Transcript
From the transcript Latent Space publishes with the episode.
- 1:24:31
So if I wanna take your general model, fine-tune it for a new robot with a new task. Not something super crazy, but you know, something that's out of distribution it hasn't seen. Say it's my own home robotics. Yep. I can program in how to use a humanoid arm or whatever. Mm-hmm. Uh, what is that process like? How long does it take? How important is that in fine-tunability? Also, again, like since this model is so general and, and the pre-training was so nice, um, it, it takes like compar... Basically- Exactly, yeah... you, you need a bunch of hours.
- 1:24:58
I think we showed one example, um, where we compared it with, um, I think it was Paleo5, which was also, uh, open source, right? Yeah. It took eight times less data to basically train on it. That was for industry application. It was like four hours of data that we, that we needed basically to get to a success rate that was like good enough for this basic application. And is that a thing you kinda wanna help climb on right now? Or is that like- Yeah. So we go back to the context thought. Yeah.
- 1:25:24
We shouldn't be doing fine-tuning What we, what we are targeting and what we'll- Absolutely... working on right now extremely carefully and with a lot of focus in, in context learning for robotics. Absolutely. This is-- You should be showing a robot an action one time, and then it should be able to do this, and this would be truly a superhuman intelligence. Like, if you, if you look at how long it takes us as children to learn walking, to learn using our thumb correctly to grab this can, for instance, right?
- 1:25:52
This is like weeks and even months of, of learning that it takes us to do this. Our vision is that robotic-- like an autonomous robot should be able to observe any action once and then be able to do it. Mm-hmm. That is what would be a clearly superhuman kind of visual intelligence, and that is what we wanna be reaching. What is the standard now? Like, how many demonstrations do we need? It's around like- Hours...
- 1:26:13
four, four hours of fine-tuning- Four hours, yeah, yeah... you, you need at least. But this will- Yeah, and even, even four hours is pretty good. I, I would say 2027 will be the year where we will crack this task. Single shot learning. Yeah. Mid-journeying is an interesting one in here too, right? So is this like I wanna go from manufacturing to say maybe medical stuff like filling pill capsules, like specifically like different niches, for example?
- 1:26:34
Is that where- I, I mean, the model, the model is trained quite generally. Yeah. So even, even the mid-train, like before fine-tuning, it might be able to handle many of the... Like even this version might be able to handle many of the tasks you throw at it. Yeah. The fine-tuning is really just nailing. You know, in the robotics world, you wanna, you wanna act... You wanna- You, you want a certain level of accuracy- Yes... you expect out of it. Exactly. This is just a standard- This is where, yeah... plain large scale mid-training. Yeah.
- 1:26:54
And then we move on to this fine-tuning stage- Right... where we add the high-quality robotics data in, and then we get this, this, this further bump. But you, you see that already to a, to a, to a somewhat a good extent, um, on mid-training, the model can actually do these tasks. I guess the other interesting thing is it's a 7B, right? Yep. Is that mostly just constrained from these things are deployed- Exactly... on device? You wanna be having- Yeah... you want wanna be having a model that is as small as possible because- Yeah...
- 1:27:20
you need to be able to act first on device if you wanna be adding this to a manufacturer, basically, and then also in real time, which- And this is on the backbone of Flux.3? Yes. [chuckles] And do we-- So is like the image and audio, all that stuff- All-- Like, this is, this is derived from this one model, basically. This-- We, we have this multimodal model. Yeah. That, that is really important to understand.
- 1:27:43
This has been trained on a huge corpus of images, videos, audio, and from that, we can derive everything that we basically released this summer, which was Flux.3 video, Flux.3 video edit, Flux.3 action, Flux.3 image, Flux.3 image client. Yeah. We also derived an upscaler from it. We have a super nice 4K, uh, video upscaler, which is, I think, super fast also. Can only recommend. It's really good. And this is all powered by this one model, and this, this shows how training these very general models actually compounds then over time because you can derive- Mm-hmm... all these applications from them, right?
- 1:28:15
Is there a difference between a video upscaler and an image upscaler? Isn't it- A video upscaler, we, we talked about the temporal consistency. Yeah. Obviously, if you would have a- The same upscaling... image scaler- Yeah... that could have like, like no temporal understanding, then you would have this flickering again. [laughs] This-- Especially in the high frequencies, you would then real-- Like, like you don't see this too much when you com... Like look, look at two images side by side, you don't see that much.
- 1:28:36
But if you switch between the images, that's, that's one of the basic, uh, tasks that everyone who's looking at a lot of images does, just opening two images in two tabs- You do notice, yeah... and then, then switching left, right- [laughs]... and you see every single, single difference, and that would just amount to kind of flickering in, in- Yeah... temporal space if you wouldn't have this temporal component in the video upscaler. Got it. And that's what makes the difference from a image upscaler. Any notes on real robot evals and how to scale this?
- 1:29:00
Like I, I see, you know, sponge in bowl three times. [laughing] Like... And, and at some level, like if you look at our Dynapod, there are literally people just one-off testing robots 'cause you have to test in real scale. But like, come on, two out of three runs on sponge in bowl. Just restart, do it again. You can be three out of three, right? [laughing] It's, it's a hard problem, and I think one, one, one, uh, thing that's constantly being worked on is just closing the sim-to-real gap, and this- Yeah... will get better and better and better over time.
- 1:29:29
But to be honest, evals, no matter where you do it, it's a painful thing. Yeah. It's also painful when you, when you look at the content creation evals. Like ask three different groups of voters what a good image looks like, and you would get-- you, you, you will get three different answers back. You get wars over it. Yeah. We, we- [laughs] We, we have wars over it internally. We have wars over this. [laughs] Yeah. But that's e- evals are just for generative modeling. Evals are just hard. Yeah. Yeah.
- 1:29:51
Is this already-- Like how developed is the commercial side? We will have- More of these coming... soon [laughs] I cannot tell, tell too much, but there will be soon first- We can in my goal here... DFL, DFL-powered robots in productions live. And it's open, right? 2027 will be the year of robotics. Oh. Oh, absolutely. Okay. Say more on predictions. Where, where do we go from this in 2027? How, how fast do things pick up? Single shot learning. Yeah. In context learning is a, is, is a big, is a big thing we'll see first.
- 1:30:19
Is this a- We'll see first commercial applications of these things in real manufactories. That's, that's why it's actually good that we have a, this German base because there's a ton of, uh, industry data- Mm... and, um, obviously lots of potential for partnerships. People are really hungry for robotics, I would also say. Sure. So there's a, there's a good bunch of, um, of synergies that we wanna be using to actually make 2027 the year of robotics. I, I, I'm very excited about it. The research, the research on this is also moving very quickly, so I, I suspect- Yeah... that robotics will improve very quickly. Yeah.
- 1:30:53
What about the side of like robotics is very physical manufacturing constraints. Like you can scale up tech, you can scale up models, but that's-- It's pretty hard to affect, right? So- Mm... predictions 2027, where, where, where, where are we realistically on robotics? Can I buy something off the shelf that can single shot learn, like? I suspect like later 2027, like people will be able to get some, some quite interesting robotics in their house. I mean, I-- Whether it's, you know-- Is it gonna be able to do like fine motor tasks and all this?
- 1:31:20
I, I don't know. But I suspect like... And again, this is just entirely predictive. I've, I've no baseline for this. But I, I, I suspect next year There might be some, some interesting like, you know, at least niche for like the, the tech side of people like us. Not like, you know, uh, the average person would be picking this up, but some interesting potentially useful robotics in your house. And for manufacturing- Mm... I think 2027 will be a, a year.
- 1:31:44
Because manufacturing- Yeah, absolutely. Yeah... is, like, more restricted, right, than, than kind of... It, it, it isn't that long tail less like, say, autonomous driving and stuff like that, right? Or, or like consumer robotics where, where we can just like do a- a- You would ideally like to do this thing to do anything you want. But for manufacturing, I think there's a very good chance that we will see like a lot of applications actually being unlocked by robotics in 2027. Very much so. And that's what we are also working towards, basically.
- 1:32:07
Very much so. Awesome. I mean, exciting. It seems like very fun place. You guys have robot labs- [laughs]... image video model. Building the future. You're also- You- You're just missing the flying car.