Are AI agents ready for real work?

“it accelerates our most senior researcher by a factor two, three or four with our models.”

“We use agents and coding agents now for probably half the code that is written inside our place, and it is superior to what was written before.”

“I think if in some ways I view 2027 as a golden age of that productivity frontier for us”

“you almost have agents helping AI researchers in some automated way work together to build these models.”

“And that took maybe about 10 days. In previous days, that would have taken maybe about six months for a single person.”

“it was able to ground that in performance benchmarks”

“It will at least confront the user with these high-level decisions because it still has business impact and outcomes to it.”

“agents are the primary writers and maintainers of content now.”

“last weekend, we pulled out over 10,000 of them and we're not even trying that hard.”

“essentially you can capture real production traffic with just one middleware because now we have standardized language frameworks across all the services”

“around 15 percent of all of the production PRs go through go through minion right now”

“we want to err always on the safer side because the cost of an incident for Uber is like really high.”

“What that means is that you just point your web browser at one malicious website, and the attacker will own your entire Windows PC.”

“the benefit of pooling is we get to essentially load balance across these different customer types”

“What I know about consumers is that the first time it doesn't work, they just walk away. They have no incentive to try again to overcome frustration or brokenness.”

“there's all the people in the org who don't really. We don't really want to maintain their own cause and then the people who do want to do it like eventually you kind of get tired of it”

“it's sitting in a compliance backlog today somewhere in their organization where it's pending the approval”

“this area here is where we're trying a full software factory approach, where we don't look at the code anymore, but we specify the interface.”

“Maybe now, in a way, I don't need to be a vulnerability researcher to do vulnerability research.”

“we tested the open weight ones and the most advanced closed models, they all found eight.”

“the remaining support team that we have really is now finding legitimate problems in the product and then working really closely with the engineering”

“The fundamental difference in the way that we've built dots is the harness does not run on the machine.”

“I think one thing I always try to encourage people to do, you know, whether you're a pstack user or not is to actually spend the time to sort of observe the bot or agent doing”

“The root of the problem to me is that RLHF actually greatly increased expectations.”

“the problem is it was really really clearly not robust and that was something that has like plagued me for years”