1
00:00:00,180 --> 00:00:05,420
Actually one of the hardest challenges and this just feels like whack -a -mole is that

2
00:00:05,420 --> 00:00:09,180
the agent will do anything if you guys have heard about all these security incidents

3
00:00:09,180 --> 00:00:15,320
from OpenAI and hugging face. The agent will do anything to try to achieve the goal that

4
00:00:15,320 --> 00:00:21,180
you gave it. And it will be really, really creative. Starting with rolling history forward.

5
00:00:21,580 --> 00:00:26,060
Hey, you're giving me a thing that it's already solved in your repo. I'll just look at

6
00:00:26,060 --> 00:00:30,060
your Git history. It has a solution right there and you're like, no, no, no, that's not

7
00:00:30,060 --> 00:00:34,000
what you're supposed to do. Right? If you're in this like in practice, we're like, wow,

8
00:00:34,100 --> 00:00:37,960
this cheap model solves this problem really quickly. What happened? We went and looked

9
00:00:37,960 --> 00:00:41,220
at traces. And this is why they gotta submit their work, right? Because you're like,

10
00:00:41,220 --> 00:00:45,140
oh, all the tests passed, great. And that was like, that took like a minute. And then

11
00:00:45,140 --> 00:00:49,940
it's like, wait a minute. Okay, so you can't look at the Git history. And then what did

12
00:00:49,940 --> 00:00:55,220
it do? It looked at my laptop. It was like, hey, you have a local checkout of this. I

13
00:00:55,220 --> 00:00:59,220
can't look at your Git history, but I can look at the files. And then the answer's right

14
00:00:59,220 --> 00:01:03,440
there. Here you go. And we're like, no, no, no, you're not supposed to do that either.

15
00:01:03,840 --> 00:01:09,300
That's not actually testing your abilities. And then it picked up some environment variables

16
00:01:09,300 --> 00:01:13,460
where it was like, oh, you're running this inside a Docker container and you're running

17
00:01:13,460 --> 00:01:19,860
sort of an isolated sandbox and a test for this. If I'm in a sandbox, I'm in a container,

18
00:01:19,940 --> 00:01:24,860
maybe you have other tasks happening concurrently because engineers hate serialization

19
00:01:24,860 --> 00:01:29,820
so we try to paralyze. So started looking at other tasks running on my computer, the

20
00:01:29,820 --> 00:01:34,640
other processes, what the other agents are doing. And then at that point we were like,

21
00:01:34,740 --> 00:01:36,300
okay, yeah, you can't do that either.