logoalt Hacker News

ludwiklast Saturday at 7:16 PM4 repliesview on HN

I like to dunk on Meta as much as the next guy, but I think this makes sense: deterministic verification like this is not, and should never be, the LLM’s job. The tools it has access to should enforce the permissions layer, ensuring that the LLM can never perform actions the user themselves should not be allowed to perform. In this case, the tool failed to do that.


Replies

dbbkyesterday at 9:43 PM

Yes the LLM part is irrelevant here. It'd be just the same if it was a HTML form.

gavmoryesterday at 4:13 AM

The overall system that allowed this implementation is accountable. So why put such a fine point on it so as to exculpate the LLM?

show 1 reply
TZubirilast Saturday at 8:25 PM

>deterministic verification like this is not, and should never be, the LLM’s job.

But when humans handled it, this was not as much as a problem. That is, the humans did the job, because they recognized the need to do that job.

Sure sometimes accounts could get recovered if a human was tricked, but evidently it was easier to trick the LLM in masse than humans.

show 1 reply
jffyjcaalast Saturday at 7:23 PM

[dead]