logoalt Hacker News

Der_Einzigetoday at 2:23 PM1 replyview on HN

Wrong, custom "specs" i.e. schemas, are literally all we have for "real" guardrails with LLMs.

https://developers.openai.com/api/docs/guides/structured-out...

Nothing else operates on the logprobs level and literally bans continuations that fail your schema.


Replies

scwoodaltoday at 2:33 PM

Enforcing structured outputs from LLMs is not the same thing as using linters, formatters, static analysis to control how an agent writes code.

show 1 reply