logoalt Hacker News

cluckindan • yesterday at 11:06 PM • 2 replies • view on HN

Neither a chat or an API are an LLM.


Replies

verdverm • yesterday at 11:09 PM

LLM's have chat templates that sit at the lowest levels of how we feed tokens to them. It's quite integral to how they are trained to process tokens and rises up through the tech stack.

Go to a huggingface repo, look at the files, they have a literal chat_template.jinja

tptacek • yesterday at 11:29 PM

By that standard Gebru was also not writing about LLMs in the Stochastic Parrot paper.