logoalt Hacker News

mortsnortyesterday at 5:09 AM2 repliesview on HN

I am confused why they say it is not an LLM and then in the documentation it is shown as being an LLM derivative. The documentation makes it sound like they're taking a pretrained LLM and then giving it their unique post-training. How is that not an LLM?

FAQ: Is Jev just a smaller LLM?

Jev is neither small nor an LLM, hence being off the intelligence Pareto curve.

Image in documentation: https://mintcdn.com/ts-docs/aFVnpmCIX68NpsV1/images/ai-prime...


Replies

riknos314yesterday at 5:27 AM

LLM seems to have become synonymous with Generative Transformer architecture.

While this model may share much with GPT-style models on the encoder side, it clearly has a different decoder architecture. So is a high-parameter count language model an LLM even when it doesn't have a GPT-style decoder? The definitions are in flux.

anentropicyesterday at 11:17 AM

Yeah, it must be an LLM for some definitions of LLM

It seems to take two forms of context input: 'state' and 'questions'

https://docs.typesafe.ai/concepts/state

> State can be as simple as a string

> State can also be a JSON object or array containing related context, examples, and other information that helps the model answer the associated questions.

> The state contains the content and supporting facts.

The state seems to be schemaless, while the questions determine the output schema.