logoalt Hacker News

hypferyesterday at 8:14 PM0 repliesview on HN

Having played around with this model a bit, I am fairly confident that it is not competing in the coding space.

It can do that, but its actual selling point appears to be a different take on guardrails and safety alignment.

Either that or the only new training data left was industrial quantities of dark romance literature and Wattpad.

Clever business move. 131k context is more than enough for that use case, and due to that small K/V footprint, you can probably have a bunch of characters on the same GPU.

Or it's just a happy little accident. We will never know.

___

I was informed that normal people use LLMs for mundane tasks like asking for a pancake recipie.

That it apparently can also do decently.

Unfortunately, it is also very confident, regardless of whether it is actually correct.

So maybe it should actually stay the smut engine and nothing else.