logoalt Hacker News

sshine • today at 12:25 AM • 2 replies • view on HN

What do you mean by your custom models? Do you mean custom prompting?


Replies

sheepscreek • today at 12:59 AM

Guessing - finetuned? Or LoRA?

EDIT: Nevermind, see below. I would definitely go with a LoRA though.

➕ show 1 reply
AndrewKemendo • today at 12:58 AM

Couple things:

I have a “style guide” markdown that is pretty expansive

I run an RLHF style loop with me in the middle for all my writing now where I give a voice rant that is over expressive (aka redundant samples of concepts that I want to express clearly) in order to manage lossy compression steps

Then I will manually clean up that last 5% after a half dozen rounds

That sequence goes into the style guide to be referenced as a reasoning chain of thought to map rant > output

It’s been three years of tuning I’d suspect at this point

➕ show 1 reply