I've noticed most fine-tunes, whether "heretic" models or something else, tend to be over-fitting, or something, at least some of the time, and get kind of chaotic. I want to believe normal folks with normal resources can be involved in this stuff, as I'm working on fine-tuned specialist models as we speak, but it seems like it takes notable investment and time. My first experiment was teaching a little Gemma 4 more to write more like me with a LoRA (like you, I don't want to use a model to write for me, but I did want training data that I could ethically use, and I've written several million words on the internet over the years), and it wasn't what I would call a success. It either wrote like an asshole (which I only do, like, 15% of the time) or it just borrowed a few of my quirks, like too many ellipses, if I applied it less heavily.