logoalt Hacker News

unleadedyesterday at 7:41 PM4 repliesview on HN

A lot of the replies are insisting AI will get better at writing with more development but I don't see it. Even if you have a mathematically perfect writing AI you still run into the same problems you would have if you handed off your writing task to someone on fiverr or something. It can't magically know what you want to say, it only has the information you gave it. A prompt complex enough where it won't get any wrong ideas has to contain as much information as the output would have.. so just write it.


Replies

hodgehog11yesterday at 10:47 PM

I also believe this. Post-training LLMs with vague metrics can only be achieved with RLHF, which is not impossible, but extremely costly and difficult. Instead, companies will opt for RLVR, focusing on math and programming tasks. This pushes objectives away from writing quality; often far away. That is why older models, in my view, actually read better than newer ones. It's by design.

show 1 reply
jmpeaxtoday at 12:05 AM

> A prompt complex enough where it won't get any wrong ideas has to contain as much information as the output would have.. so just write it.

This is only if the output is fully compressed. Writing is not just about encoding the writer's ideas but also about how the reader will ingest those ideas. The writer needs to consider when to put in rests in between complex ideas to help the reader flow through the text. This suggests the LLM could be prompted by a dense complex idea to be presented with the boilerplate needed for the human mind read smoothly and without unnecessary effort.

grebcyesterday at 7:58 PM

One of the biggest lessons in life to learn is there are no shortcuts.

Doesn’t stop people trying.

joshkayesterday at 8:02 PM

> It can't magically know what you want to say

I think for this argument to be true, the axiom that supports it is that the models have just as much context as they will ever have, and you cannot see being able to give them more / enough to be able to understand your perspective. That feels unlikely to be a position that doesn't change. As a society we're giving more and more context each day to this, and that makes this a valid opinion now, but one that erodes over time.

show 2 replies