logoalt Hacker News

otterleyyesterday at 7:47 PM1 replyview on HN

Plagiarism, fictional data, and unreproducible results have been a problem for a some time, and LLMs are now increasingly standing in authors’ shoes. In a system that rewards production over all else, people are naturally going to be incentivized to cut corners.

Some cultures that are increasingly participating in the scientific process don’t even agree as to what the ethical boundaries are.


Replies

doc_ickyesterday at 8:11 PM

True, and thanks to llms are of those are being “exploited” exponentially more.

“In a system that rewards production over all else, people are naturally going to be incentivized to cut corners.” That sounds like the human condition and or capitalism, advancements in cars, weapons, toys, etc…

The agreement on ethical boundaries seems like a conversation held at a conference level, otherwise place a governs place b and that never goes well.

I agree fully replicable experiments is a minimum for research papers. Even with caveats it should be required. That being said those who don’t want to fully prove their claims will find another venue. I think frontier models should curb or have provably verified output (chatgpt did say x) for the majority cases to help reduce or help identify the slop.

show 1 reply