I'm on your side, but don't you think 'grotesquely immoral and unethical' is a bit of an exhaggeration? It's just software.
Why do you believe morals and ethics do not apply to software? Would you say nuclear weapons are "just physics"? What about the software involved? In that context, software is a tool that can make or break civilizations.
Honestly, this kind of disregard and reductive reasoning comes across as corrupt and sociopathic. The sentiment is a recurring theme I see on HN more than any other forum, and representative of the moral and ethical systemic failure permeating modern business and governance; how most politicians, investors, and leaders treat their users/customers/employees/constituents adversarially, as though they are marks to be fooled, manipulated, and exploited without conscience.
We should always hold each other accountable and ensure our beliefs and actions are conducive to improving everyones quality of life and standard of living. Software is no exception. These should not just be virtues to be signaled through marketing, or while standing on a pulpit, or being recorded. They are how we should strive to live our lives in private, even when nobody is watching.
Software has an ethical dimension, and it's ignorant or disingenuous to dismiss that.
No, these things don’t exist in a vacuum. Most LLMs were trained on huge amounts of copyrighted works that they then regurgitate portions of without regard to license or copyright holder, and without attribution.