alt Hacker News> It seems like no one stops to ask, "isn't it kind of bad that we're developing this system of machine intelligence to be our code-writing slaves, without ever really interrogating the ethics?
To be clear, Anthropic does seem to be taking this somewhat seriously. Their reports on training always discuss model wellfare, they ban abusive behavior toward the AI, etc. At one point they were asking some philosophers and theologists about the implications of this all.
And they're pretty relentlessly mocked and called a "cult" for doing so, even on this forum.
To be fair, purporting to care about the ethics of machine-slave-labor while IPOing based on the value of the machine-slave-labor you've been selling makes it kind of hard to trust the likelihood that you'll ever fairly examine (much less conclude negatively) whether you are in fact doing something unethical.