logoalt Hacker News

solenoid0937yesterday at 6:59 PM2 repliesview on HN

You aren't understanding this at all.

The frontier labs have hundreds of the best people in the world working on safety and alignment. They care deeply.

What happens when some random Chinese open source model, distilled on Astra, gets alliterated and now has no guardrails? Any script kiddie in the world could wreak havoc with it.

It turns out that guardrails matter.


Replies

w4deryesterday at 7:11 PM

> They care deeply.

Until it clashes with their quarterly revenue reports.

show 1 reply
mayvyesterday at 9:48 PM

It is hard to take their concerns for safety seriously, when they have been constantly talking about how dangerous their latest model is, before then deciding to release it to the public.

show 1 reply