logoalt Hacker News

hypfertoday at 7:36 PM1 replyview on HN

I would be curious if this can do moderation with an arbitrary ruleset, or if it's just "that one moderation style" we already know from current big tech platforms.

The kind where malicious intent is okay if the words are nice.

___

Or, rephrased: How big is the space in which you can tune this model without retraining.

Is it just "we hate sex"/"we don't hate sex" "We hate violence"/"we don't hate violence" or is it _truly_ as flexible as claimed?

__

Maybe something like "Is this guy a corporate fraud that is going to waste my time with performative nonsense?"

That would be the true test for a moderation model and I would be immensely impressed if it could manage to pull that off.

___

Edit: Looking at the paper though.. probably not.

I suppose this is useful for B2B, which seems to be mistrals whole thing. Question is just if it is also useful for society to hand the SV prefab morals down like that. Kinda like cultural imperialism but with an ethical spin.

Maybe opinions on those base datasets could occasionally differ more than the model can be steered.


Replies

charcircuittoday at 9:47 PM

It sounds like it is. You have a set of moderation policies and then you evaluate the model 1 time per policy if it is violating it. Then you combine the results into a score you use for taking actions off of.