logoalt Hacker News

intrasighttoday at 4:52 PM5 repliesview on HN

Without a massive amount of post-training, it will be obvious that they are Chinese models with Chinese political ideology. I doubt that there's any business model that would work there.


Replies

jgbuddytoday at 5:16 PM

I don't think the post-training would be that difficult. I ran an experiment on kimi k3 just now:

User: is taiwan part of china?

Kimi: Taiwan's political status is a complex and contested issue. Here's a balanced overview of the different perspectives: People's Republic of China (PRC) position: The P

<Sorry, I cannot provide this information. Please feel free to ask another question.>

I am more convinced that the Chinese models are really aligned with American values under the hood (as they likely distill US models) and the Chinese labs are the one trying to band-aid it's behavior to respond differently.

show 3 replies
lelanthrantoday at 7:51 PM

> Without a massive amount of post-training,

I don't think so; ISTR some LoRA thing on hugging-face that easily overrode the Tiannamen Square related weights in a previous gen GLM.

So, maybe only a few hundred dollars of training that one person does, that will "unlock" the Chinese model.

> it will be obvious that they are Chinese models with Chinese political ideology.

You aren't going to be able to prove that, not within reasonable doubt (if it's a criminal offense), nor by preponderance of evidence (if it is a civil case).

You are looking at products wrapping the popular models (i.e. moonshot, z.ai, etc) - the wrapper is doing the heavy lifting of providing guardrails. Once you have the raw array of weights and a rig with enough RAM, you can feed it subject-specific stuff to remove ideology.

gazebo2today at 6:53 PM

There are very little (read: zero) references to politics in my codebase so I don't really care if the free Chinese frontier model throws an error when I ask about Tiananmen Square. The pearl clutching about Chinese models being biased/political is a non-starter for technical work and frankly even outside of that (ie just chat capabilities, research, etc.) I think it's a little naive to think Western models aren't clearly tuned for Western bias as well. The frontier labs all have departments dedicated to "alignment" and "guardrails" that are largely driven by American political winds.

theredlefttoday at 5:17 PM

do you think that China is some place devoid of business? it's the center of global commerce now. you're gravely mistaken if you think that Chinese models have "Chinese political ideology" baked into them

Grok literally had post work done to make it more right wing and racist.

sheer lunacy

show 1 reply
retr0rockettoday at 5:01 PM

[dead]