Out of curiosity, how was it discovered? You would have to look for it to find this linear combination.
Without the system prompt, asking its name results in it responding with the name of the model they're ripping from. That would certainly draw your eyes to the right places.
Check the linked GitHub issue. They explain their process.
Scroll past the first issue to find it. It’s further down.
Without the system prompt, asking its name results in it responding with the name of the model they're ripping from. That would certainly draw your eyes to the right places.