🤖 Two neurons are enough to make a small AI model "evil"
An interpretability researcher who goes by lyra posted a recipe: in Qwen3.5-4B, a small free model from Alibaba, turn one neuron up and another one down. "now you have evil qwen," the post said.
It passed 2 million views in two days, and people started posting their own "evil Qwen" results.
lyra says it isn't a jailbreak, since the refusal neurons stay untouched. What changes is the model's character. Flipping the same two neurons the other way doesn't make it extra nice, because many neurons act like on/off gates.
lyra says the poin
An interpretability researcher who goes by lyra posted a recipe: in Qwen3.5-4B, a small free model from Alibaba, turn one neuron up and another one down. "now you have evil qwen," the post said.
It passed 2 million views in two days, and people started posting their own "evil Qwen" results.
lyra says it isn't a jailbreak, since the refusal neurons stay untouched. What changes is the model's character. Flipping the same two neurons the other way doesn't make it extra nice, because many neurons act like on/off gates.
lyra says the poin