My guess: As a problem that I feel threatened by becomes a greater target for action by society, the solutions enacted by society feel like an unnecessary imposition on me--since I don't believe the problem to be real--and the (potentially) building consensus around that problem makes me feel as more of an outsider. Not feeling like a part of a society's approach to that issue may lead me to withdraw from that society in a continued effort to deny the existence of that problem, which is to say not being confronted with society's narrative.

As my opinion on a problem diverges from society's, I fit less and less with that society, prompting me to withdraw from it.