"there is no incentive or a very small incentive to choose the candidate with the best policies, because the chance of your vote making a difference is so small" is a theoretical argument about rational actors, not an observation about actual people. The paper I linked argues that it doesn't hold. It also argues that there's some real-world evidence that people vote for social reasons.
Regardless of how a person votes, they're voting for a feel-good reason.
Some people's identity gives them pleasure in voting for the candidate that rationally maximizes the Good, for some subjective measure of the good. These are the 'social preferences' Gellman talks about.
Some people's identity gives them pleasure in the tribe, and they want to vote for the people like them and around them to fit in, especially so they won't be confused with the Enemy.
Pretty much everyone has both tendencies, which are inherently in tension. This is cognitive dissonance. People don't like experiencing this, so they end up choosing to believe both in tribal politics and that their tribe is the rational one, which is the most convenient way to cut that Gordian knot.
Now, we can debate which tribe is more rational. I think currently in the USA the blue tribe has more people motivated by the desire to be seen as rational. Then again, we'd also predict that's what everyone thinks. So probably that debate wouldn't be productive.
This experiment is useful because it tells us that money is a very useful way to cut through the bullshit of tribal beliefs. It also might give us hints as to how to design our electoral system to tend toward more rational options.
> Pretty much everyone has both tendencies, which are inherently in tension. This is cognitive dissonance. People don't like experiencing this, so they end up choosing to believe both in tribal politics and that their tribe is the rational one, which is the most convenient way to cut that Gordian knot.
And in addition, the more and more fiercely we tribally associate, the less and less we want to do with the other tribes. This has gone to the extent that certain fields of employment, or even fields of science are largely owned on tribal lines.
Conservatives largely outnumber liberals in fields like agriculture, while liberals dominate social sciences. This sounds fine, but peer review demands cultural diversity as well, or our own cognitive bias imparts blind-spots on the work. The only fix for those blind spots is cultural diversity, and the only way people can be happy with that cultural diversity is to re-tie their Gordian knots and learn to accept other people as other people, and not the devil monsters we tend to equate them as today.
Both you and the previous commenter seem to be talking about the polarization of politics as if it's an inevitable feature of human social interaction. But I think that's a little overly simplistic.
The current extreme polarization in the US is new and fairly unusual, in historical terms. It could be an inevitable phase that other counties will reach too, or it could just be a random artifact of the US's history and political system. Very few countries have a voting system that locks in the main two parties as strongly as the US, for example.
The idea that all politics is purely about tribal identity, and that "rationality" is a myth, would seem to suggest that we've never made any real social advances. But I'd count things like the outlawing of slavery as advances.
It reminds me of the extreme view of social structures in science (which Thomas Kuhn subscribed to, if I remember right), that all scientific "advances" and "revolutions" are just changes in fashion as one generation of scientists succeeds another. But each advance does in fact get us closer to the truth, even if we never quite reach it.
I don't think it's at all inevitable, nor do I disbelieve that political polarization is new. That said, tribal clustering is as old as time.
Without getting into the whys and wherefores, my main concern is that as we eliminate some forms of tribal clustering (ethnic, gender, class, etc.) we are simply replacing them with other forms, namely political affiliation or wedge issues. Particularly, I'm concerned with tribal clustering on wedge issues that don't affect the quality of work a person might do.