I've only left a job because of the boss one time. The other times were mainly because I was either unhappy with my role in the company or to pursue other career opportunities that presented better/more diverse challenges and superior compensation packages.