Yeah, in the summer. In the winter most people that visit think it's warm. 90% of the country has either unbearable summers or unbearable winters or both, so SF wins despite the micro-climates (also if you don't like the microclimates just relocate 5 miles in any direction).
Personally I like seasons, but there is a huge contingent of people for whom some form of California weather is their idea of perfection whether that be LA, San Jose, or San Francisco.