The anti-google glass argument bears a striking resemblance to the anti-camera phone argument back in the 90's. The complaints were pretty much the same, "cameraphones" started to be banned in certain places, and there were even the local news stories to the effect of "Bathrooms will never be safe again - that phone could be a camera!" People got used to it, acceptable norms were established, and they became very much ubiquitous, and uncontroversial.
In the 19th century, the Kodak Brownie was banned from beaches and the Washington Monument over concern of camera fiends:
"The appearance of Eastman's cameras was so sudden and so pervasive that the reaction in some quarters was fear. A figure called the "camera fiend" began to appear at beach resorts, prowling the premises until he could catch female bathers unawares. One resort felt the trend so heavily that it posted a notice: "PEOPLE ARE FORBIDDEN TO USE THEIR KODAKS ON THE BEACH." Other locations were no safer. For a time, Kodak cameras were banned from the Washington Monument. "
Not uncontroversial. There regularly are problems with invasion of privacy, for example a few months ago there was trouble with an Argentinean blog with photos of girls in public transportation (can't find a link right now, but it was on TV, etc..).
