Disabling zoom is done independently of CSS RWD, and should generally be avoided for the accessibility reasons you state. Preferring zoom-and-pan to scrolling is a separate issue, but I haven't seen or heard much to indicate its a common sentiment.

It sounds like what you dislike is poorly done RWD, which only addressed the aesthetic of the small viewport and not the unique navigation & content challenges (unfortunately common).