If you setup your dotfiles correctly, your vim environment should be accessible with a simple `git pull`.

The plugins are very worth it, there's no need to handicap yourself locally just so your environment matches some bare bones server config.

And regardless, the basic vim motions are always there - you don't lose much when just editing some config files on a server even if you have to use vanilla vim