I use colemak and vim and it works just fine, but I first learned colemak and then got used to vim. I use the vim defaults, no custom keys. I tried customizing keys for a short while but quickly decided to keep to the defaults to make my muscle memory work on any box I log in to.