There are a lot of degrees of "off grid". Society also includes less dense (non-urban) regions. Being miles away from your neighbors permanently isn't a crazy idea if you live in Kansas, yet they still have a coherent civilization.

It isn't very hard to reinterpret this critique as a kind of crab bucket mentality. God forbid someone goes off on a crazy boat trip for a few months without first consulting with "society".