Then you can choose to disable public vote visibility. That's been available to uploaders for years. Of course, channels that produce good content generally don't do that, because their vote ratios are evidence of their quality.