Good point about the karma limit. I was writing under a different assumption.

What I was proposing in my earlier post was exactly as you say: explain the downvote.

Maybe let everyone downvote, but have tiny radio buttons with reasons next to them. :-)