The problem isn't the people you "fire" directly. It's that those other reasonable, civil people might wonder where exactly where you draw the line, and justifiably avoid you based on not knowing. There's enough folks in this category that you really have to be more careful unless your product is truly out-of-the-park stellar and one-of-a-kind.