Personally, it's not worth living in fear of that small chance. If you're alone and they're visibly on drugs or something then yeah, better to just move. Otherwise we just let people get away with bad behavior.