And yet everyone must live in a society subject to policies that are enacted as response to racism or supposed racism.

To suggest that people should be absolutely silent and not contribute to the discourse that leads to policies that affect their lives is morally abhorrent. Ask them to weight their opinions, sure but telling them to shut up is absurd.