I sometimes think about how norms have changed. People are more neurotic and more longing for safety than before. If the Internet was invented today, it would likely work that way. (Though another aspect is that when the Internet was invented it was simply technologically impossible to do a deep semantic scan of messages.)
Similar thing is that I believe if motorcycles were invented today they would most certainly be banned from the road due to their safety properties.
There needs to be a balance. It feels off, today & consequences of future, that technology has led to the collapse of privacy.
And as we progress we will need to rationalize what it means for private companies, AI, to know everything about you and for the government to have a tap into that. I hope balance lands in favor of things like privacy preserving underpinning.
Government would have to explicitly ban companies from surveilling, but they are fully incentivized to want the opposite: government naturally wants maximum amount of info to have the most agency, to know what's going on, to be prepared for any threats to itself, to make sure things are running smooth, that taxes are being paid, that regulations are being followed etc.
Similar thing is that I believe if motorcycles were invented today they would most certainly be banned from the road due to their safety properties.