Well, by increasing attack surface you do introduce potentially more vulnerabilities.

And this ain't a fairy tale - lots of stories about AV MITMing traffic, introducing unsecure endpoints, adware, etc.

By increasing the defense surface you do remove existing vulnerabilities. Also disabling Defender is reducting the attack surface