When you put a website live on the internet, you're giving everyone permission to access it, including Google, unless you state otherwise. (Or put processes in place to make it non-public.)

So yes, you do allow them to visit your website.