I would ideally like a solution that builds it all out, and then allows me to download a docker container etc to deploy on my own...

Essentially a builder that i can then deploy on my own (cloud or local) infrastructure.

If I need to make code changes, I would come back to the website, make changes (version them with git) and build an updated docker container to roll out...