You can still add .json to any thread and get the full comments in a single object. The anti scraping features must be a rate limiting thing, because it’s very machine readable otherwise. They just want to push people to be logged in and use the app.
They are selling content to google et al for their LLMs and they don't want to give it away for free.