How will we know if it is actually worrying, or if it's just regurgitating our own worries like a VHS tape of the famous Bladerunner or Hamlet soliloquies?

When it can provide its own answer, it will have already been smart for a long time.

How do we know a person is not regurgitating worries?

Assumptions, and often incorrect ones at that.

I keep finding the Münchhausen Trilemma popping up whenever the possibilities of AI consciousness are discussed, more specifically I keep seeing circular and dogmatic arguments against it.

I only see "cogito ergo sum" or "there is a thought now" when I myself bring up those quotes.

Having an A-level in philosophy at mere grade E, I'm almost certainly less qualified than ChatGPT to discuss it, of course…