How will we know if it is actually worrying, or if it's just regurgitating our own worries like a VHS tape of the famous Bladerunner or Hamlet soliloquies?
When it can provide its own answer, it will have already been smart for a long time.
I keep finding the Münchhausen Trilemma popping up whenever the possibilities of AI consciousness are discussed, more specifically I keep seeing circular and dogmatic arguments against it.
I only see "cogito ergo sum" or "there is a thought now" when I myself bring up those quotes.
Having an A-level in philosophy at mere grade E, I'm almost certainly less qualified than ChatGPT to discuss it, of course…
When it can provide its own answer, it will have already been smart for a long time.