What's the argument here? It's not about the implementation method, it is about the behavior that emerges from it. You could calculate the next token by hand on paper if you had enough time.
It's incredible how the “Chinese Room” argument, as well as its counterarguments, is still incredibly pertinent despite being now more than 40 years old. Scientific American published many articles on this topic in the Eighties; they seem as fresh as ever.
Matrices are an implementation detail in reconstructing the surface of human knowledge. It's a complex surface, but it's a regurgitation.