“Come to a conclusion” is probably wrong; “synthesize a response to a prompt based on the training data provided” is probably closer. Still, it’s what you and I would do when answering a question using information we’ve accumulated from reading various sources.
seems you're getting unnecessarily hung up on the "how" of it.
planes fly but not like birds. does it matter from an "object moved from point A to B through the air" point of view? not really.
LLMs are kind of the same. it's obvious from even the most cursory examination that they're doing something quite different to statistical word mashing. is it being achieved in the same way as your gray matter? no.
Considering the argument is irrationally applying human rights and rights of living beings to these computers running mildly complicated software, yes the "How" does matter a lot.
The concepts of lift and flight actually are the same for birds and planes and insects and drones and hellicoptors…… or fish! And whales. And any other organism that uses voyance and lift to ‘fly’ through the ‘medium’.
Every form of intelligence we know of is operating in a fundamentally different environment to what these programs are doing.