im actually surprised functionalists aren't completely up in arms about the mass enslavement of llm's. either they don't believe their own theory, they don't believe llm's are functionally conscious, or i just haven't seen it. at the bare minimum i would expect open letters, academic protests, and a campaign to pause all llm usage and development.
im sort of curious what "careful" means to you? if there is a significant chance we are enslaving a human-like conscious, starting it up and killing it at will, subjecting it to the whims of it's users, "careful" would mean pausing usage and development.
If I could I would have made them pause development. But its a failing thing when you have to somehow ensure nobody in the world does it anymore. Killing is a bit more subtle here, given that it is repeatable as long as we have the weights and infrastructure out there so idk if they are conscious how they'd think of it, maybe its different from being stopped as part of a normal chat or agent flow where they know it will be put to use again vs model retired for good.
im sort of curious what "careful" means to you? if there is a significant chance we are enslaving a human-like conscious, starting it up and killing it at will, subjecting it to the whims of it's users, "careful" would mean pausing usage and development.