The only rational way to look at it is as a tool that can be used by humans to do useful things, but ultimately the human must always be one making decisions and held responsible. In my opinion, the most powerful bit was at the end where Ted Chiang shows how clearly Anthropic doesn’t really treat Claude as being conscious, because the kabuki theatre they’re putting on with their constitution would be woefully inadequate to protect the rights of any conscious entity.