I'm unsure if the comparison to more standard automation is totally apt (but agree if you rob people of purpose which many get from their jobs, lots and lots of bad shit happens), but what you're poking at is frankly nightmare fuel. Look how much chatbots that are in sycophantic "romantic relationships" absolutely break people (there was some subreddit linked once recently full of these types), and consider what happens when they're actually manifested. I'm sure some lolbert types will be like "but muh freedoms", but that sort of shit is so dangerous and so destructive on the same way brown glass bottles are to Australian jewel beetles, that we damn well better crush any of that and anyone that proposes producing robots like that. They're basically weapons and should be treated as such.