When ancient Romans ran their villas, they were really, really careful to ensure their guards and house slaves were well treated - often better than most free workers and soldiers - in accordance with the times. In many cases, those people were treated like members of the family.
They did have more disposable slaves, but those were typically not in any position where they might interact with anyone in the villa.
The Autocrats who bullied or sadistically mistreated their "loyal servants and guards" would very often find themselves in a fatal position.
Slave revolts are always a fear in Autocracies or Plantation Societies.
In a remote island or walled compound, it's going to be really, Really difficult to get new people coming in willing to put up with your shit after you've already screwed everyone over. At least anyone you can trust.
And I can't see Tech Bros or Prosperity Gospel "Financial Wizards" treating anyone, even their "peers", with respect or dignity unless they felt they were going to get immediate gratification if they did so. The true believer cult members they might be able to bring with them to play staff and servants aren't going to remain cult members very long, and if they bring mercenary types - well, when the world economy and trade collapses, dedication isn't going to last very long.
Unless they think they've got enough Robots. Autonomous Farms, and AI to keep them, a small automated army, and a minimal staff going...
But having enough Robots and automation to keep a single Elysium settlement running, fed, and comfortable is still a good 50 to 100 years away in - a good economic environment.
If they're planning on escaping while plunging the world into Thunderdome over the next 5/10 years - they're high and stupid.