What gives rich men power? Do the money themselves cast a "follow my owner's will" spell on those around them?
No. It's the desire for a share of that money, of that power that generates the power in first place. And that desire exists in everyone's mind. In your mind too.
This is a human problem, not just a rich people problem. Because what power is it exactly? It's power to have other people do things for your benefit, either to work or to give up their possessions.
We need a way of organizing work for each other in a society. As well as the value of possessions. The problem is in the fairness of the way these possessions and work are valued, because we seem to have allowed ourselves to possess profits from the undervalued work of others. The accepted unfairness of such trades is the problem.