How did certain people end up in control of the rest of the world?

I want to understand this at it's core. At what point in time was it that the so-called "elites" took advantage of everyone else? Is their influence world-wide or strictly in certain regions? How did it happen? Is destabilize them possible or are we sort of cooked for the rest of humanity's existence?