When we raise taxes on the rich, only a few of them move away.

Besides which, if a country raises taxes on income to the rich, even when they leave they will still have to pay the official tax rate on the income they visibly receive in that country.