If the data is normally distributed (as in bell shaped), the mean and median will be the same. The problem is that the data is probably very skewed, so the median is probably a better representation of the central tendency than the mean. Also, it's incorrect to say it only represents 2% of people; it's more that every person is only represented by their position in the set. Quintiles, quartiles, and percentiles work the same way. I like to think of it as everyone being a single vote, unweighted by value.

That said, if you wanted another acceptable alternative, you can also remove all outliers and likely return the curve back to normal. The problem there is you'd probably be removing every immigrant, so you wouldn't be representing all Americans. Pros and cons, but given medians are almost only used to describe data and not analyze it, since it's not compatable with a lot of statistics. A real analyst would probably just dummy code immigration in a regression and provide coefficients for both groups, anyway.