Not so sure. When it comes to human hatred, big differences, petty differences and made-up differences work just as well as one another to motivate atrocities. Elves and aliens would end up on the list, but I don't think they'd hold us back from being awful to ourselves. Ultimately there's no real logic, so in what order that would happen is anyone's guess.