Why does it often seem like I'm surrounded (as an American...) by people who give literally not a single shit?

They don't know. And if you tell them, they would fall back to whatever racist, colonialist stuff they've been taught.