I think it’s an interesting idea, and that it could lead you and your party to explore some points of view that you might not otherwise get to really think about.

Your idea is making me think of the Asperger's community, as that’s the one I have the most familiarity with. Some mage class maybe.

If you want to do it right - that is, really use it as a learning experience - I would say read the bios of people like John von Neumann, Murray Gell-Mann, John Nash, and most especially Paul Erdos. These were some of the most brilliant mathematicians of our time (Murray was the guy who discovered quarks). George Price, too, although that one is pretty sad.

I am going to say that it’s going to make it a burden on your party members, and you should do it with their buy in, not make it part of the plot line that they discover it. If they’re not aware of it as a character trait and if you play it to the extent exhibited by some of those I mentioned, you’re just going to come off as an asshole. It’s really going to make things harder on everyone if you do it right. It’s a spectrum, so some in. The community can end up building self-awareness and develop coming mechanisms, but that wouldn’t be the point of playing that role.