That can only leak which closed primary the person chose to vote in. It could be that some of your neighbors vote tactically for the least-bad Republican in the primary and then vote for the Democrat in the general, especially since you're surrounded by Republicans and may not have a lot of Democrats running for office locally (making their primary uninteresting).