I recently finished The Southern Reach trilogy. They're about an anomalous region that defies scientific explanation, and the people surrounding it. Even when I didn't really know what was happening below the surface (which was often), I found them highly compelling.

Of other media I'm familiar with, I'd compare it to House of Leaves and Control in that it's weird but not exactly supernatural or paranormal (the Control devs have even cited these books as one of the many inspirations)

You might recognize the first book's title, Annihilation, as a movie from 5ish years ago with Natalie Portman and Oscar Isaac. It's a very different plot, but uses a lot of the same pieces.