I'm not very familiar with XT32. And I live in a building with neighbors, so I don't have much experience with subwoofers either.

But at first glance it appears the majority of the (over)correction is right around the typical crossover region (80Hz).

Do you in fact have the crossover set to 80Hz?

Does your sub have a switch for flipping the phase?

Also, where in the room is the sub located? In a corner?

What about speaker locations?

Can you post a pic of the speakers and sub location in the room?