1996 Xplorer Tire Swap

Hello All!
Brand new, just signed up member…
I am looking to change tires on my Xplorer and was thinking of moving down to 24" OD instead of 25"…. When riding more aggressivly i notice the rears rubbing under the fenders periodically. I have already turned the rear suspension all the way up…
Anyone have good or bad input with switching to the 1" smaller OD?
Maybe the suspension is the problem?