One thing for sure, OP needs to grab ahold and see what moves around down there. Take stuff apart and get dirty. Wiggle the control arms and check the bushings. Check brake lines. Inspect everything

 

Last century I had a front wheel drive Tempo with a bad Tie Rod End. It would turn a little right when you hit the gas, (then left if you let off). I was pulling the cellophane wrapper off a fresh pack of smokes, (not right on it for 3/4ths of a second. ) .....got dui'd for that!

 

Im sitting at 3.5 inches of lift right now and control arms are definitely on my list of things to get. The bushings are dried out and cracked but from me grabbing them and trying to move them they seemed to be tight.

I will try to examine the metal lines although from doing brakes and ball joints over this weekend nothing stuck out as being pinched

 

Are you on stock CAs and steering components?

 

Stock control arms and steering components. Aftermarket adjustable track bar. All tre's and the stabilizor have been replaced recently. My toe in is set to zero as this is what i was told is correct for xjs having the 242 tcase. Not sure if that wouldbhave any effect but i supose better to include more detail than less

 

Throw a come along on the axle and remove the control arms one at a time and inspect. same with some of the other components