I have a 95 grand Cherokee limited and it won't shift into 3 rd unless u let off the gas..... And there is no check engine light on.... What could it be

Adjust the throttle pressure cable. Do a search on this forum for the details on how to adjust it.

I have a 93 Limited with a similar issue. The 2-3 shift point is late, espescially when cold. However it will shift eventually but i can make it shift at a lower RPM by backing off the pedal like you describe.

From everything i'v read it sounds like a shift solenoid. Mine has been this way for three years and hasnt gotten any worse, but i'll be attempting a fix some time this summer.

The shift solenoids are kind of an easy fix, just cost some money for the parts.