Have a 2001 4.0 xj. Live in Ohio and weather is pretty cold. Went to start my jeep the other morning and it gave me solid clicks off the starter. So I just assumed that was the problem so I replaced it. Was fine for a few days. Went to start my jeep this morning with new starter and I could hear the starter motor try to engage but it was like it was froze I truly don't know to describe it... Anyway I just held the key for atleast a minute it kept doing this not cranking and making the weird noise from the starter. And finally it cranked and fired right up. This has only happened twice and it's been cold each time. Since I've replaced the starter two times all together I am truly thinking it's something else just don't know where to look. Don't want to end up stranded somewhere

 

I hope you're not getting your starters from Autozone.

In addition, check your battery cables for cleanliness and proper grounding. They can also corrode inside where you can't see it and cause low voltage to the starter.

If you keep holding the key in start mode for a long time like you are doing, you're going to break or burn up something.

 

Cold temperature + starter clicking = dead battery (usually)

Cranking it for a minute is a good way to kill a battery/starter though, even if that's not your problem. Verify you have 12+ volts cold and that it charges up the 14-15 when idling.

Cold start problems can be from alot of things... too much air getting in (vacuum leak), too much fuel flooding it, weak ignition parts, weak injectors, bad grounds, etc.

 

Did the lights dim or go out?