My plan is to take it all out and clean it, then pop it back in. I see no visible screws, but I don't want to just rip everything out and screw something up.

I guess the first step would be popping the transfer case shift cover off?

EDIT: I have an aftermarket cover on the top, towards the right of the picture. I know how to get that part off.

 

There are some screws within the storage area of the console--looks
like you have a cup holder on top of it. There is also a screw under the plastic piece for the 4wd shifter. At the top near the emergency brake there
are two screws that hold the black piece on. If you go forward of the
shifter assembly there are a couple of screws, kind hidden from view. For some detailed pictures
there is a website called greatakesxj.com. You can download parts catalogs that show where everything is. Hope this helps!

 

1) remove shifter handle
2) remove bezel at base of shifter, there are 2 screws there.
3) remove tcase cover, 1 screw there
4) 2 screws at the top of the black part under the cup holder thing. The black thing should pop off.
5) rest of the screws will be visible

 

Got it out! Only an hour and I managed to take it all out, soak em in hot soapy water, hose em down, clean some of the crevices out with a toothpick, and put it all back in.

I also noticed the light behind the shifter map wasn't even in place -____- I always figured there was just so much dirt that the letters (P, R, N, D, etc) couldn't get much light through. Turns out the bulb was just popped out.

Anyways it's looking new now! thanks guys!