Unless you have small hands than yes. Good thing is that the dash doesn't need to be completely removed. Get yourself 4 bolts with the same size threads, but they should be maybe 4-6 inches long. Put one of these in each corner of the dash, remove the other 6 stock bolts (I think it's 6) and then pull the dash plate away. This should give you enough wiggle room to change speakers, gauges, work on wiring, etc.
Hope this helps......
You can get under there without pulling the dash, but it's tough.
I would strongly recommend getting component speakers (separate tweeter and woofer). I'm normally a deal seeker on stuff like this, but I bought my green Jeep with a set of components in there and they sound SO much better than any of the speakers I've tried with a tweeter in the middle of the woofer. This also takes away the issue of the center-mounted tweeter hitting the backside of the grill. You can use spacers on a two way speaker, but I think you lose some sound quality that way.
I've had Pioneer, Polk, Kenwood, JBL, and Infinity in the dash of my tan Jeep over the last 20 years. The green Jeep I picked up in 2002 and it had Pioneer components in it. They sound better than any of the ones I've tried, and they've lasted longer. Just worth the extra money in my opinion. The PO mounted the tweeters above the oil/ volt gauges. I plan to move them to the rollbar pad pointing down at the front seats when I take the dash out to paint it (probably be another 20 years, but that's the plan)
Dang, after searching these things have gotten cheap. Think I might get a set for the tan Jeep!
Thanks to all of you for your suggestions. I kinda stumbled on an easier solution for getting to the passenger side speaker - I tore out the deteriorated cardboard glovebox (which gave me easy access) and replaced this with a new plastic one ($20 bucks).
How do they sound? I need to replace mine as well and I am having a hard time finding a quality speaker that does not have the tweeter sticking out.
You can also use Jeep TJ speakers that are found in the sound bar that's mounted to the roll bar. Their 5.25" and can be flush mounted onto the Jeep CJ dash and can be bought at most junk yards for cheap. Just make sure you get the plug portion of the speaker wire so it makes it easier to install them.