Short of dismantling your Jeep, you may want to go into a decent hardware store. Sometimes in the Mom & Pops there is a Fastener section. You're looking for a real Fastener section where you can buy a nut or bolt by the each or even by the pound. If you can find a shop with one of these, you'll find all kinds of stuff like knobs for radios, bushings, springs, etc. Look around and more than likely you will find all sorts of plastic hole plugs in various sizes. Most of them can be painted to match your dash. No, they won't make the holes go away, but they will be plugged and your mind will tend to dismiss the plugs as "belonging there" as opposed to "what's missing?" You may need to drill out some holes just a bit to find a plug that fits.
Paved roads are just for getting you to the starting point!