Short of dismantling your Jeep, you may want to go into a decent hardware store. Sometimes in the Mom & Pops there is a Fastener section. You're looking for a real Fastener section where you can buy a nut or bolt by the each or even by the pound. If you can find a shop with one of these, you'll find all kinds of stuff like knobs for radios, bushings, springs, etc. Look around and more than likely you will find all sorts of plastic hole plugs in various sizes. Most of them can be painted to match your dash. No, they won't make the holes go away, but they will be plugged and your mind will tend to dismiss the plugs as "belonging there" as opposed to "what's missing?" You may need to drill out some holes just a bit to find a plug that fits.
Be kind. If for no other reason, it will confuse the daylights out of people and make them wonder what you're up to. And ALWAYS drink upstream of the herd!