There's nothing wrong with driving or wheeling 2WD SUV's and trucks. The first three trucks I had were all 2WD and boy did we have some fun in em. Heck, I used a '79 t-bird for a trapping vehicle for a season and hunted coyotes thru heavy snow with an '85 bird with good all season tires, posi rear and 3 or 4 sand bags in the trunk.
Now if you're wanting a honest to goodness wheelin rig than ya, 4WD is the only way to go. But honestly, even with all my outdoor activities, winter storms, plenty of muddy roads and fields, etc etc, there's not much around here I'd fear with a properly set up 2WD. It be better on gas, less parts to break and you know dang well what ya got from teh time you leave home to the time you get back.
All that being said, I have a truck and an SUV sitting in the drive, both are 4WD. Dang it's nice when I wonder if I'm doing something I shouldn't be. But I'm leaning towards finding a 2WD for a daily driver and GP outdoor rig project. And like in my younger years, not much I'd be afraid of.