Wranglers have a terrible ride on the road. I didn't realize quite how bad until I got a turbo'ed VW for a daily driver and relegated my 01 Jeep to being the "fun" car. You can't drive fast. You can't go around a corner or turn very quickly. I like doing both of those things, so I got a sporty German car. Like the others have said, drive a Jeep similar to what you want before you buy one. Drive it a lot. I'm going to assume you drive somewhat aggressively, just going off your lowered Bimmer set up. You won't be doing that in a Jeep. They're super top-heavy, even more so with a hard top. Also, the lift will make the ride even worse and make you have to take corners even slower.
And if you do decide you want a Jeep, I'd recommend a Sahara. They have nicer seats, more chrome, more amenities. And don't pay extra for any off-road upgrades if you don't want to wheel it. Driving a Wrangler is completely different than driving a car, especially a sporty German number.
Hope that helps a little bit.
Currently: 2007 X: 2 Door, Steel Blue Metallic, Manual, Skyjacker 2.5" lift, Nitro 4.56 gears, 35x12.50x15 Grabber 2
Formerly: 2001 Sport: Black, Manual, D44, Stock on 31s but lovingly abused (I loved that rig.)