Wranglers have a terrible ride on the road. I didn't realize quite how bad until I got a turbo'ed VW for a daily driver and relegated my 01 Jeep to being the "fun" car. You can't drive fast. You can't go around a corner or turn very quickly. I like doing both of those things, so I got a sporty German car. Like the others have said, drive a Jeep similar to what you want before you buy one. Drive it a lot. I'm going to assume you drive somewhat aggressively, just going off your lowered Bimmer set up. You won't be doing that in a Jeep. They're super top-heavy, even more so with a hard top. Also, the lift will make the ride even worse and make you have to take corners even slower.
And if you do decide you want a Jeep, I'd recommend a Sahara. They have nicer seats, more chrome, more amenities. And don't pay extra for any off-road upgrades if you don't want to wheel it. Driving a Wrangler is completely different than driving a car, especially a sporty German number.
Hope that helps a little bit.
2001 Wrangler Sport 4.0 (sold)
2009 VW Jetta Wolfsburg Edition 2.0T (sold)
2008 Ram 1500 4.7L TRX-4 (current)