I've seen some mechanics having good success with the Snap-on strap oil filter remover. Yeah, it can crush an oil filter but just move it up near the base and you can even use a pipe on your ratchet handle for leverage if need be.
Breaking/cutting the seal may be your best bet along with using a strap oil filter remover. But that Snap-on one w/the pic I posted seems waay too pricey at about $30.
Here's a write up removing the oil filter adapter and believe the Torx size is T60. I may have to double check that since I have a post in that thread where I said I used a T55. It's one tight fit, have a 96 4.0 just like yours, and removing the bit from the socket it comes with as posted below may be the best route.
Regardless, I had to use a big 10" pipe wrench with a pipe on the end to break the bolt loose. Tricky in not damaging the metal on the adapter next to the round bolt head in doing this. Also had to put heat to it but I didn't have an oil filter full of oil attached to it. Didn't matter if I might melt those o-rings, but they didn't, since had the Mopar 3 o-ring set from the dealer for only about $5. See the beginning of that thread for part number. Good luck!
Some of the oil filter adapters (like mine) use a 9/16 Allen head. I used a threaded rod coupler for 3/8 rod. It's just a 9/16 nut about an inch long. Put a 9/16 box end wrench on that and double wrenched it. Came right off.
Had this issue with with a 4.0 I rebuilt a few months ago. I took a flat head screw driver and pryed the base of the filter away from the filter adapter. Sprayed the oil filter base with PB Blaster and used a large pair of adjustable jaw pliers to spin it off.
__________________ His: '00 WJ 4.7 Limited- Zone 4" SA lift, JKS BPE's, 242HD Swap, 18" JK Sahara 'Phone Dial' wheels, 255/70/18 Bridgestone Dueler A/T's
Hers: '03 WJ 4.7 Laredo- IRO 3", 245/75/16 Duratracs, Bilstein Shocks, JKS TB w/KOR Bushings, Rusty's A-Arm Spacer, CORE4x4 Adjustable Front Control Arms, Dynomax Exhaust, RB1 Nav -Coming Soon- Overland Rock Rails