Your clutch may be bad. The bearings are probably starting to go. Remove the clutch plate and take a look. It's only one nut and you don't have to remove the compressor or anything.
When I was diagnosing a noise/problem with ours I had my wife turn on the AC. The clutch came on. I told her to turn it off. It stayed engauged. Turned out the bearings had gone bad and the assembly was loose enough to keep the clutch engauged.
I bought the assembly from Amazon, paid like $100 for it. It wasn't too hard to replace. I had to buy a nice pair of snap ring pliers (my cheap ones wouldn't open enough). But I like justifying the cost of tools by reminding myself I am saving a ton on upsale parts and labor.
82 Cherokee WT - SOA/SF/agr box/Borgeson ujoint steering shaft/401/performer/holley TA/HEI/BeCool/727/np208/d44(aussie)/amc20(ARB)/BFG 35X12.5/Corbeau Moab Seats/RCI 6point Harness,Hella Aux lights/tuffy console/killer32 slider bars/custom bumpers and roll bar/Alpine head unit/amps/speakers 2002 Liberty Limited Early edition - Basically stock