I bought a '67 CJ5 a couple months ago, and I couldn't be happier. That being said, I have been turning wrenches on my own vehicles since before I could legally drive, and minor repairs don't scare me. I bought mine, almost completely rust free, complete with aftermarket hard top, PTO winch, overdrive, running and driving, for $3k. I knew what I was getting into, and have had a blast getting her to be as reliable as she is now. She's my baby, and will be with me long term. My wife is picking up a YJ soon, and while they're similar, they're also worlds apart. The YJ is going to be a fun DD, and an occasional backwoods driver. The CJ is a dedicated woods wanderer, and summertime fun machine with the top off.
Don't try to make the CJ something it's not, know that it's going to be a rough and ready trail machine, and that's about it. Know that your creature comforts are going to be what you bolt into it, but the huge advantage is that they're dead simple to work on, and you can accomplish just about any task on the thing by yourself (unless you have to pull motor/trans/transfer case). I'll echo what others have said, $2500 sounds a little steep for what you're getting, at least around here. For that money, you could get something at least complete, running and driving, without huge rust issues.