I debated with myself regarding changing the lifters when I had my head off my 4.0 WJ earlier this year. I ultimately decided that I didn't want to do the job again because of a lifter, so I put in a new set. Given the relatively low cost of a replacement set, it seemed like cheap insurance.
I do understand some of the arguments for not changing lifters and some folks will say you need to install a new cam with new lifters... blah... blah... blah... . But, I have put new lifters on old cams numerous times and never regretted it. So far, we've put about 8K on our WJ since the new lifters. So far so good.