I wouldn't worry about it. Mine behaves exactly the same. The only time it really bugs me is when waiting in line at toll booths and stuff because instead of just letting off the brake I have to gas, brake, gas, break.
2008 KK sport 4x4
1998 XJ sport 4x4 (sold)