I would not take the disk off of the shaft. The pump is very cheap, and it comes with a new disk. If you apply pressure on the shaft, then it will surely leak in the future. I suspect that that is what is leaking now via the weep hole. I would hate to get it back together only to find that you really need a new pump. Prophylactic pump replacement is a good thing.
'06 XK Limited, 5.7L Hemi, Quadra-Drive II, Black, 118K Miles
'02 WJ Overland, 4.7L HO, Quadra-Drive, Inferno Red, 98K Miles