Nope, we had a customer have a shop install a Big Brake kit and afterwards he swore something was wrong with it because every time he stepped on the brakes it pulled to the right. The harder he used the brakes, the harder it pulled. I ran him through all the typical diagnosis and the only thing he wanted to hear was that something was wrong with the kit.
I finally had him bring it to me and we checked everything. About 90% of the way through, he tells me that one rotor did wobble a bit when he was putting the tire back on. I asked him why he didn't mention it and he said he looked it up on Google and it told him that it is okay for the rotor to wobble until the rim clamps it in place. I told him that was indeed correct unless you happen to have wheel spacers, which he did have.
Replaced the unit bearings, problem went completely away.
I've seen bad clevite bushings do similar. Especially if you get a bad upper and lower on the same side.
Since the OP has new U/B's, I'd look at control arms and toe in as well.
Yeah, it makes sense when you put it that way.
Current: '00 TJ Sport
Past: '98 TJ Sport - lots of aftermarket