If there is grease in there, thru the square plug and no signs of leakage, I wouldn't mess wiith it, but that is me.
if there is no significant leakage on the ball, just keep the shims together and install the same when re-assembling the knuckle.
if you are going thru all the trouble to get to...