When you say you removed the front shims and driveshaft vibes went away, I'm assuming you were talking about front shaft vibrations? Why were you getting front shaft vibes? Do you drive high speeds with the front hubs locked? You will not get driveshaft vibes from the front if driving with...
Do you have front shims under the leaf packs? 2-4 degree shims make a huge difference with any front lift (leafs or shackles), and will most likely cure the 'wandering' issues.