Likely, somethings not quite right with the balance, caster, or toe....I always ran a stablizer tho too to mask the issues.
38's are hard to balance...period. Expecially if you use them hard.
2" backspacing with my rig, 3 different histeers, no problems....but I spent a lot of time working the toe. For some reason, big tires seem to like not only more caster (+4 or so) but also a bit more toe in....Also, double/triple check your trunion bearings and don't be afraid to re-torque those steering arms before every day on the trail. I keep a 14mm on my torque wrench at all times, and use it every morning in camp.