@MH_Stevens
If you were in my neck of the woods (Denver) I just have you come by, and I'd inspect for you.
Zero point calibration is not something normal needed. VGRS equip systems (lexus). These system when battery disconnected will flash VGRS on dash. One just needs to drive in a straight line a few 100 yards at 35km. ~25MPH. VGRS Light goes off. Than make normal right and left turns. I like doing figure 8s.
I get sense your wheel bearings are loose, you may have bad ball joints and or TRE, power steering issues along with brake issues. Your brake fluid may also be low.
If this the case were looking at and under maintained rig and or improperly maintained. I find dealership maintained, improperly maintained all the time. INDY shop can really mess these up.
I've a number of threads you can read through in my links in signature line. Start with master (first link) and look at my restore projects. These go go through very extensiveness inspection and restore work. Look at Snowy and The Unicorn for most in depth. These are not step by step, but over views. Reading these may get you on to right tract. If you don't have the mechanical tools and skills. I suggest you find a shop that specialize in 100 series. Or club member in your area, that can help you inspect.
Get a copy of your years maintenance schedule. It has something required done every 5 or 7K miles. Mostly fluids. But other things like inspecting area, wheel bearing service, etc... Don't just settle for what you can find in parts, go after OEM parts. Be them from Toyota or Toyota's suppliers like Denso, NGK and Asian to name a few.
Build a list, start with safety stuff first.
Good luck my friend.
Edited to correct error in ZPC being only LX. It is done on LX or LC.