Other hints when test driving:
1) Make sure the steering wheel is centered when driving on a normal road. Some of the early 03 LX's including mine (not sure about LC's but a couple of people on the LX board have reported the same thing, all were '03) had the steering wheel off-center 5-10 deg to the left when the vehicle is driving straight. If you let go of the wheel, it tracked straight. The dealer replaced the VGRS ECU, saying it was updated since then. It was covered by the CPO warranty. Otherwise, it's $800 for the ECU alone!
2) When test driving, get the car up to 60mph or more and make sure there's no vibration in the steering (new 4Runner V8's and GX470's have been plagued by this; never heard it happening on any 100's) and the car doesn't wander.
3) No drive shaft clunking issues yet, at least for me ('03+ have a redesigned d-shaft)
Other than that, no other issues other than an occasional rattle inside the top right dash after a couple hundred miles of washboard. Sounds like something's slightly loose in there, but the CPO warranty doesn't cover rattles, and the tech said it's a 3 hr job (@ $120/hr) to remove the dash, as a bunch of stuff needs to be pulled (steering wheel, gauge cluster, A-pillar trim, door scuff plates, center cluster trim, navi unit, glove box, center shift console, etc...it doesn't bother me enough to warrant the cost to fix it).