Did you ever figure out what this was? I've got the same thing going on with a newly acquired 2007 GX470 with 175,000 miles.
I replaced the blower motor and cabin air filter but that wasn't the fix. I changed the vent selection one time on this car and then barely any air would blow out so I do...