A big part of it is that the rest of the truck is pretty rough. While it sat, I had forgotten and myriad of smaller issues that contributed to a frustrating vehicle.
In no particular order:
Seatbelts lock and take forever to slowly prod them to a sufficient length that they can be used
Rattles. Everywhere.
Painfully slow windows
painfully slow wipers - motor is HDJ81 specific
Useless rear defrost
Rattling mirror
Leaky windshield
RDL not working
Brakes suck!
Motor specific:
the motor pollutes so much it's embarrassing - even when it's warm and running relatively clear, the exhaust is cancer. literally. NOx for days.
Starting in the winter smokes out the entire block for 10 minutes
Performance isn't really that impressive even with the GTurbo @ 20Psi. LX has more HP and torque no doubt.
Fuel economy not impressive (often 20l/100km in the city, worse in the cold)
Cost of the motor rebuild would've bought my LX outright
Short oil change intervals. 2UZ did 16,000kms, 1hdt does 6000kms.
Always keeping an eye on the EGTs
The motor is reputed to be stout but I'm also paranoid since it failed once already. Feels like it's made of glass after spending $15k++ rebuilding it.
Diesel - $1.16c/L
Gas - $0.90c/L
Constantly fiddling with the boost compensator, trying to get a proper mix of fuel but not run too rich and kill fuel economy. I could see these motors being so much better in the FTE trim.
Highway fuel economy of a fully loaded LX on 33" ATs with RTT and supermoto on the back - 13.9L/100km
HDJ81 is doing about the same on 33's with the RTT.
I'm now into this truck for almost twice what I paid for my 2006 LX470 (which I just sold). The LX was better in every single way. Especially the motor. But also the chassis. I don't do the most extreme wheeling, but I never found myself missing diff locks where the lx had ATRAC. on-road, no comparison - 100 series all day.
I guess my only advice is to think long and hard about the money you're spending. How clean is solid is the rest of your truck? Mine has a lot to do with having a rough truck to begin with. If it was a super clean, tight and rattle free cab, I'd probably feel differently. Even then, it's painful to drive when -30'C hits and is infinitely less comfortable than my LX. It's hard to justify owning the 80 given the cost.