It’s well documented that there is no fuel gains going from full-time to part-time in a 803rd gen 4Runner is definitely smaller than the 80 series. It's a great car. I thought it's Achille's heel was the lower balljoints. Terrible design, although for most people not a big deal. Hadn't heard of the radiator milkshake issue. Another reason to buy a manual (if you can find one!).
One metric about how durable a Toyota will be is whether or not it's sold as a global market truck. Torsion bar IFS pickups, yes! Solid axles, yes! Coil spring IFS? Nope. It's durable by most standards but not as durable as their other offerings.
I've never driven a 100 series, but most people don't seem enamored with them. I'm sure it's peppier, but not tremendously.
The biggest issue, speed wise, is people throwing on 33" and 35" tires and then expecting it to climb mountains at altitude. It's going to be miserable with those expectations. If you run stock tire sizes, expect it to be slow but survivable at altitude. If you run larger than stock tires without regearing, it's going to be very slow.
I personally have a general preference for the 3FE over the 1FZ-FE. I'm definitely one of the odd ones out on that. Up there I might change my mind, though.
You can do manual swaps, especially on the 3FE. This may help some. I think the rigs are quite capable in stock form but it depends on what you want to do with them. Part time 4WD modification would help climbing the hills in the summer, a little bit, and give you better gas mileage. But keeping the AWD option for winter is very nice.
Just saying