Rocky places, muddy places, washboardy places. The larger contact patch will help with traction on almost any surface, and the softer tire will absorb a lot of roughness that would normally be transferred to the passengers. However, airing down has its drawbacks. It exposes the sidewall to sharp objects, it softens the handling, and if taken too far it can result in the tire coming off the bead which can be very dangerous in certain situations. Also, it will cause the tire to wear faster and unevenly if driven on the road much.
I personally air down the minute I leave pavement. I have particularly hardy tires meant specifically for rock crawling, so I don't have to worry as much about sidewall punctures- with 6 ply sidewalls, my tires are twice as protected as most people's tread at 3 plys. When I ran BFG A/T's on my 4Runner, I didn't air down very often at all, and more often with BFG M/T's on my Nissan. On my wife's 80, with stock Michelin LX tires, I wouldn't even consider airing down, unless I got stuck in sand somewhere.
-Spike