I think you need to get the bolt tight enough such that the crush/sealing washer on the outboard side will seal. From the picture posted above it looks like the o-ring on the inboard side is supported by the o-ring gland so it can't be over compressed. You can probably do a google search for bajno bolt torque for the appropriate size bolt/washer.
Edit: I couldn't really find an appropriate specification using google. I think the oil side of the oil cooler is not under pressure. This crush washer seal would be similar to the seals for fill and drain plugs on the transfer case. I found the thread below providing some torque spec for those.
Toyota doesn't give any of these torques in the 60 series manuals.
forum.ih8mud.com