If U are going to "hammer" it into a trail-rig eventually & cant be bothered with the imperfection today, then I`d leave it be.
I recon a "fair" dent is better than a questionable filler job with unmatching paint to go.
If U want it straight, either replace the door or the door skin.
That being...