I like an oxy torch with a scarfing tip for rivets and annoying brackets. It will peel them right off. Quick brush with a flap wheel to pull slag, and then air hammer out the rest.
I would weld that section back in, filling the rivet holes and shaping the bead to look like a rivet, and...