Rarely a day goes by that I don't have a hammer in my hand at some point. I was using a steel punch and didn't want to use a hand sledge with it. Didn't want to risk damaging the hub. I don't mind using a big hammer with the race driver if it can bite onto the race. I don't remember if it sits flush other than the cutouts, or if the driver can make contact all the way around.
I should have time to tear into it in the morning. I've got a suspicion that the brake may be dragging some as well.
Just make sure you're on the RACE and not the lip inside the hub.
The welding trick works too. I prefer not to do it because you have to kinda weld blind and my hands shake too much......
I don;t think the seal/race driver will help to REMOVE the race. I usually use the driver to INSTALL or I use the OLD race to install the new one.