I have done this 3 times and never cracked the casting. A bit of heat may help, but be careful. I have removed it installed on the engine and installed in a vice. I prefer the vice as it is less likely to cause damage such as you are worried about.
Hth's
Daryl
Hth's
Daryl