The plastic fan like this can flex at least 3/8" depending on RPM and other conditions. I'm not sure what factory clearances are.
Also, the fan needs to be in the smallest diameter of the shroud to optimize the air seal and flow.
At 5mm, you may have to get a 1/4" thick spacer and have it...