Then again isn't the hub attached to the UCA, LCA, and steering linkage? So if there was CV movement in and out wouldn't the caliper be moving with the disc (i.e. the entire disc/caliper/etc assembly would move)?
Yes, the hub (stub axle, brake rotor, wheels as an assembly) is tied to the spindle/upright via bearings. The brake calipers are independently bolted to the spindle/upright. So if the axle has play at the bearings, it will knockback the pads, as that is the only part that can deflect in the brake assembly.
For those curious, this is actually a thing for track cars with large brake rotors. The huge side loads cause the brake rotors to do the same thing. Larger brake rotors deflect farther with even minimal play. That's why real race cars need incredibly beefy stub axles and bearing assemblies to minimize deflection. Which is also why cheap cars use floating brake calipers so that their weak and tiny axles/bearings don't cause pad knockback.