You wouldn't be swapping the frame mount, you would have to modify the axle. The panhard must mimic the drag link. (Also, it would be a lot more work to modify the frame link.)
I've never examined it in that context. I suspect it either can't be done that way or it would be much easier to get a new OEM mount (no idea if they are available) or fab one.