Looks like the p.o. in the top picture did the same thing to the cap as you did, just not as cleanly.
I grinded the edge down a bit on my cap and that gave me just enough room to pull it out enough, but I think I went with a bolt that was just a bit shorter and it still worked out just as good.
I remember when I was putting mine in, the pin was a PIA to get in. I actually had to grind it a bit for it to slide in. Maybe the p.o. just gave up trying to put it in.