no need to remove the carpet, u can slip and slide them once u get to the screws holding the steel plate under the rubber iirc, ur set.
if yours was used regularly and then suddenly stopped shifting in or out, then u have to check out ur transfer case.
i had the same thing happen to me, when i first got my truck, previous owner never put it in 4wd, so it will not go anywhere, once opened i sprayed it with wd40, wipe the dirt out, then soak it, it became tough to shift, but it worked after a day it was smooth, didnt look back since then.
the saying of "use or lose it" holds true here.