Well, when you have the case apart, you will see how the range selection detent set up works; there is no reason to shim it as it is a threaded fastener that makes the tension on the spring and ball tighter, the closer the screw is to the ball.
You can get a general idea of what I am talking about
HERE
However, there are other reasons why the case may not stay in gear and you have found, just as many with the Orion have found, that it is not the case that is the issue with it not staying in gear, but rather, the shift linkage on the vehicle creating the issue.
If there is a lot of play on your range selection collar you will want to replace that, also, you will likely want to use stepped thrust washers to remove some of the free play that is inherent in the high and low speed gears on the main shaft. None of this will be obvious until the case is out of the vehicle and inspected.
Again,
If you remove your shift linkage and the transfer case stays in gear, the transfer case is not the issue.
