What's your budget? You can get a decent 2m mobile for pretty cheap these days and could always pick up a hand held to go along with it. If you don't mind used and/or a bit older tech you could have both on a shoe-string budget.
If you want new and the latest tech and can only afford one I'd go with a good HT. As you mentioned you can run it mobile and yank it out to hang on your hip when needed. If the low power is a big issue there are mobile amplifiers made specifically for use with HTs in mobile applications.
Welcome to the club. You've got your ticket. Now the sickness will really begin to spread.