I would never go without all my gear, but I'd be lying if I said it wasn't a hassle sometimes. There's times I don't want to spend more money on it, or to pile on the gear for a short trip, peel it on or off at a restaurant or store, etc.
But, I wear it and will continue to do so. No alternative, really.
The Rant-Fu blog & podcast ->Rant-Fu