Jack of all trades or two aces...?
Same boat, I had a KLR and found it to be OK at a few things, and not good at most. I don't ride that much dirt since there isn't that much around me, but I have a 1200GS which covers gravel, commuting to work, and touring 2 up with my wife.
Then there's my 900SS for twisty roads and hooliganism, I have an SV650 which is in the same niche but I can't seem to get rid of it as it's not worth anything to sell and really is the perfect standard motorcycle.
Got a couple vintage '70s Hondas which I really cannot justify owning anymore as I ride the about once or twice a year, but, as they say, they don't eat anything so in the corner of the basement under a blanket they sit.