It has been many years since I have been out there. Some of the upper trails are too rocky for your preferences, but you could ride all day out there on the rest of the trails.
The last time I went, it was for a bachelor party near Star Lake (I don't remember how close that is to Dinkey) We camped just before a steep rocky decline leading to the lake, leaving just a short hike to good fishing.
Bottom line: the whole area is a hidden gem.
"Don't go gettin' all snotty on me just because I like to drink beer and piss off the porch once in a while." - Boondoggle