What side of Charlotte?
Here's a map that's not all inclusive by any means but it'll point you in the right direction for gravel in Northern York County. http://goo.gl/maps/c1FZz
You can find more little bits and pieces like that around the area but dlrides nailed it, you really need to go up around the Wilson Creek and Linville Gorges for the closest place to link miles and miles of gravel together.
Doubt I'll be getting out for much of a ride this week.......sorry.