Mate, you are doing great. Gravel is a bitch to ride on but you do get better at it. One thing, as someone mentioned previously, be very careful going on your own. It's easy to come of on gravel and if you hurt yourself you could be neck deep in the brown smelly stuff with no help. I'm a relative noob. Only been riding a couple of years and I love riding on gravel but it scares the living daylights out of me. Went on yesterday having not ridden on gravel for a while and it was like back to square one. Keep at it and keep smiling, but FFS go with someone just in case!
Living the dream, everyday!