Loudon or Fauquier County has endless gravel. You can easily do 5+ hours on 95% gravel roads. Leesburg or Haymarket are both good places to start a ride depending on where you are coming from.

I would suggest checking out gravelmap https://gravelmap.com/