Yes couple of miles up the road. It's still good riding, but I'd go on a saturday am if I was you. Sunday you tend to get loads of townies and people that cant control thier dogs.
The other thing watch out for the Exmoor ponies if you go Sutton/four oaks side. Great fun when they explode out of the bushes in front of you! Best to park at Streetly gate.