It's not that scary,,, you just have to find your lines, not overreact when the bike slides around, and not go faster than you can handle,,, if fact it's fun except for the dust cleanup after the ride!
I've gone 70+mph on hard packed gravel,, avoid that kind of speed on freshly graded roads,,,😉
Read about early bikers like Cannonball Baker,, he rode a hard tail Indian from California to New York in 11 days wayyy back when,,, no paved roads,, dirt and gravel. And no decent tires,, which he patched and changed on the ride. Stay on pavement if you're uncomfortable with loss of traction,,,😜
The only new bike I've had was a 1970 Kawasaki 250 Sidewinder,,, they named it that because on gravel it traveled like the snake, slithering from side to side,,, I tend to avoid gravel on heavy bikes with road tires but I'm not afraid to when necessary. The most fun bike I've had on gravel was a 73 Triumph TR5T trophy trail,,, 21" front wheel with enduro tires,, it flat out flew on the gravel roads,,, 😜
The Triumph 500 had only 30hp but weighed only 350lbs. 4 gears, small aluminum fuel tank, single carb,,, one of the finest motorcycles I've owned, or ever built,,? Hell on wheels!!!😝
In a weak moment I traded the Triumph for an 85 Honda VF750 Sabre,, that bike went over 120mph,,, not a gravel machine tho,,, and a service nightmare,, four carbs,, 16valves manually set,,,, mos def a road racer!!! Stay off the gravel if you are not ready for it,, but huge fun watching the rooster tail of dust in the rear view mirrors,,,😜