I think I've only sailed over two in all the time they've been a thing.
One of those times was last week when I was doing a vault in the Roar... As I approached the island I wasn't paying attention and only noticed them when it was too late to turn and avoid.
I knew the best strat, get to the back of the ship and just brace. I immediately anchored... in a bad spot, the cannon from Ashen Reaches bearing down on me... but I stayed calm, concentrated on patching, repairs and bailing and at the right time raised my anchor to sail away from the cannonfire and get my ship back in full order before continuing.
Was it a challenge? Yes. Impossible? No, not even solo. And just like the time I beat the Kraken, a skelly sloop and Meg in the storm, it's a story of triumph to be told.
There are plenty of things I would balance in the game but I don't think this is it.