Port vs Starboard: Who Actually Gives Way?

Wind on the starboard side means right of way — the port boat keeps clear.