Port hit me on starboard and damaged my boat — do I lose points too?

No. Rule 10 disqualifies the port-tack boat, and as the right-of-way boat you break Rule 14 only if you could reasonably have avoided the contact — and you need not act until it is clear the other boat is not keeping clear. If her breach damaged your boat and made your score significantly worse, you are entitled to redress under Rule 62.1(b).

▶ Watch on YouTube ↓ Download (via YouTube)
<iframe width="560" height="315" src="https://www.youtube.com/embed/3D85S0o_d-o" title="Sailing Kiwi" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
<p><a href="https://sailing.kiwi.nz/v/3D85S0o_d-o/">Source: Sailing Kiwi</a></p>

Next on this shelf — The Upwind Beat