Normally, it's possible to talk to non-hostile pirates, as indicated by the cursor changing to the dialog icon. However, I've found four pirates that "refuse" to talk: the cursor doesn't change when it's hovered over them. Don't know what makes them special. See the attached screenshots for their locations.