No, AssociationSphere will make sure that no duplicates make it into the system during the import. In addition, if a recipient has been unsubscribed, importing a duplicate subscriber will continue to keep the recipient unsubscribed.