From the constituent’s record on the Payment Info tab, credit cards can be deleted by clicking on the trashcan icon.