A pledge can be deleted from the Transactions Grid (not the Pledges Grid) by selecting that specific pledge and clicking on the trash can which is located on the far left side of the grid. You will get a confirmation message asking you to confirm that you really want to delete the pledge. You can cancel or continue and the pledge will be deleted. All pledge payments and any other payments due for that pledge will also be deleted. 

Please note this is a permanent action.