You can delete donations by going into the donor's record, then clicking their "Finances" tab. Click the "edit" button next to the donation you'd like to delete and at the bottom right you'll see a button that says either "Refund", "Delete", or both (which buttons are shown depend on the payment processor you use).