Once an abandonement or completion reason has been applied to a profile you will no longer be able to delete it.  The idea being that you would want to retain a historical record of what had occurred on any given profile.  

What you can do though, is update any completion or abandonment reason by going to the specific reason and selecting the pencil icon to edit the name of the reason as seen here: