When you're still on the recently uploaded paste and click on the delete button, it will ask you to fill in your delete secret.
I think the page should remember the secret (until you reload the page) and just delete the paste when clicking on the delete button. Maybe it should ask whether you really want to delete it or not so that you can't accidentally delete it.