Click the document reference in your Mailbox.
Click Edit > Delete.
Click Remove Document From Folder, then click OK.
Only the document reference is deleted. The document in the library is not deleted, and any users with references to the document can still view, open, edit, or delete it, depending on their rights.