If you want to use that public key in the future then make sure that you’ve already exported and saved it locally. A public key is required to validate the OpenPGP signatures.
- Go to Settings -> Messages -> Encryption and click on the Public key that you would like to delete.
- Click on Delete.
- Click on Yes.