you can keep using email, but the sender should be able to verify the public key of the receiver by making a phone call and confirming over the phone

some sort of display can be made available for confirmation in the app

this way, if the sender decides that email is not to be trusted, the sender can confirm it.