Yes, the idea has been raised many times before.
The problem is that in a lot of network the voice is going to be
decompressed in the network, transferred as PCM and then recompressed.
The crypt phones, which are used from our politicians today,
establishing a CSD connection for voice crypt transmission.