It would take electronic analysis to discern the synth voice double from the real thing... but yes. Telephone conversations could be phoneyed.
Hehehe... now to get 20 minutes of audio of my manager and use it to prank call the owner :)