For JPMorgan's retail employees, there will be no more messages after the beep.

The company's consumer banking chief told an industry conference the bank would be eliminating voicemail in an effort to cut costs. Each line costs about $10 per month, and a source tells CNBC that the unit will reap annualized cost savings of about $3.2 million.