Read MoreWill Apple shake up Pandora's streaming reign?
"Streaming music services are booming, particularly among younger consumers," Costa said. "Google is a big player, but its music offerings have been subpar. Songza should give the company a much-needed lift," he added.
Android devices make up nearly 62 percent of the U.S. market for smartphones, according to Kantar Worldpanel ComTech research as of May 2014.
With the Songza move, Google pits itself against Spotify, Pandora and Rdio as well as Apple, which acquired Beats Music and its streaming service, as well as Amazon, which recently launched a streaming music service for its Prime customers.
Read MoreAmazon quietly unveils streaming music service