Price is important, but Gallup warns it cannot be the only thing that differentiates a store from the competition, because price is not the only factor customers consider when making a purchase.
"Gallup research has shown that customers only shop based on price when price is the only thing that separates competing offerings. In other words, customers shop based on price when there is no emotional connection to a particular retailer— when they are not engaged."
And engaged customers, those who love the brand, are the most profitable customers—they'll go out of their way to shop at that store. Think Nordstrom, Apple or Starbucks. Gallup's research shows that these loyal customers care less about price, so they typically spend more.
Read MoreBig restaurant chains dip in customer satisfaction
Ed O'Boyle, global practice leader at Gallup, told CNBC there needs to be a corporate culture shift. Management needs to understand the value of having the right salespeople on the floor.
"If you have things in stock that people want and your salespeople are really helpful and deliver good service, that's when you hone in on driving engagement," O'Boyle said. "We have abandoned the talent profile of having great salespeople, who want to take care of customers who drive things forward in the store."
Bob Thompson, founder and CEO of CustomerThink and author of the book "Hooked on Customers: The Five Habits of Legendary Customer-Centric Companies," said retailers need to take Gallup's advice to heart. He believes focusing solely on price is an excuse for not dealing with the real problem—poor customer service.
"It's easy to slide into this mindset of, if we just match price then we're going to be fine, but you haven't given them a reason to go to the store," Thompson said. "Price is still a factor, but you can't build your retail strategy around price if you're a brick-and-mortar operation. That in-store experience is incredibly important."
Thompson noted that he shops for clothing at Nordstrom because the salespeople there help him make good decisions about what to buy.
"I know I'm going to pay more and I don't care, because that service is incredibly important to me," he said.
Read MoreCustomers unhappy with TV and ISP services