Trader Guy Adami said that the oil names have "traded extraordinarily well now for quite some time." He added, however, that the valuations are starting to worry him.
"These are rich stocks at $80 oil. So I think they're extraordinarily rich stocks at $50. Exxon, probably close to 22 times forward earnings," Adami said, adding that investors are piling into energy stocks because "the move in energy has been exacerbated to the downside."
"Everyone's reaching for yield, so they bloated that multiple on them, but I still think they hang in," Grasso said.
Trader Tim Seymour agreed and added that the best in the sector are the ones that "can be opportunistic and have operational leverage to be able to be buying assets." He said that he likes the oil services part of the space the most.
Trader Brian Kelly said he thinks these names are actually cheap on a relative valuation. Kelly, however, said that he sees oil trading in a wide range, which would mean markets could see a $20 level again.
"We've seen rig counts increase. We're now probably through the bulk of the speculative summer driving season run up and you're seeing oil down quite a bit," he said.
Grasso said that even if Kelly's view is correct, Grasso thinks the big integrated oil companies will be "impacted a lot less than those other names."
— CNBC's Christopher Hayes contributed to this report.