Heller said one of the key constraints was restrictions on drilling activity on government-owned land which has prevented oil and gas companies from expanding at the pace they should be.
He also said the U.S. economy had a number of untapped resources, including the large amount of unemployed people, together with hoards of corporate cash holdings sitting on the sidelines.
(Read more: Summers as next Fed chief? Brace for wild market swings)
"U.S. corporations have the largest cash holdings they have ever had, so the potential for growth is there but you've got to let it happen and not restrain it," he added.
December taper?
On the ongoing debate over when the U.S. central bank might scale back its $85 billion a month bond buying plan, which has kept markets transfixed since Fed chair Ben Bernanke first suggested it was on the cards in May, Heller said he expected tapering to commence in December, later than the broad consensus forecast of September.
"Probably the current Fed will want to do so [start tapering before the end of the year] so the new Fed chief who will take office at the end of January next year will not have to change policy at the first meeting," he added.
Speculation has been rife over who might replace Bernanke when his term expires, with vice chair Janet Yellen and former Treasury Secretary under Clinton's administration, Larry Summers, emerging as possible candidates.
(Read more: Wall Street wants Yellen, not Summers, as next Fed chief)
Heller voiced concerns over whether Summers would be the best person for the role.
"Summers clearly is a very bright man but he also speaks his mind and he's not exactly known to be the great consensus builder that Bernanke has been in his time," he said.
"He might have a harder time holding the Federal Open Market Committee (FOMC) together... if you were to get more dissent that would make policy making more difficult," he added.
Heller told CNBC in June that Yellen was the most credible candidate for the job.
—By CNBC's Katie Holliday. Follow her on Twitter @hollidaykatie.