European economies might be improving in terms of growth but the figures are still modest. The 19-member euro zone grew a miserly 0.3 percent in the second quarter, from the previous one, and the 28-member European Union fared little better, growing 0.4 percent in the same period.
Years of crisis have been coupled with political uncertainty, sparked by a public backlash against austerity in countries like Greece, that have also left their mark on the region and on investment with many investors nervous about more upheavals.
Read MoreEurope's crisis of confidence
As such, Coeure said the a lack of investor confidence was a residual problem for Europe.
He agreed that uncertainty over the region's recovery was evident in "the lack of investment that we are (seeing) today in Europe."
"We want investment to come back and investment is about confidence. Investment is about animal spirits, so you need these animal spirits to gather and to show up and for that you need reforms in countries," he added, saying that there were "very high expectations" of the region that it had to live up to.
Read More German exports fall amid 'unprecedented' challenge
The term "animal spirits was first used by economist John Maynard Keynes in 1936 to describe the human emotion that drives consumer confidence.
Cœuré said that institutions in Europe had done their part to stabilize the economic backdrop, such as creating a banking union to instil more homogeny and rules into the European financial sector, but that individual states needed to do their bit.
It was up to European governments, some of whom were slow to implement reforms to boost growth, competitiveness and labor markets, to "get their act together and to reform, to do tax reform, to do regulatory reform, to instil confidence into the business community," the ECB board member added.