At a press conference following the talks in Berlin, Tsipras had struck a conciliatory note, saying it wasn't right to hold foreigners responsible for the country's problems. He also promised to launch "big structural reforms."
Greece was given a four-month extension to its bailout program in February but a condition of giving Greece more time was that it had to present a concrete list of reforms to its creditors. As yet, however, time is running out and reforms are on paper only.
Merkel remarked on Monday that Greece had to stick to the bailout extension conditions and it was up to the Eurogroup to decide on releasing more funds for Greece – funds it desperately needs to function and upcoming meet loan repayments.
Read MoreHas Syriza ruined it for Europe's populist parties?
The chief economist at the German Chamber of Industry and Commerce (DIHK) told CNBC that while the meeting showed improvement in relations between the two countries, action needed to follow Tsipras' promises.
"The two heads of government they tried to show an improvement in the relationship but there are still a lot of substantial differences between Greece and Germany and this was clear yesterday as well," Alexander Schumann told CNBC Tuesday.
"I think it was a necessary step to improve the relationship but now more talks have to follow about what Greece is going to do, what are the concrete, detailed measures of structural reform that Tsipras mentioned. This is necessary now, Greece's government needs to show what it will do to reach this objective."
Other economists agreed that the Merkel meeting was not a resounding success for Greece. Carsten Brzeski, a senior economist at ING based in Brussels, said Tuesday that "all in all and as expected, yesterday's meeting was not a great breakthrough in the Greek crisis."
"The crucial question on how to make unsustainable public finances sustainable while at the same time restoring competitiveness was not even addressed. However, it might have been another small step towards the end of the recent political thaw. It's too early to tell whether this would eventually lead to a real happy end," he said in a note Tuesday.
Tsipras' visit to Germany continues on Tuesday with meetings with the foreign affairs minister, vice chancellor and opposition Green party members. He will also visit a Holocaust memorial today. Schumann said it was unlikely that Tsipras would find a friendlier reception from those meetings.