It would be better if policymakers let a disorderly default of Greece take place and recapitalized banks, an analyst told CNBC Wednesday.

The Parthenon in Greece

"Policymakers need to force the issue now. It might be better to let Greece default in a disorderly manner, because policymakers would have more control over the banks than they would on Greece," said Patrick Armstrong, managing partner at Armstrong Investment Management.