Although investors have shied away from the financial sector in recent months, Thursday's rally in financialscould "have legs," said one Sandler O'Neill principal.

While "exteme fear" drove a move away from financials in August and September, not owning financials puts investors behind as opposed to ahead now, said Jeffery Harte, a principal at Sandler O'Neill.