In his first interview in two years, Goldman Sachs CEO Lloyd Blankfein told CNBC Wednesday, "We haven't gotten everything right in how we deal with the public."

Lloyd Blankfein, CEO of Goldman Sachs speaks to Gary Kaminsky on April 25, 2012.

The bombshell op-ed piece in the New York Times caught Blankfein off-guard, he told Squawk on the Street.