During his appearance on CNBC, an anchor read a statement from Fine regarding a column Dimon, CEO of JPMorgan Chase, wrote in April in The Wall Street Journal calling for large and small banks to come together. Fine ridiculed the column, saying in a statement that Dimon was trying to deflect intensified regulatory pressure on big banks.
"I think the guy who wrote that's a jerk, OK." Dimon said.
Read MoreJPMorgan's Jamie Dimon to Trump and others: Stop 'scapegoating' and 'yelling'
"We are one of the biggest banks to community banks," Dimon said Wednesday morning. "I'm completely sympathetic to the community bank saying that 'some of these regulations are killing us' ... I agree with that."
Dimon's "remarks reflect Wall Street's inability to take responsibility for the economic crisis it caused and the taxpayer-funded guarantee against failure it continues to enjoy," Fine said in a statement provided to CNBC.com after Dimon's appearance. "The nation's financial and economic stability should not be at the mercy of a few large financial institutions, regardless of whether they process checks for other banks."
For his part, Dimon went on to say that he wants regulatory burdens for community banks reduced, even if the pressure isn't eased on bigger banks — like his.