The NBA issued Sterling, the embattled owner of the Clippers, a lifetime ban and $2.5 million fine on Tuesday over his racist comments caught on tape. In one of the audio recordings, Sterling asked a friend not to bring former Los Angeles Laker Earvin "Magic" Johnson to Clippers games.
Read MoreClippers owner Sterling banned for life, fined $2.5M
Yahoo Sports, citing league sources, suggested Magic might be interested in purchasing the Clippers—but Magic has so far denied he has any interest in buying the team, the Chicago Tribune reports.
Damon told "Closing Bell" no one has contacted him about investing in the Clippers. But the 43-year-old, a Boston native and die-hard Boston Celtics fan, said he just wants to see Sterling go.
"I think a lot of us are really excited to get him out of the NBA. So whatever it takes."
Advertisers and sponsors fled the team after Sterling's comments became public, and the NBA banned him from the sport for life Tuesday afternoon. Samsung Electronics was the first advertiser to return its support to the Clippers Tuesday evening.
—By CNBC's Drew Sandholm