The on-line commercial for Panoramic View's ocean front residences in Montauk, N.Y., promises concierge service, porters and breath-taking views from every room.
The prices for the "luxury townhouses on the ocean" vary from $1.8 million for a one bedroom, Salt Sea villa to $6.5 million for a five-bedroom hilltop house. Brian R. Callahan and his brother-in-law Adam J. Manson are the men behind the Panoramic property, which includes five buildings with 117 units and three beach front cottages on 10 acres that they purchased in 2007 for a reported $38 million.
But prosecutors are now alleging that when the Panoramic property started to lose money, Callahan devised a plan to keep it alive by orchestrating a massive Ponzi scheme—dumping millions of his "client's" money into the Montauk property, without their knowledge or consent.
Loretta Lynch, the U.S. Attorney for Eastern District of New York, has charged Callahan and Manson in a 24-count indictment that accuses them of bilking at least 45 clients out of $96 million. According to the indictment, Callahan courted investors, and then told them that their money would go into "high dividend stocks and bonds, CDs and diverse government and corporate fixed income instruments" but instead diverted millions to various projects at Panoramic View and to pay investors in several other Callahan funds—some of which were based in Nevis in the West Indies.
(Read more: Charged with fraud, ex-NBA player turns to defense)
According to the indictment, the massive expenditures didn't stop with the Panoramic. Callahan allegedly used $3 million of investor's money for his own benefit, including large credit card bills, dues at his golf club, down payments toward the purchase of luxury homes in Old Westbury and Westhampton and payments for a Range Rover and a BMW. Callahan also allegedly used $475,000 to buy a minority partnership interest in his own name in a company that published archived church sermons.
So while investors were told they were getting short-term liquid investments similar to a money market fund, according to the indictment they were instead funding Callahan's lavish lifestyle, and rather odd side investments.
(Read more: Busted! Inside one massive cybercrime ring)
Callahan cast a wide net for perspective clients. He allegedly received $600,000 from the Montauk volunteer fire department on Long Island. According to U.S. attorney, he told the firemen that their money would be invested in mutual funds and other securities but instead diverted the money to the Panoramic View and personal expenses.
To cover his tracks, prosecutors said, Callahan sent fraudulent account statements to the fire department that falsely showed that the investment was in 12 different mutual funds—but no mention of Panoramic View or the fact that Callahan and Manson each owned 50 percent of the development.
According to Richard Schoen, Montauk's fire chief, the department demanded its money back after the treasurer started asking Callahan questions about the whereabouts of the department's investment and was told by Callahan that the money was "moved around daily".
The scheme started to unravel when an independent auditor started to take a close look Callahan's various funds, authorities said. According to the indictment, Callahan and Manson provided bogus promissory notes representing debts owed to the Callahan funds. Callahan is also accused of sending the auditor documents with forged signatures.
The government is seeking forfeiture of the Panoramic property and any other property and goods obtained through the alleged Ponzi scheme.
(Read more: Behind this pump-and-dump scheme was...a chimp?)
Callahan's lawyer, Robert Knuts, has not returned CNBC's calls but Robert J. Anello, Manson's attorney said: "The criminal charges, as they relate to Mr. Manson, are unfounded. Mr. Manson consistently and expertly has acted consistent with the interests of the owners and investors of the Panoramic Property. For more than seven years, Mr. Manson has overseen the successful renovation and development of the beachfront historic property's luxury, full-service units and famous hotel. No allegations have been made that Mr. Manson had contact or involvement with any investors or that Mr. Manson made any investment decisions on behalf of the offshore investment funds or received any management fees based on those funds assets."
Anello Added, "Mr. Manson looks forward to a speedy resolution of the government actions, which will benefit its investors, unit owners, and guests."
Jeff Pohlman is a senior producer at CNBC. Andrea Day is a reporter at CNBC, covering crime and punishment.
You can watch all of our "Crime and Punishment" on CNBC's "Power Lunch" every Thursday, 1 p.m. ET.