The real estate that came with Hudson's Bay's $2.9 billion purchase last year of the Saks department store chain was "a little added gift with purchase," CEO Richard Baker told CNBC on Tuesday.

That's some gift. On Monday, the company announced its Saks flagship on Manhattan's Fifth Avenue has been valued at $3.7 billion, making it the most valuable retail building in the world.