In 2014, the median price of a home in Palo Alto with less than 1,000-square-feet of living space surged 40 percent to $1.7 million, according to DeLeon Realty, a real estate firm based in the city.
Realtors say a lot of that surge can be explained by the flow of new tech money in the area, which is driving prices higher, as well as an influx of international investors looking to capitalize on a red hot real estate market.
"About 40 percent of these buyers are investors from overseas," said Ken DeLeon, the founder of DeLeon Realty.
Read MoreSilicon Valley's luxury boom
Specifically, he says there are many Chinese buyers, who intend to tear down the homes and build new ones.
Courtney Charney of Alain Pinel Realtors says some of her Chinese buyers are also scooping up homes for their relatives. For instance, she sold a $2.3 million home in Palo Alto to a couple who bought the property for relatives moving to the Bay Area from China.
Interested in buying a home in Palo Alto? Good luck finding one.
As of this week, there were only 11 homes on the market, according to Carol Carnevale, also of Alain Pinel. She said five of those homes are priced at $4.9 million and higher.
The cheapest, Carnevale says, is a 1,100-square-foot home selling for about $2 million.
Of course, such a surge in home prices brings up the question of whether there's a housing bubble developing in Silicon Valley. Nancy Wallace, a professor at the U.C. Berkeley Haas School of Business, doesn't think so. She says Palo Alto has enjoyed a significant increase in income growth, which should support home prices.
"Given what's going on with income growth, unless there is a crash in tech, I see this as sustainable in the near term," Wallace said.
Read MoreBay Area tech firm paid workers...$1.21 an hour