The Yomiuri newspaper, which first reported the news, said the government was expected to revise its internal rules on procurement as early as Monday in a bid to prevent intelligence leaks and cyber attacks.
The report follows a decision by the United States this year to ban government purchases of Huawei gear.
U.S. intelligence agencies allege Huawei is linked to China's government and that its equipment could contain "backdoors" for use by spies, although no evidence has been produced publicly and the firm has denied the claims.
In addition, Australia and New Zealand have blocked Huawei from building 5G networks, while Britain's BT Group said on Wednesday it was removing Huawei's equipment from the core of its existing 3G and 4G mobile operations and would not use the Chinese company in central parts of the next network.
— CNBC contributed to this report.