* U.S. political woes, U.S.-South Korea drills keep markets jittery
* Nippon Yusen outperforms on report it will offer payouts this FY
TOKYO, Aug 21 (Reuters) - Japan's Nikkei share average fell to a fresh 3-1/2-month low on Monday as global investors remained cautious amid worries over whether the Trump administration will be able to implement growth boosting measures.
The Nikkei fell 0.3 percent to 19,406.40 points by midmorning trade, after opening slightly higher.
The dollar was at 109.22 yen, not far from Friday's four-month low of 108.605.
In the latest shakeup, the White House said U.S. President Donald Trump on Friday fired chief strategist Steve Bannon, known as an economic nationalist and an advocate of "America First" policies. Critics have accused him of harboring anti-Semitic and white nationalist sentiments.
"There is something every day that's worrying the market... People are risk averse as various risks are coming from the United States now," said Hikaru Sato, a senior technical analyst at Daiwa Securities.
He also added that the market remains jittery as the United States and South Korea will go ahead with joint military drills this week.
Such financial stocks as banks, securities and insurers underperformed, with Mitsubishi UFJ Financial Group, Nomura Holdings sliding 1.6 percent and Dai-ichi Life Holdings falling 1.5 percent.
Bucking the weaker broader trend, mining shares rose, with Inpex Corp advancing 1.1 percent and Japan Petroleum Exploration Co adding 0.5 percent after oil prices held on to Friday's big gains.
Japan's major maritime shipper Nippon Yusen KK soared 3.0 percent after the Nikkei business daily reported that the company is preparing to resume dividend payments for the current fiscal year, after no payouts were offered last year.
The company secured cash by transferring funds from capital surplus to retained earnings in June, the Nikkei said.
The broader Topix dropped 0.2 percent to 1,593.49. (Editing by Kim Coghill)