President Donald Trump has threatened Nigeria with higher tariffs and visa changes. Nigeria has enough problems of its own, says its foreign minister.