Mr Buhari said this was because Nigerians have confidence in him and his administration.
The president stated this while responding to a question during an interactive session with the Nigerian community in Togo at the Nigerian Embassy, Lome, Togo.
“I am not bothered about the defections,” Garba Shehu, the President’s Senior Special Assistant on Media and Publicity quoted him as saying on Monday.
“Ordinary Nigerians have developed confidence in us and are defending us.
“I assure you, majority of Nigerians back home are appreciative of our efforts”.
Buhari assured his audience that his administration had remained steadfast in keeping to its three campaign promises of providing security, improving the economy and fighting corruption.
“I assure you that we are making progress in security as some displaced farmers are returning to their farms.
“We will continue to work very hard for our dear country,” he stressed.
The president noted that if past governments had utilised even 25 per cent of the huge oil revenue available to them, Nigerians would not be complaining today.
In his welcome address, the Nigerian Ambassador to Togo, Joseph Iji, said the close to two million Nigerians in Togo were law-abiding and peaceful.
He, however, drew the president’s attention to the inability of the Nigerian Mission in Lome to issue Nigerian passports, making applicants to go to Ghana or Benin Republic.
On its part, the APC Togo Chapter, told President Buhari not to be worried about the defections from the party, assuring him of its support in the 2019 presidential election.
The President’s first official engagement on arrival in Lome ahead of the Joint ECOWAS/Economic Community of Central African States Summit,
President Buhari will also be participating in the 53rd Ordinary Session of the ECOWAS Authority of Heads of State and Government, among others.