Staff left the Israeli embassy in the Mauritanian capital Nouakchott Friday, a Reuters witness said.
Diplomatic relations between Mauritania, one of only three Arab countries to have full ties with the Jewish state, have been strained since Israel launched a military offensive in the Gaza Strip in late December.
Earlier Friday, Gulf TV broadcaster Al-Arabiya said Mauritania had given the Israeli ambassador 48 hours to leave the country, reported Reuters.
In January, Mauritania recalled its ambassador to Israel for consultation, a step an adviser to the northwest African country's government described as a "first step" to cutting ties.