On Wednesday, a motion of no confidence was submitted as MPs blamed Prime Minister Soumeylou Boubeye Maiga for failing to handle the unrest, BBC reports.
Last month, scores of herders were killed by a rival ethnic group.
President Ibrahim Boubacar Keita said in a statement that he accepted Mr Maiga and his ministers' resignation.