Rwandan President Paul Kagame has suspended two provincial governors as part of an ongoing purge targeting public servants deemed to be lacking accountability.

Southern Province Governor Brigadier General Emmanuel Gasana and his Northern Province counterpart Gatabazi Jean Marie Vianney have been pushed out pending investigations into their performance.

"The President has suspended from duty Mr Gasana Emmanuel, Governor of Southern Province and Mr Gatabazi Jean Marie Vianney, Governor of Northern Province owing to matters of accountability under investigation," a Monday statement by the Prime Minister said.

During a tour of the province early this year, President Kagame warned that local leaders will be held accountable should they not deliver services.

Lawmakers have welcomed the move by President Kagame to hold "the big fish" accountable, and are calling for thorough investigations of those who suspended and the findings made public.