Here is a map of the world with the proportion of atheism in the population for each country.
Source: Wikipedia. 2012-2014 data.
For Africa, there is very little data for atheism. It is often simply indicated without religion or unaffiliated, which does not mean atheist. Most of the time they are believers without labels.