The documentation and understanding of variations in the Earth's magnetic field through time is fundamental for several disciplines, but current geomagnetic models rely on datasets heavily biased toward the mid‐ and high northern latitudes. The African continent and surrounding islands and oceans are particularly underrepresented. Here, we present a new record of paleo‐secular variation (PSV) of the inclinations over the last 23 ka from Lake Chala, situated at 3°S near Mt Kilimanjaro in eastern equatorial Africa. This groundwater‐fed crater lake is characterized by a high sedimentation rate (ca. 1 cm/10 years) and a particularly well‐constrained age model based on 210Pb and 14C dating. The magnetic mineralogy of the sediments is tested with rock magnetic analyses. The Lake Chala inclination record shows four highs and lows over 20 ka and compares well with that of Lake Malawi (10°S) between 20 and 16.2 ka, and from 9.8 to 2.6 ka. This record is linked to PSV records at Lakes Victoria and Malawi using a sequence slotting technique to generate a composite PSV model for east Africa. Analyzed at best‐possible resolutions up to 200 years, the Lake Chala PSV record not only represents an important contribution to improve our understanding of local and global features of the Earth's magnetic field. It also expands the utility of paleomagnetism as a key tool for dating and correlation both for archeological sites throughout East Africa and the many volcanoes, active or dormant, of the East African Rift System.