Mount Elgon’s slopes are comprised of various caves left by moving lava and erosion of soft volcanic deposits that erupted some years back. The most accessible of these caves are Kapkwai Cave which is near the Forest Exploration Centre, and Khauka Cave on Wanale Ridge.

Long ago, the precious features acted as shelters for livestock of the local people who were the traditional inhabitant of the Mountain.

On later days the caves also provided manure in form of bat droppings and recently they are used by climbers and their porters as their resting grounds when hiking the mountain, also campsites have been set at the formerly Hunters Cave, Siyo Cave which is near the hot springs and Mude Cave, Tutum Cave are ideal for overnight expeditions.