If you do that, the volcanoes could start sucking the rocks back in, along with the people and animals, and we aren’t well adapted to living in reversed volcanoes. Within a few generations, survival pressures will probably select for shorter posture (to more easily move around in tight spaces), stronger build (to be able to push rocks out of the way more easily), skills with mining and smithing (obviously), and beards on women (so they, too, can easily carry around small snacks for later).

So yeah, carry on.