The wind picked up to the point where it sounded like a chorus of a hundred howling banshees. Even deep in the cave, we all felt the temperature drop even further as the Chill Squall moved through; snatches of wind fingering in as if it was trying to pluck us out of our hole.
Pcs learn of high power magics that allow them to banish weapons and suits of armor to some 'elsewhere' place until such time as they need it. reduces encumberances, gets fewer questions, and when the PCs get jumped by thieves in the ally, they can summon their suits of full plate armor with weapons drawn.
Lesser powers would allow them to summon their weapons from another physical place, drawing them to their hands like Luke skywalker summoning his lightsaber on Hoth.