The Old Kingdom pyramids are solid stone all the way through. The Middle Kingdom pyramids are often mud brick with a stone shell on the outside, or built on natural hills so that the hill is actually part of the pyramid. This meant that it was not necessary to move so much stone.
