First thought for speed is cardboard.
Second would be polyethelene sheet PE, easy to cut and score with a knife.
Third, use an existing box, there are hundreds of thousands of boxes premade in nearly every material and size. Usually the quickest way to arrive at a solution is the best.
EVA foam is what Crocs shoes are made from, you can buy sheets of it.