Yes, I think it is going to be very important to strike a balance between quality and easy disposal/recyclability. Ideally the containers will be nice enough you can keep them around for a while but not SO nice/expensive that you can’t throw them away (recycle of course) without feeling guilty. Obviously it would be impossible to keep every single container forever.
All the suggestions so far are great.