Keep the inner liner or toss it?

When you get your A Muse Studio stamp sets, they come in DVD cases. You have the choice to either take out the inner liner with the stamps in them and just let them stick onto the DVD case by themselves or keep them in their original places. I first took mine out but did not throw it away and I am glad I kept it. I prefer to keep the inner line inside and use it that way.