How To Remove Stickers From Glass - Going Zero Waste The mason jar labels should easily peel off at this point, leaving behind lots of glue residue. Create the paste. Create a paste of baking soda and dish soap. It's not an exact measurement, but 1-2 tablespoons of baking soda plus a few pumps of dish soap should work.