Yep. Get a spray bottle, drop in a couple of drops of dish soap, soak that paper down really good, then using plastic gloves, and wearing a mask, scrape the loose material off into a trash bag, then bag that trash bag into another, and toss into your garbage can.
There is not enough removal of material there, that you have not got a lot to worry about in the way of an environment hazard. Now of course if you want to, you can use the Rubber in the can that you see advertised on tv, and spray the heck out of that to seal it from coming loose, but that is the most expensive solution.