You may also like to bring up a set of pliers or channel locks for when one side still sticks in the old decking and a shovel or pitchfork will not lift them out of position.
Yes, remove them.
They can poke holes through the new shingles some day, later down the road.
Ed