I'd set a skill saw the correct depth, cut each side of each joist, an inch away. Smack the remainder 3-1/2" piece with a hammer towards the sky or in-line with the joist, whichever works. Use vise grips on the stubborn nails, with a spacer block. Be safe, GBAR