If it's only been 2 years, you should be able to dig them out with a shovel. When you get to roots too thick for the shovel to cut through, use loppers or a hand saw.
Comealongs are good for 1 or 2 thousand pounds of force. Moisten the ground and build up a fixture shaped like an upside-down U with RR ties and chains and such, and pull it out vertically.Is there a device (perhaps sort of like an engine block jack) that can be used to hoist the trees/root balls out of the ground without doing too much damage to the surrounding landscaping and walkway?