Every time I run the numbers here (New England), oil comes out cheapest, followed by propane, with electric a distant last place.
Natural gas would be cheapest where available. Oil might not win out if you have an outdoor tank and need "mobile home blend" fuel. Kerosene isn't even in the ballpark. Wood pellets are inconsistent in both quality and price. Regular firewood can be a cheaper option if you're set up for it and have a good supply. Coal is messy but probably cheap in your area.
Natural gas would be cheapest where available. Oil might not win out if you have an outdoor tank and need "mobile home blend" fuel. Kerosene isn't even in the ballpark. Wood pellets are inconsistent in both quality and price. Regular firewood can be a cheaper option if you're set up for it and have a good supply. Coal is messy but probably cheap in your area.