Hot water pipe frozen

My hot water pipe is frozen. The main pipes/feeds to the house are on the outside of the house, in a little area with the hot water tank and heating unit, since they both run as one and both work off of kerosene (we have baseboard heating). The cold water, about five minutes ago, just kicked back on, so I left the hot water faucets on to help relieve that pressure and help it thaw out. I was wondering if there was a way to thaw out the pipe in a timely manner. I keep reading things about using a blowdryer, but they are all mixed discussions (they are good, they are not good). We've used one before, but last time, something in the house burst. I don't know what I should do this time in order to help this issue.

UPDATE: Problem solved! Everything is back to normal. Gotta insulate the boiler area better.