So only the two end bands are embedded in the brick? I would fill the holes with a good mortar to prevent water infiltration and attach the ledgers properly. You can't attach a deck directly to or through the brick veneer. See page 15 of the following link. You can't attach it to your chimney chase, either. See page 8. I'm afraid a free standing deck may be in your plans.