Not sure you can buy anything strong enough over the counter so you may want to call a pest control expert. They are often cheaper in the long run when yo finally sit down and add up receipts for bottles of stuff that did not work and that you cannot even dispose of legally.
Carpenter bees are nasty and aggressive but from my experience and that of others, it takes a lot for them to sting. This doesn't mean your kids should enjoy having them around though.
And definitely fill the holes they made.