No problem locking a 4x4 to a house, but if the post is also locked into the ground w/ concrete you better make sure the post is not lifting at all from frost heaving... as far as I can see. If you are only holding up a short chunk of fence, then yes, I'd say the concrete is overkill and potentially a problem, assuming the house is solid where connected.