Ideally you'd replace the affected boards. You could inlay similar wood striving to keep the grooves in line but it will always show. Sometimes the best fix is the easiest - just nail wood over the hole and paint it to match.
If I were to just cut a round piece of wood to patch both holes, how would I go about attaching it?