Do you have double pane windows? It may boil down to poor air circulation. Do you have a return duct? Damp Rid may work for you.

And more importantly, why are you opening the windows in the middle of winter? Your kid's going to catch a cold!