Yes ! If fiberglass itches your skin, I wonder what micro particles of glass will do in peoples lungs over the course of decades. Even if it technically is not a carcinogen, it really cannot be a good thing.
Yet, when working around and moving the stuff enough to do a job, you can often see little sparkles of glass in the air.
Maybe the worst that happens is a man becomes Pink.