Angora and alpaca can be itchy, even for people who don't have sensitive skin. Stick with very soft, smooth yarn. Lion has microspun, a soft microfiber yarn. If the baby cotton is really soft, that would be good. Caron SS is another one that people use a lot for chemo hats.