Before I dressed my newborn in anything I had I washed it first with gentle baby detergent whether it was clean/washed or not. So, may be the person you give it to will wash it anyway.
As for adults, I wouldn't bother washing gifts when I've kept that yarn clean. Also, remember that some people are sensitive to certain smells and cleaning agents.
Hope that helped.