4x4 ribbing will be a gentle stretch factor. But do use a smaller needle (by 2 or 3 sizes) than the body of the hat.
Felting it? :?? I dunno. I think felting will sap the energy right out of the ribbing. 'Freeze-drying' it on the spot. Like matted hair: it's locked into itself.