The headband in that picture is woven rather than knit. To knit eyelets into something I do this:
Row 1: K1, yo, k2tog to last stitch of row, K1 (this is what gives you the eyelets)
Row 2: Purl across (to complete the pattern)
Knit these two rows to desired length and then bind off after a purl row.