I’m not sure which kind of buttonhole you worked but I take it that the outer border is a bit ‘tatty’.
As a quick fix, you could get some matching embroidery yarn to sew a small blanket stitch around the edge - this will not only tidy up the buttonholes but give the garment a little extra professional-looking finish.
Next time you’re working buttonholes, check out this site:
It’s Maggie Righetti’s one-row buttonhole and it is the best I’ve come across - it’s from her book [I]Knitting in Plain English[/I] and anyone who writes “buttonholes are bstrds” must know what she’s on about.
All the Best