That is very nice, Karen.
Is it the ribbing for the button/buttonhole bands that you are not happy with? Maybe the neck ribbing too? Are you using smaller needles when you do that part? I usually use 2 sizes smaller for the ribbing for the picked up areas and sometimes even 3 sizes smaller. Most patterns tell you how many stitches to pick up, but I went to a knitting class about finishing and the lady who taught it said not to worry about how many it says to pick up. She taught to use 2 sizes smaller needle and to pick up 3 stitches and then skip one all the way up the fronts. 1, 2, 3, skip she sang as she skipped around the room to help us remember. LOL On the neck you use the 1, 2, 3 skip except where you are picking up the horizontal stitches at the neck back and then she said to pick up one for one across that part. Sometimes a pattern will have you ditch a few stitches across that part too, but not usually. If you pick up this way, picking up how many need to be picked up you will usually be pretty close to the number the pattern called for (unless you change the length). If you are way off you might have done something wrong.
Using smaller needles and doing the 1,2,3, skip will cause the bands to be a little smaller (or shorter) than the body of the sweater, which is just what you need in these areas. I find this works very well. You might like to give it a try on your next one and see if you like the result. If you don't you can always rip it out and do it over.
Our youngest daughter is expecting her first baby Oct. 25. It is expected to be a girl too. We have 5 other granddaughters and one grandson. All these others range in age from 7 to 14, so we haven't had a baby in a long time. It is fun, huh?