I can’t say what I prefer…but I can say that I avoid knitting with fingering & lace weight yarn for garments which require teeny needles such as US000-3. But I’ve done it, reluctantly, for baby sweaters.
I’m not wild about super bulky weight yarns which require huge needles either, but I’ve done it, too!
Usually, my garment knitting ranges around dk weight, worsted weight, and aran weight. And the needles usually are US5-US9 to get gauge.
I don’t mind knitting on the US5 or US6 using dk weight. You get used to it. I always knit a 4"x4" gauge swatch, and this gets your hands used to smaller needles again.
I have circulars ranging from US000-US19. And I bought a straight pair of needles in sizes US35! They are hollow plastic needles, not too heavy. I think I even have a pair of straight US50! For rugs…using BIG YARN, or numerous strands held together. Saw it done on a Knitting Daily TV dvd video. Real cool. So I purchased the super gigantos when I spotted them somewhere.