It's important to use the right tool for the project. If you try to use a screwdriver to hammer in a nail, you'll find it very frustrating, but you wouldn't say, "I don't like screwdrivers!"
In knitting, trying to force the wrong needle to work in a project is just as frustrating.
Hats are normally worked on 16", so you are having to stretch your stitches out over 11 extra inches!! Of course that's going to be frustrating!!
So...before you make the final decision on whether or not you like circulars in general, do try a project or two on the proper size and see what you think.