Raglan Sweater Design Faux Pas

I am knitting a seamless raglan sweater of my own design, and I appear to have made a bit of a mistake (or maybe a big mistake): in all of the excitement of finishing the second sleeve, I joined it and began decreasing every other row immediately instead of working an inch or two plain and then decreasing. I’ve already been decreasing every other row for about two inches, should I just rip it back, rejoin the sleeves and work an inch or two plain? Or will my sweater possibly be alright in its current state?

Thanks so much.

Well I don’t know all that much about raglan shaping, but I’m knitting my first cardigan in this style at the moment and I did start decreasing immediately after joining the sleeves to the body.