*P23 with ws of left sleeve facing, P tog last st from left front and 1st st from sleeve (raglan seam), P across sleeve to last st, P tog last st from sleeve and first st from back, purl across back to last st, with ws of right facing, P tog last st from back and 1st st from sleeve, purl across sleeve to last st, P tog last st from sleeve and first st from front, P 23. 167 stitches.
You are now going to join the three pieces (two sleeves, body piece). From what you describe sounds like you are making a cardigan and it has been worked from the bottom up. Look at the body piece, and realize/visualize that the two spots of 6CO sts are going to be the bottom of the arm holes. Start on the body and purl 23 of the 24 sts (one front panel). Then join the last st there with the 1st st on one of the sleeves. Then work across the sleeve to the last st. Join the last sleeve stitch to the next available st on the body (1st of the back sts). Then work across the sweater back to the last st. Join the last st with the 1st stitch of the other sleeve. Work across the sleeve to the last st. Join the last st with the 1st of the remaining body sts (other front panel). Work remaing sts to end.
The next few rows will be difficult as stretching your needles across the 24 sleeve sts can be hard. You will definitely benefit by using a "magic loop" type technique. But, after a few rows you will slowly decrease the number of sts across the sleeve as you set in the raglan, and it will become easier.