Neck edge

My pattern tells me to decrease at the neckedge of the sweater. I s this the side closest to the buttons or to the sleves?

On the same edge as the buttons.

Thank you!