It shouldn’t be the case.
What kind of curve do you have in the back?
Also, are you doing this on sand paper? If so and if you kept your larger chisel to the end, perhaps you should change your paper.
Final question: are all your chisels of the same making?