Without pictures (and maybe not even then… :)) it’s hard to say. However, I think I can visualize what you are describing.
Mr Sellers has a video on making a rabbet plane where he encounters something, I believe, like you are describing. Have you taken a look at that video and how he handles the ‘pushed out’ wedge? The solution might be similar, if the issue is similar.