If so, thinking off the top of my head -- the simplest solution would be to create a new dataset that only has the labels you want. Have you tried that?
I answered a similar question yesterday where I showed a simple code to export annotations (db-out), change a few mislabeled examples, then import back in (db-in).
The only difference is you may want to remove specific spans type instead of changing the label name.