I need to relabel a pre-annotated data.
When I import it and work till let's say document 10, I am getting an error
ValueError: Mismatched tokenization..... I understand where the error is coming from.
My question or request is: how can I make it either skip this document or discard annotations around that positions, or discard annotations on that document altogether?
Currently I am learning about it in the middle of manual annotation, and it takes a significant effort to recover manual annotations and restart the job. Is there any flag to make it fail gracefully?