Hi team, I keep running into this error frequently when trying to train NER models on annotation data that was collected using ner.correct recipe.
ValueError: [E024] Could not find an optimal move to supervise the parser. Usually, this means that the model can't be updated in a way that's valid and satisfies the correct annotations specified in the GoldParse. For example, are all labels added to the model? If you're training a named entity recognizer, also make sure that none of your annotated entity spans have leading or trailing whitespace or punctuation. You can also use the experimental
debug-data command to validate your JSON-formatted training data.
Things i have tried so far -
no luck. does any one have any tips on how I can move forward?
spacy : 2.3.0
prodigy : 1.10.8
p.s - i never used to face this issue before as prodigy would just throw an warning for misaligned tokens and carry on. Now i am stuck and unable to proceed. All this started happening recently after some updates