ner.batch-train after ner.maual results error (Value error : [E024])

[ines (Ines Montani)]

Hi! Did you use the same Prodigy version for annotation and training, or did you collect the annotations in a previous version?

It's likely that this is related to the update to spaCy v2.1, which is stricter about gold standard data and constraints for the parser and named entity recognizer. See my reply from this thread:

@ines

Do any of the entity spans you’ve annotated start or end on whitespace characters? In spaCy v2.1, it’s now “illegal” for the named entity recognizer to predict entities that start or end with whitespace, or consist of only whitespace. For example, "\n" , but also "hello\n" . This should be a really helpful change, because those entities are pretty much always wrong, and making them “illegal” limits the options and moves the entity recognizer towards correct predictions. But it also means that if you data contains training examples like this, you probably want to remove or fix them.

So you might want to double-check the data and see if you have any "illegal" spans in there. It's usually pretty rare and removing them should be no problem, because in most cases, they'd be rejected suggestions anyway.