# NER training on dataset which was annotated on older version.

**URL:** <https://support.prodi.gy/t/ner-training-on-dataset-which-was-annotated-on-older-version/3820>\
**Category:** Uncategorized\
**Tags:** usage, ner, spacy\
**Created:** [January 25, 2021, 7:34am UTC](https://support.prodi.gy/t/ner-training-on-dataset-which-was-annotated-on-older-version/3820 "2021-01-25T07:34:49Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Zainpann](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/zainpann/32/1150_2.png) [@Zainpann](https://support.prodi.gy/u/Zainpann)\
**Post date:** [January 25, 2021, 7:34am UTC](https://support.prodi.gy/t/ner-training-on-dataset-which-was-annotated-on-older-version/3820/1 "2021-01-25T07:34:50Z")

</div>

I annotated data on older version of prodigy, adn now when I db-in that data and train it on newer version of prodigy, its giving me the following error during training:

(spacy221) C:\Users\BNV\>python -m prodigy train ner newenglish en\_core\_web\_lg --output D:\latest\modelss  
✔ Loaded model 'en\_core\_web\_lg'  
C:\Users\BNV\Envs\spacy221\lib\site-packages\prodigy\recipes\train.py:453: UserWarning: [W030] Some entities could not be aligned in the text "chalo hamaray ilawa koi tou balance ki baat kertay..." with entities "[(0, 5, 'IGNORE'), (6, 13, 'IGNORE'), (14, 19, 'IG...". Use `spacy.gold.biluo_tags_from_offsets(nlp.make_doc(text), entities)` to check the alignment. Misaligned entities ('-') will be ignored during training.  
biluo = biluo\_tags\_from\_offsets(doc, offsets, missing=missing\_tag)  
C:\Users\BNV\Envs\spacy221\lib\site-packages\prodigy\recipes\train.py:453: UserWarning: [W030] Some entities could not be aligned in the text "haha..."tu mera hero" bhi tha:-P;-)" with entities "[(0, 4, 'IGNORE'), (7, 10, 'IGNORE'), (11, 15, 'IG...". Use `spacy.gold.biluo_tags_from_offsets(nlp.make_doc(text), entities)` to check the alignment. Misaligned entities ('-') will be ignored during training.  
biluo = biluo\_tags\_from\_offsets(doc, offsets, missing=missing\_tag)  
C:\Users\BNV\Envs\spacy221\lib\site-packages\prodigy\recipes\train.py:453: UserWarning: [W030] Some entities could not be aligned in the text "Arsal:-Sab kOo apni jan bachane ka haq ga.Jiya :-T..." with entities "[(0, 5, 'PERSON'), (7, 10, 'IGNORE'), (11, 14, 'IG...". Use `spacy.gold.biluo_tags_from_offsets(nlp.make_doc(text), entities)` to check the alignment. Misaligned entities ('-') will be ignored during training.  
biluo = biluo\_tags\_from\_offsets(doc, offsets, missing=missing\_tag)  
Created and merged data for 20761 total examples  
Using 16609 train / 4152 eval (split 20%)  
Component: ner | Batch size: compounding | Dropout: 0.2 | Iterations: 10  
ℹ Baseline accuracy: 0.665

=========================== ✨ Training the model ===========================

# Loss Precision Recall F-Score

* * *

1: 74%|█████████████████████████████████████████████████████▏ | 12281/16609 [02:44\<00:24, 177.92it/s]Traceback (most recent call last):  
File "C:\Users\BNV\AppData\Local\Programs\Python\Python36\Lib\runpy.py", line 193, in \_run\_module\_as\_main  
" **main**", mod\_spec)  
File "C:\Users\BNV\AppData\Local\Programs\Python\Python36\Lib\runpy.py", line 85, in _run\_code  
exec(code, run\_globals)  
File "C:\Users\BNV\Envs\spacy221\lib\site-packages\prodigy\_main_.py", line 60, in   
controller = recipe(_args, use\_plac=True)  
File "cython\_src\prodigy\core.pyx", line 300, in prodigy.core.recipe.recipe\_decorator.recipe\_proxy  
File "C:\Users\BNV\Envs\spacy221\lib\site-packages\plac\_core.py", line 328, in call  
cmd, result = parser.consume(arglist)  
File "C:\Users\BNV\Envs\spacy221\lib\site-packages\plac\_core.py", line 207, in consume  
return cmd, self.func(_(args + varargs + extraopts), \*\*kwargs)  
File "C:\Users\BNV\Envs\spacy221\lib\site-packages\prodigy\recipes\train.py", line 163, in train  
nlp.update(docs, annots, drop=dropout, losses=losses)  
File "C:\Users\BNV\Envs\spacy221\lib\site-packages\spacy\language.py", line 529, in update  
proc.update(docs, golds, sgd=get\_grads, losses=losses, \*\*kwargs)  
File "nn\_parser.pyx", line 446, in spacy.syntax.nn\_parser.Parser.update  
File "nn\_parser.pyx", line 551, in spacy.syntax.nn\_parser.Parser.\_init\_gold\_batch  
File "transition\_system.pyx", line 102, in spacy.syntax.transition\_system.TransitionSystem.get\_oracle\_sequence  
File "transition\_system.pyx", line 163, in spacy.syntax.transition\_system.TransitionSystem.set\_costs  
ValueError: [E024] Could not find an optimal move to supervise the parser. Usually, this means that the model can't be updated in a way that's valid and satisfies the correct annotations specified in the GoldParse. For example, are all labels added to the model? If you're training a named entity recognizer, also make sure that none of your annotated entity spans have leading or trailing whitespace or punctuation. You can also use the experimental `debug-data` command to validate your JSON-formatted training data. For details, run:  
python -m spacy debug-data --help

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [January 26, 2021, 11:18pm UTC](https://support.prodi.gy/t/ner-training-on-dataset-which-was-annotated-on-older-version/3820/2 "2021-01-26T23:18:57Z")

</div>

Hi! It looks like your data ended up with misaligned tokens (which old versions of spaCy quietly skipped, but which it now raises an error about explicitly). Did you use the same tokenizer during annotation and training?

One easy way to find the misaligned examples, check what's wrong and/or just exclude them from your dataset would be to load your Prodigy dataset and use spaCy's [`Doc.char_span`](https://spacy.io/api/doc/#char_span) method to check that all spans refer to valid tokens. If there are only a few problematic examples, you could just skip them and save the filtered examples to a new dataset.

```python
import spacy
from prodigy.components.db import connect

db = connect()
examples = db.get_dataset("your_dataset_here") # Prodigy dataset
nlp = spacy.blank("en") # whichever language/model you used
for example in examples: 
    doc = nlp(example["text"])
    for span in example["spans"]:
        char_span = doc.char_span(span["start"], span["end"])
        if char_span is None: # start and end don't map to tokens
            print("Misaligned tokens", example["text"], span)

```