I have a custom ner model trained with “en_vectors_web_lg” as the base model and wish to combine it with one of the core english spacy models to handle dependency parsing so that I examine how my entities are related to each other. I can do this by loading both my custom model and a spacy model, then applying them separately; however, I cannot successfully combine them.
My custom model contains two pipelines:
[('sbd', <spacy.pipeline.SentenceSegmenter at 0x7fc11fff7e48>), ('ner', <spacy.pipeline.EntityRecognizer at 0x7fc1b81ccca8>)]
while the spacy model contains three:
[('tagger', <spacy.pipeline.Tagger at 0x7fc1e5f5b5f8>), ('parser', <spacy.pipeline.DependencyParser at 0x7fc1e5ef80a0>), ('ner', <spacy.pipeline.EntityRecognizer at 0x7fc1e5f0d6d0>)]
I have tried using replace_pipe, loading the spacy model without the NER pipe and using add_pip to add my custom ner model to the spacy model, and also tried adding the tagger and parser from the spacy model to my custom model. anytime I try to use the model do perform the new or updated pipeline I receive an error similar to:
ValueError: [E084] Error assigning label ID 8397771882303007253 to span: not in StringStore.
Based on some github and stackoverflow posts I have tried updating/replacing the vocab without any luck and am still looking for a solution.