I am new to prodigy. I have an NER task of which I have used ner.manual to provide some initial labels. In order to test the prospect I want to use ner.train with pretrained weights. I tried using Scibert provided weights and another fine tuned weights I have of NER built on Scibert....Both failed with the message:
srsly.msgpack.exceptions.ExtraData: unpack(b) received extra data.
So, my question is, how can I use some of these pretrained weights with prodigy since Scibert is also compliant with Scispacy I expected its weights should have worked.
How can I get pretrained weights for biomedical NER that can work with prodigy?