Hi, I think this is the same issue as a known bug related to spacy-transformers
: PyTorchWrapper causes error on deserializing · Issue #8319 · explosion/spaCy · GitHub
We're working on a fix in spacy-transformers
. If you are very adventurous, you can try out the current dev version: pip install spacy-transformers==1.1.0.dev3
. We should be pretty close to the final release, but want to do a bit more testing first. If you do try it out, let us know how it goes!