Training a NER model with en_trf_robertabase_lg

[ines (Ines Montani)]

@edu

Is training a simple textcat model with Transformers also not supported? Or did I install something incorrectly?

See my comment on this thread for more details on training a text classifier with transformer weights. TL;DR: You can do it, but you should probably use a separate training script, since the transformer models need pretty specific settings.

Error using XLNet for text classification: No component 'trf_tok2vec' found in pipeline

This is currently expected – the transformers classifier is a different text classifier implementation with its own component and component dependencies (token-vector-encoding, tokenization alignment etc.). The underlying problem here is that the train recipe disables all components except for the one you train (which makes sense, because that's the only one you want to update). But that doesn't work for this component, since it has other component dependencies. You can probably work around it …