A brand new plugin: ๐Ÿค— Prodigy Hugging Face

Hi all.

Just wanted to let y'all know that there's been another iteration on our plugins. This time, we've added initial support for training Hugging Face transformer models directly on Prodigy data. We noticed that some of our users were interested in training a HF model directly without a spaCy wrapper. The new prodigy-hf plugin should make this much easier.

The recipe comes with two recipes right now:

  1. hf.train.ner which allows you to train NER recipes
  2. hf.upload which allows you to upload your annotated datasets directly to Hugging Face Hub

If you want to learn more you can check out our updated docs. If you want to customise the training further you can also use these recipes as a place to start and customise.

1 Like

The recipe on Prodigy Plugins ยท Prodigy ยท An annotation tool for AI, Machine Learning & NLP is hf.ner.correct, but the recipe on GitHub is hf.correct.ner

wh00ps! My bad!

We changed names just before releasing that feature. Good catch! Will make a fix right away.

Just made a new release of prodigy-hf. If you reinstall, the names should be all good again.

Again, thanks for reporting! I'm still a bit embarrassed that we didn't catch this ourselves.