A brand new plugin: 🤗 Prodigy Hugging Face

,
1

Hi all.

Just wanted to let y'all know that there's been another iteration on our plugins. This time, we've added initial support for training Hugging Face transformer models directly on Prodigy data. We noticed that some of our users were interested in training a HF model directly without a spaCy wrapper. The new prodigy-hf plugin should make this much easier.

The recipe comes with two recipes right now:

  1. hf.train.ner which allows you to train NER recipes
  2. hf.upload which allows you to upload your annotated datasets directly to Hugging Face Hub

If you want to learn more you can check out our updated docs. If you want to customise the training further you can also use these recipes as a place to start and customise.

1 Like
5

The recipe on Prodigy Plugins · Prodigy · An annotation tool for AI, Machine Learning & NLP is hf.ner.correct, but the recipe on GitHub is hf.correct.ner

6

wh00ps! My bad!

We changed names just before releasing that feature. Good catch! Will make a fix right away.

7

Just made a new release of prodigy-hf. If you reinstall, the names should be all good again.

Again, thanks for reporting! I'm still a bit embarrassed that we didn't catch this ourselves.