Dynamic label

[ryanwesslen]

hi @fsa,

Thanks for your question!

Can you describe your use case a bit more?

Initially, I suspected the new custom event hooks could help, but a teammate reminded me that it likely wouldn't work with spans. You could modify the task structure but still need the provide spans and offset which are needed for span annotation; it may be possible with text classification that doesn't require them.

The challenge is Prodigy wasn't designed for dynamic label sets (within the same session), i.e., "one-label-set-per-session":

Custom ner.manual with different label sets

No, by design, Prodigy expects you to define one label set per annotation session. The label scheme is one of the most important parts of an NLP application and model, so allowing too much arbitrary variance during annotation can easily lead to many other problems down the line. Similarly, changing the annotation objective completely on a per task-basis really goes against Prodigy’s UX philosophy and I can’t think of many cases where this would be beneficial compared to an approach that uses mu…

However, we are actively looking at this problem as it has come up before. Any context from your use case will help to make suggestions or consider possible modifications. Thank you!