We currently working on a NER project. We have a larger number of samples for annotation. We have multiple people in the team(around 10). We have started evaluating the active learning capability of the prodigy and it is excellent. We like to purchase the lincesnce. Please help us to get answers to the following questions to make our purchase process smoother.
- In case of multiple user annotation, all the users will get similar sentences/paragraphs for annotation or different? We essentially want all the users should get a different set of sentences for annotation and that should not overlap with each other.
- Consider prodigy satisfy the first condition.
i) how active learning works? All annotators would have a local model or they will be updating to a global model?
ii) Does annotation from one user changes the recommendation for another user?
iii) Does prodigy store user_id for specific annotation is DB?
- Does ner.teach and ner.correct work in conjunction? Underlying active learning would be the same in both the approach?
I found out multiple threads regarding multi-user capability, but they are 1 or 2 years old hence specifically asked for these questions.
Thanks in advance.