ner.manual: Accept/Reject confusion

I am using ner.manual recipe to annotate a new entity type. I am confused on what accept/reject means when a sentence with multiple entities identified and annotated is presented in the browser.

If one of three entities, for instance, is incorrect, should I press the reject button or should I delete that one specific annotation, and hit the accept button so that the other two annotated entities are recorded as correct?

Hi! If you're annotating manually, you should ideally correct the annotations and hit accept, so that the answer you're submitting is the final and correct one. If that's not possible, e.g. because the tokenization doesn't match, there are OCR issues or other problems, you can hit reject to exclude the example from training and to separate it from the examples you skip for other reasons. See this thread for details:

Alternatively, as of Prodigy v1.10, you can also use the buttons setting in your config to disable the reject button entirely: Installation & Setup · Prodigy · An annotation tool for AI, Machine Learning & NLP

1 Like

Many thanks, @ines. This clarifies my doubts.

1 Like