# NER review datasets with partial overlap while keeping all texts **URL:** \ **Category:** Uncategorized\ **Tags:** usage, ner, best-practices, review\ **Created:** [February 13, 2023, 2:19pm UTC](https://support.prodi.gy/t/ner-review-datasets-with-partial-overlap-while-keeping-all-texts/6365 "2023-02-13T14:19:50Z")\ **Posts on this page:** 1\ **Showing post:** 2
**Author:** ![koaning](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/koaning/32/230_2.png) [@koaning](https://support.prodi.gy/u/koaning)\ **Post date:** [February 13, 2023, 4:14pm UTC](https://support.prodi.gy/t/ner-review-datasets-with-partial-overlap-while-keeping-all-texts/6365/2 "2023-02-13T16:14:41Z")
The `--auto-accept` option only automatically accepts examples where at least two annotators agree. Some of the details of that behavior are explained in this thread: > [@Prodigy review recipe not entirely clear to me](https://support.prodi.gy/t/prodigy-review-recipe-not-entirely-clear-to-me/6044/4): > > So let's extend the example. I'll be annotating this on-theme example: {"text": "a wood chuck could chuck a lot of wood if a wood chuck could chuck wood"} Again, I'll run: PRODIGY\_CONFIG\_OVERRIDES='{"feed\_overlap": true}' python -m prodigy textcat.manual issue-6044 examples.jsonl --label truthy And now I'll annotate this with the guybrush user. This user did not appear before. And for good measure, I'll show the annotation from db-out: \> python -m prod… I'm wondering why you'd automatically want to accept annotations if only a single annotator was involved. It could work out, but you are risking accepting candidates where annotators might be disagreeing. Could you give a bit more background? Is there a reason why only a subset of the annotated examples should be seen by two annotators? --- _[View the full topic](https://support.prodi.gy/t/ner-review-datasets-with-partial-overlap-while-keeping-all-texts/6365)._