# Prodigy Annoation: Best Practise

**URL:** <https://support.prodi.gy/t/prodigy-annoation-best-practise/5318>\
**Category:** Uncategorized\
**Tags:** usage, ner, solved\
**Created:** [February 15, 2022, 11:47am UTC](https://support.prodi.gy/t/prodigy-annoation-best-practise/5318 "2022-02-15T11:47:52Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ta13](https://avatars.discourse-cdn.com/v4/letter/t/59ef9b/32.png) [@ta13](https://support.prodi.gy/u/ta13)\
**Post date:** [February 15, 2022, 11:47am UTC](https://support.prodi.gy/t/prodigy-annoation-best-practise/5318/1 "2022-02-15T11:47:52Z")

</div>

I have labelled a data using keywords. Now I want to check the performance. So that, I have used ner.correct. When I found any wrong annotation, I cross the annotated phrase and if I find any word to annotate then I manually annotate using prodigy UI. And then I accept the annotation and save the data. Is it the right way to annotate or we have to reject the examples which are not correct? If we have to reject, then how can I correct the annotation and accept?

---

<div class="post-metadata">

**Author:** ![ljvmiranda921](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ljvmiranda921/32/3197_2.png) [@ljvmiranda921](https://support.prodi.gy/u/ljvmiranda921)\
**Post date:** [February 16, 2022, 1:16am UTC](https://support.prodi.gy/t/prodigy-annoation-best-practise/5318/2 "2022-02-16T01:16:17Z")

</div>

Hi @ta13,

You're right in terms of correcting wrong annotations and saving them in `ner.correct`. Afterwards, you can use those corrected annotations to further improve your model. Rejecting annotations in `ner.correct` is only done if you don't want to include a particular sample in the gold dataset (i.e., the text is corrupted, labels are unclear and inconsistent, etc.).

---

<div class="post-metadata">

**Author:** ![ta13](https://avatars.discourse-cdn.com/v4/letter/t/59ef9b/32.png) [@ta13](https://support.prodi.gy/u/ta13)\
**Post date:** [February 16, 2022, 3:59am UTC](https://support.prodi.gy/t/prodigy-annoation-best-practise/5318/3 "2022-02-16T03:59:25Z")

</div>

Hi  
Thanks for your answer. I have some related queries:

1. When I provide the data to annotators, how can I get to know that how much data is annotated by them?
2. How the annotators can get to know the annotation if they they take break, close the window and again comeback?
3. After annotating, if it shows that there is no task available, if I again run ner.correct and provide it to another annotator, it again shows no task available. Why it happens and how to solve it?

---

<div class="post-metadata">

**Author:** ![ljvmiranda921](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ljvmiranda921/32/3197_2.png) [@ljvmiranda921](https://support.prodi.gy/u/ljvmiranda921)\
**Post date:** [February 18, 2022, 10:05am UTC](https://support.prodi.gy/t/prodigy-annoation-best-practise/5318/4 "2022-02-18T10:05:33Z")

</div>

Hi @ta13,

1. It's possible to have different datasets for each annotator, and run `prodigy stats` to check their progress.
2. When an annotator closes the window and comes back, Prodigy will request the next available unannotated batch from the server.
3. When this happens in `ner.teach`, it usually means that there's nothing left to annotate anymore from the source data. Since `ner.teach` uses the model to suggest entities, then every example that is relevant has already been annotated.