# ner.correct examples repeat

**URL:** <https://support.prodi.gy/t/ner-correct-examples-repeat/4670>\
**Category:** Uncategorized\
**Tags:** ner, done\
**Created:** [September 8, 2021, 12:53pm UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670 "2021-09-08T12:53:13Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![latkins](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/latkins/32/63_2.png) [@latkins](https://support.prodi.gy/u/latkins)\
**Post date:** [September 8, 2021, 12:53pm UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/1 "2021-09-08T12:53:13Z")

</div>

I am running the `ner.correct` recipe, but find that the same ~20 examples just cycle (and when they re-appear, they don't have the corrected labels).

I can confirm that this occurs with multiple models (both trained locally and not). My input `jsonl` does not have these repeats, and each line contains only a text field. The `~/.prodigy/prodigy.json` is empty. I am on 1.11.3.

---

<div class="post-metadata">

**Author:** ![Onyoursix](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/onyoursix/32/1579_2.png) [@Onyoursix](https://support.prodi.gy/u/Onyoursix)\
**Post date:** [September 8, 2021, 8:16pm UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/2 "2021-09-08T20:16:33Z")

</div>

I'm also getting this same issue on 1.11.3 but I'm using `ner.manual`

---

<div class="post-metadata">

**Author:** ![kab](https://avatars.discourse-cdn.com/v4/letter/k/9dc877/32.png) [@kab](https://support.prodi.gy/u/kab)\
**Post date:** [September 9, 2021, 5:57am UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/3 "2021-09-09T05:57:59Z")

</div>

Thank you both for the reports. Looks like we pushed a bug along with a fix in version 1.11.3. This will be fixed in the next release (1.11.4) but in the meantime you can add a `?session={session_id}` query parameter.

So if you're running Prodigy locally on port 8080 (which is default) then instead of doing your annotations at: `http://localhost:8080`, do your annotations at `http://localhost:8080?session={session_id}` (e.g. I use `kab` as my session id like: `http://localhost:8080?session=kab`.

We recommend using a `session` parameter whenever possible anyway but we will definitely get the fix out for allowing no session to be specified.

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [September 13, 2021, 4:13am UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/4 "2021-09-13T04:13:23Z")

</div>

Just released v1.11.4, which should fix the underlying issue!

---

<div class="post-metadata">

**Author:** ![chuanw24](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/chuanw24/32/2708_2.png) [@chuanw24](https://support.prodi.gy/u/chuanw24)\
**Post date:** [December 30, 2021, 6:05pm UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/5 "2021-12-30T18:05:15Z")

</div>

I think the issue is still there for v1.11.6. I'm using a custom recipe based on ner.manual (simply added one additional block). 10% of the examples are shown repeatedly.

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [December 30, 2021, 6:19pm UTC](https://support.prodi.gy/t/ner-correct-examples-repeat/4670/6 "2021-12-30T18:19:28Z")

</div>

@chuanw24 Does it make a difference if you save the results to a new dataset? This particular issue is incredibly mysterious because we've tried all kinds of things and have not been able to reproduce this, which makes it incredibly tricky 🤔