# ner.correct --exclude not excluding duplicate tasks

**URL:** <https://support.prodi.gy/t/ner-correct-exclude-not-excluding-duplicate-tasks/3374>\
**Category:** Uncategorized\
**Tags:** bug, ner\
**Created:** [September 4, 2020, 6:22pm UTC](https://support.prodi.gy/t/ner-correct-exclude-not-excluding-duplicate-tasks/3374 "2020-09-04T18:22:48Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![Winawer](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/winawer/32/4481_2.png) [@Winawer](https://support.prodi.gy/u/Winawer)\
**Post date:** [September 14, 2020, 8:46pm UTC](https://support.prodi.gy/t/ner-correct-exclude-not-excluding-duplicate-tasks/3374/5 "2020-09-14T20:46:34Z")

</div>

@ines I seem to be experiencing a related issue, using Prodigy 1.10.4 on OS X (Catalina) with Python 3.8.5. I had the same issue as in the OP, with repeated tasks during `ner.correct --exclude`, found this thread, and applied the workaround with `feed_overlap`. That seemed to fix the issue ... at least until I got about 25-30 annotations in to my next batch. Then, Prodigy started to repeatedly feed the same tasks back to me, as if it was starting from the beginning of the same 25 tasks and looping through again. When I see the task again, the annotations I made are gone. The only way I can get it to stop looping through the same set of 25-30 annotations is to kill Prodigy and re-run the same recipe. Then, I get a new batch of about 25-30 tasks, and the fun begins again.

When I dump the dataset with `db-out`, it looks like the annotations I made are being saved, but my confidence is a bit shaken. Two further points:

1). I'm using `--unsegmented` because I'm correcting with a model I trained on a cold start dataset (following the general process you put forth in [this video](https://support.prodi.gy/t/video-ner-with-prodigy-transfer-learning/2662)). However, it was complaining that the model didn't set sentence boundaries, so I came upon the `--unsegmented` option. I am having the same problem with or without it, though.

2). I'm probably missing something, but the [docs](https://prodi.gy/docs/api-loaders#hashing) say that the hashs `_input_hash` and `_task_hash` are supposed to be `uint32`, no? When I look in my `db-out` output, a lot of the hashes seem to be negative integers

```python
... "_input_hash":-705417333,"_task_hash":-803297770 ...

```

Any ideas?

---

_[View the full topic](https://support.prodi.gy/t/ner-correct-exclude-not-excluding-duplicate-tasks/3374)._