# Feed overlap not working as expected

**URL:** <https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248>\
**Category:** Uncategorized\
**Tags:** usage, solved\
**Created:** [February 27, 2019, 2:52pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248 "2019-02-27T14:52:53Z")\
**Posts on this page:** 17\
**Page:** 1

<div class="post-metadata">

**Author:** ![smanjil](https://avatars.discourse-cdn.com/v4/letter/s/48db29/32.png) [@smanjil](https://support.prodi.gy/u/smanjil)\
**Post date:** [February 27, 2019, 2:52pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/1 "2019-02-27T14:52:53Z")

</div>

Hi @ines,

Continuing on this one,  
I have this scenario: for example 10 examples for annotation

two routes:

- 127.0.0.1:8080/?session=user1
- 127.0.0.1:8081/?session=user2

But, this creates each user their own dataset.  
I want user 1 to annotate 5, and user 2 to annotate other 5.

But, this does not work as expected always. If I open both sessions at the same time, I annotate 5 example from user1, save, exit. Now, if I go to user2, it also shows me the examples that I already annotated through user1.

I don’t want this to happen. Any way?

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [February 27, 2019, 2:56pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/2 "2019-02-27T14:56:45Z")

</div>

Yes, this is the default behaviour: user feeds overlap so everyone gets to see the same examples. If you set `"feed_overlap": false`, the annotations will be sent out without an overlap, meaning that every examples will only be annotated once overall instead of once per annotator.

Here's the relevant section in the `PRODIGY_README.html`:

> The `"feed_overlap"` setting in your `prodigy.json` or recipe config lets you configure how examples should be sent out across multiple sessions. By default (`true`), each example in the dataset will be sent out **once for each session** , so you'll end up with overlapping annotations (e.g. one per example per annotator). Setting `"feed_overlap"` to `false` will send out each example in the data **once** to whoever is available. As a result, your data will have each example  
> labelled only once in total.

---

<div class="post-metadata">

**Author:** ![smanjil](https://avatars.discourse-cdn.com/v4/letter/s/48db29/32.png) [@smanjil](https://support.prodi.gy/u/smanjil)\
**Post date:** [February 27, 2019, 3:12pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/3 "2019-02-27T15:12:25Z")

</div>

Still, it does not work as expected.  
Should user1 exit before user2 start working?

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [February 27, 2019, 3:16pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/4 "2019-02-27T15:16:05Z")

</div>

(Moved this to a new topic so it’s easier to find and not hidden in the comments of the other thread.)

Where did you set the setting and what are you seeing? If you start two separate sessions, are both sessions still receiving the same questions?

---

<div class="post-metadata">

**Author:** ![smanjil](https://avatars.discourse-cdn.com/v4/letter/s/48db29/32.png) [@smanjil](https://support.prodi.gy/u/smanjil)\
**Post date:** [February 27, 2019, 3:19pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/5 "2019-02-27T15:19:15Z")

</div>

I set `"feed_overlap": false` in prodigy.json .  
Yes, start two separate sessions at the same time, I annotate 4 from one session, save. And I go to other session, refresh, and still get the previous questions.

---

<div class="post-metadata">

**Author:** ![smanjil](https://avatars.discourse-cdn.com/v4/letter/s/48db29/32.png) [@smanjil](https://support.prodi.gy/u/smanjil)\
**Post date:** [February 28, 2019, 12:34pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/6 "2019-02-28T12:34:36Z")

</div>

Hi @ines,

Seems like it works on two prodigy sessions running on same ports. But fails on different ports. Is this the expected behavior?

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [February 28, 2019, 5:01pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/7 "2019-02-28T17:01:35Z")

</div>

Ah yes, that makes sense, though, since you’re running separate instances. The named multi user sessions are specifically intended for running one single instance of Prodigy on one port.

---

<div class="post-metadata">

**Author:** ![ingvarvg](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ingvarvg/32/1956_2.png) [@ingvarvg](https://support.prodi.gy/u/ingvarvg)\
**Post date:** [March 5, 2021, 2:13pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/8 "2021-03-05T14:13:03Z")

</div>

> [@ines](#):
>
> single

Hi @ines,

Doesn't work for me. I run a single prodigy session on a single port, with "feed\_overlap": false in prodigy.json. There is still the same feed in each different named session.

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [March 6, 2021, 3:34am UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/9 "2021-03-06T03:34:01Z")

</div>

> [@ingvarvg](#):
>
> Doesn't work for me. I run a single prodigy session on a single port, with "feed\_overlap": false in prodigy.json. There is still the same feed in each different named session.

Which version of Prodigy are you running? And are you running one single instance and accessing different sessions via the `?session=` parameter?

---

<div class="post-metadata">

**Author:** ![zaraki](https://avatars.discourse-cdn.com/v4/letter/z/b5ac83/32.png) [@zaraki](https://support.prodi.gy/u/zaraki)\
**Post date:** [April 15, 2021, 4:13pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/10 "2021-04-15T16:13:01Z")

</div>

Hello Ines, I'm having the same issue as the others: `feed_overlap = false`, one single instance of prodigy on one single port and multiple users accessing it through browser via url like `example.com/?session=peter` and `example.com/?session=paul`  
It shows the current session but it still sends the same entries to both sessions.

Prodigy version is 1.10.7

---

<div class="post-metadata">

**Author:** ![pl6306](https://avatars.discourse-cdn.com/v4/letter/p/bbe5ce/32.png) [@pl6306](https://support.prodi.gy/u/pl6306)\
**Post date:** [October 26, 2021, 7:44pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/11 "2021-10-26T19:44:07Z")

</div>

I am still somewhat confused about how to configure this properly. Is it possible to use a different naming conventions such as split dataset among session or repeat dataset per session? Does feed\_overlap = false mean that you split the dataset among the sessions? And feed\_overlap = true means you repeat the entire dataset per session? Or is the other way around?

---

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [October 28, 2021, 8:22am UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/12 "2021-10-28T08:22:12Z")

</div>

> [@pl6306](#):
>
> Does feed\_overlap = false mean that you split the dataset among the sessions? And feed\_overlap = true means you repeat the entire dataset per session? Or is the other way around?

`feed_overlap = false` means that the examples are sent out with no overlap, so different annotators will get different examples, whatever is next available in the stream.

`feed_overlap = true` means that every annotator will get the same examples. This is the same as starting different instances of Prodigy and giving each annotator their own instance with the same stream.

If you already know how you want to split up your source data, it's easier to just start separate instances of Prodigy with different input files. This way, you can control exactly which examples the different annotators will see, and you can use your own convention for how to name the datasets.

---

<div class="post-metadata">

**Author:** ![cheyanneb](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/cheyanneb/32/2409_2.png) [@cheyanneb](https://support.prodi.gy/u/cheyanneb)\
**Post date:** [December 9, 2021, 5:00pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/13 "2021-12-09T17:00:30Z")

</div>

I am experiencing the same situation. Same dataset, different sessions. We have `feed_overlap = true`. We are on the latest version of Prodigy. The workaround seems to be break out the dataset for each user, but is there another setting that I'm missing here in addition to `feed_overlap`. Is this a known issue?

---

<div class="post-metadata">

**Author:** ![SofieVL](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/sofievl/32/915_2.png) [@SofieVL](https://support.prodi.gy/u/SofieVL)\
**Post date:** [December 30, 2021, 10:12am UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/14 "2021-12-30T10:12:04Z")

</div>

Hi Cheyanneb, has this been addressed by the fix from the thread [Duplicate annotations in output - #12 by kab](https://support.prodi.gy/t/duplicate-annotations-in-output/4961/12) ?

---

<div class="post-metadata">

**Author:** ![vsocrates](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/vsocrates/32/3218_2.png) [@vsocrates](https://support.prodi.gy/u/vsocrates)\
**Post date:** [September 28, 2022, 5:51pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/15 "2022-09-28T17:51:19Z")

</div>

As a quick aside, is there a way to set the percentage of overlap instead of having full overlap? This would be a nice feature, if it doesn't exist already! Thanks!

---

<div class="post-metadata">

**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\
**Post date:** [October 11, 2022, 2:38pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/16 "2022-10-11T14:38:08Z")

</div>

hi @vsocrates!

Thanks for the comment and sorry for the delay.

This functionality doesn't exist currently but the team is actively looking into adding the functionality as part of Prodigy v2. Thanks again for the feedback!

---

<div class="post-metadata">

**Author:** ![vsocrates](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/vsocrates/32/3218_2.png) [@vsocrates](https://support.prodi.gy/u/vsocrates)\
**Post date:** [October 14, 2022, 2:42pm UTC](https://support.prodi.gy/t/feed-overlap-not-working-as-expected/1248/17 "2022-10-14T14:42:12Z")

</div>

Looking forward to it, thanks!
