Issue with multi-user session

[ryanwesslen]

hi @rosamond!

Thanks for the update.

@rosamond

Unfortunately, I'm still dealing with this issue, even if I add PRODIGY_CONFIG_OVERRIDES='{"feed_overlap": true}' before the command. I've added the verbose marker, and FEED shows 'overlap': True. I've also changed my global config file to have "feed_overlap":true. I've been careful to always save my work.

This is good. At least we can confidently confirm that feed_overlap is set to true.

@rosamond

I want to start a prodigy annotation task once in my terminal and then let multiple annotators perform annotation (with different session IDs) on the same port, simultaneously.

This is where I think we're (perhaps I am) missing something. This is exactly what should occur with "feed_overlap": true and named multi-user sessions.

Can you try to reproduce this example (the "feed_overlap": true) using this sample dataset?

nyt_text_dedup.jsonl (18.5 KB)

PRODIGY_CONFIG_OVERRIDES='{"feed_overlap": true}' python3 -m prodigy ner.manual ner_ex blank:en nyt_text_dedup.jsonl --label ORG

Then open multiple browsers simultaneously with different session ids ("?session=rosamond", "?session=rosamond2", etc.). Each time it should start with back at I:0 as I show below:

NER Team

hi @kushalrsharma, When all sessions have the same data, we call that "overlapping" annotations. However, it seems that you want "non-overlapping" annotations, i.e., each example in the data once to whoever is available. As a result, your data will have each example labelled only once in total. This is exactly what setting "feed_overlap" to false will do (this is the value by default). But it seems like you're saying that you think your "feed_overlap" is still set to false, but it is not pr…

The nice thing with testing this dataset is that it keeps the record number in the meta tag, which will appear each record's "card" in Prodigy (look at bottom right). They're numbered from 0 to 175 and deduped (i.e., no input text are the same).

Let me know if this works.