I'm trying to stream different examples to my annotators as follows.
In the first case they get examples to reannotate and only when none available, they get a stream of new unannotated data.
The first part works but then new examples don't stream - Prodigy is saying no tasks are available.
Please could you look at the code below and advise where I'm going wrong?
Source is a JSONL
def get_stream(source): curated_examples = get_curated_examples() for eg in curated_examples: if eg["answer"] == "reject" and eg["meta"].get("racid", 'Unk') == annotator_id: yield eg stream = prodigy.get_stream(source) return stream