why does the labeler only select some of the examples

[yishairasowsky (yishai)]

i told prodigy to train using a jsonl file, as shown here

but then when i train, it only tells me to click on about a third of the example texts. why don't we use all of them?

[ines (Ines Montani)]

There are different reasons this could be happening, see here for a start:

Get 'no task' before all annotation finished

Hi! There are several possible explanations why this would be happening: Does your data contain any duplicates? Prodigy will filter out duplicate texts from the stream automatically, so you’ll only ever see a task once. When you restart the server with the same dataset, do you see new examples, or does it show “no task available” immediately? If so, this definitely indicates that all examples in the input text have been annotated once. Otherwise, did you or the annotator reload the app at any …