Hi,
The visualization does not reflect the annotation progress correctly.
We have 5 examples in our dataset and it was annotated by 2 people.
First annotator annotated 5 examples while second one annotated 1 example.
As we can see in the picture, in the PROGRESS section, TOTAL equals 6 and progress percentage is 120%.
As I understand that is because the progress visualization belongs to all the annotators.
TOTAL equals 6 because of 5 + 1 and progress percentage is 120% because of (5 + 1)/5*100.
But I expect that this information will reflect progress of the current annotator only.
In case it is not a bug from your side, please explain how my intention can be achieved.
Thanks for the report! I think I might know what causes the 120% here: if the stream has a length, the default progress function currently divides the number of annotated examples in the current session by the length of the stream. However, the internal count of "examples in the current session" is incremented whenever new anwers are received and doesn't distinguish between generated session IDs. That's how you end up with 6 "session" annotations.
The custom progress function you can provide receives the number of session annotations and the number of annotations in the whole dataset – but it currently doesn't receive the session ID that's assigned at runtime (when you access the app with a ?session=). You could make it return None to make the progress less confusing.
We'd have to find a better general progress logic internally and I can't think of an easy workaround for now, since it's kinda complex. But I'll update if I can think of something you can implement yourself in the meanti,e!