Hi all! I would like to understand when and how exactly Prodigy excludes tasks it has already seen. Is it that the server fetches tasks from its stream and then filters them before sending them out? If so, does this cause batch sizes to shrink? I have observed batches fall short of the configured value and such deduplication would explain some of my observations. The reason I'm asking is I was struggling to get my progress display right.
Also, how can I disable this feature? I have tried setting auto_exclude_current to false, but in my tests, tasks seem to still be filtered based on their hashes.