Thanks for this helpful clarification!
So just to check my understanding, in this post you note that "by default, Prodigy will skip examples that are already in the dataset you're saving to: so if you've already reviewed the same example before, you won't be asked about it again." But the review recipe considers an example 123 (input hash xyz) with three conflicting annotations as distinct from example 123 (input hash xyz) with four conflicting annotations, and so the recipe will serve example 123 with four annotations, even though input hash xyz is already in the dataset?
I swear I'm not trying to belabor this-- I should probably just look at the code!