Thanks for the detailed information! I followed your advice and saved the model predictions into a separate Prodigy dataset (I tried both using Python script and using ner.correct accepting all, and both led to the same output), and the ran
prodigy review reviewed_dataset manual_dataset,pred_dataset ...
and it's still not providing me exactly what I was looking for. First I ran the above command with
--view-id ner
and it was showing annotated sample from one input dataset at a time with same sample being shown consecutively: sample 1 from manual_dataset, sample 1 from pred_dataset, sample 2 from manual_dataset, sample 2 from pred_dataset, etc.
Then I tried with
--view-id ner_manual
and it was showing annotation from both input datasets for a given sample on the same page. This is what I want, but it's not highlighting the annotations with conflicts between the two datasets which is what I am mainly looking for. The page has 3 text boxes arranged vertically, where the top one looks like the normal ner recipe output and I am guessing it's the one picked by the review recipe, and the two text boxes below are a bit greyed out with smaller fonts, and they appear are for the annotations from individual input datasets for that sample.
I hope I described clearly and would like to check if this is what is expected from the review recipe or if I mis-used the recipe somehow. Thanks again!