Recipe review code

[JulieSarah]

Dear all,

Do you know where we can find the code or recipe "review"?
We would like to modify it to allow the correction of flagged annotations.

If you have workaround or code to do it, I would be very keen on it.

thank you
Best regards
Julie

[ryanwesslen]

hi @JulieSarah!

@JulieSarah

Do you know where we can find the code or recipe "review"?
We would like to modify it to allow the correction of flagged annotations.

Yes! First, locate your Prodigy library installation path. You can find this by running python -m prodigy stats and find the Location: path.

Open the Location: path folder and then look for the /recipes/review.py script.

I've also found a few related posts where other users have modified the review recipe.

Review recipe with blocks interface

Thanks for the report! It looks like you hit an interesting edge case here: the review recipe will check the tasks for their "_view_id" and then use that to decide how to render the examples in the review interface. The --view-id is only used as the default and fallback. In your case, the interface is "_view_id": "blocks". So Prodigy will try to render the content with the blocks UI, but since the review recipe doesn't define any blocks, you see "No blocks available.". The easiest workaround wo…

Review interface -- how to set choice_style to multiple?

Hi, I'm reviewing an image classification dataset using the review interface. During initial labeling, I used the recipe below to allow multiple classes to be chosen for each image. But during review, they show up as radio buttons instead of checkboxes, and they become mutually exclusive. Is there a way to allow multiple options during review? These are the commands I'm using to start review: python -m prodigy review new_dataset orig_dataset or python -m prodigy review new_dataset orig_datas…

There's also the "review" tag that you can search for other posts related to the review recipe.

Hope this helps!