Restarting a custom recipe without overwriting annotations stored in the database

Ah. It sounds like you want a recipe to "correct" your annotations.

Do you have a model?

Prodigy's typical workflow (manual -> correct recipes) is based on the idea that the correct recipe has a model in the loop that you're correcting the model's predictions.

If not, that's okay. But without a model, the custom recipe may be more like review than the correct. But same idea applies.

I would suggest creating a new second custom recipe. From an organization workflow, you'll make things easier down the road with a second recipe than trying to add this new task of correcting into the same recipe.

For the new recipe, check out this thread:

If after the second (correct) round you wanted a third/final round to compare, you may find the diff UI to be helpful. There you could combined the first (manual/current recipe) and the second (corrected) at the same time.

Example from docs:

Hope this helps!