I'm using the ner.correct recipe for annotating emails (most of my labels are custom).
It all worked fine for a few months until recently it started getting "stuck" on certain emails right after clicking accept / reject (snippet attached).
I have several questions to better understand the situtation.
Just to confirm, by stuck, you mean that when you accepted, it freezes, correct?
Does it only do it on this record or for many other records? What happens if you try to choose a different action (e.g., ignore or reject)?
Have you tried to use logging to better diagnose? You can try PRODIGY_LOGGING=basic or PRODIGY_LOGGING=verbose to see what’s happening with the records where it is getting stuck.
Logging would probably be the best place to start.
A few other questions:
Are you running any third-party libraries?
Are you adding any additional arguments to your ner.correct recipe? For example, --update or a unique --loader?
Sorry I can't help more just yet - but hopefully with a little more background we can figure out what's going on.
Just to confirm, by stuck, you mean that when you accepted, it freezes, correct?
correct
Does it only do it on this record or for many other records? What happens if you try to choose a different action (e.g., ignore or reject)?
It happens to many other records as well and for all actions.
We added logging verbose. I'll recheck the logs with this example and report on the exact exception we received.
No
We're only adding --unsegmented in order to keep the text as a whole in the same tagging window instead of splitting it into separate sentences using the sentencizer.