Feature request: Send low concordance annotations to expert

Hi folks,
I know Annotation Manager is in the works so I wanted to submit a feature request. I’d like the ability to send annotations with concordance below a certain threshold to a group of expert annotators. Obviously I can hack this together myself with the current software but at least for my use cases this will be a very useful feature.

Thanks for the great work!

Thanks! So to clarify: would the agreement threshold be based on the annotator decision vs the model score, or on non-agreement between non-expert annotation workers?

I was thinking on non-agreement between non-expert annotation workers.