Hi prodigy team/community,
I have a question about working with longer text in the annotation tool. In the documentation it says that: For "NER annotation, there’s often no benefit in annotating long documents at once, especially if you’re planning on training a model on the data. " However, the text snippets that I am trying to annotate are quite long and arbitrary making them shorter would not make much sense in my case. So the question is: How are these annotations (annotated long texts) are being fed into the CNN while training (prodify train ner)? I guess the maximum token number is somehow limited.