Segmentation and newlines in ner.manual

@blakey @KMLDS @menshikh-iv @bhanu

Just released v1.5.0, which includes the fixes I described above:

  • Newlines in manual mode are now rendered as ↵ plus line break.
  • To disable this behaviour (e.g. if your text contains lots of newlines like in this example), you can set "hide_true_newline_tokens": true.
  • You can now mark individual tokens as "disabled": true, which will render them in grey and will prevent the user from selecting them. This may be a nice solution for use cases similar to the one described by @KMLDS, where the text should be enhanced with formatting markup (lists, line breaks etc.) to help the annotator
3 Likes