I just found this Training after annotating with custom tokenizer - #2 by magdaaniol and am trying to follow it.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| revising annotation by prodigy--here only one label (DATE) | 16 | 1947 | May 20, 2019 | |
| Alignment of NER tokens when creating suggestions using Transformers | 7 | 1094 | August 12, 2022 | |
| data-to-spacy is not using my custom tokenizer | 7 | 1114 | May 15, 2023 | |
| Mismatched Tokenization on NER | 2 | 1150 | June 25, 2021 | |
| Using Prodigy to annotate data and train a tokenizer, or to fix the default tokenizer. | 4 | 1356 | March 11, 2020 |