I just found this Training after annotating with custom tokenizer - #2 by magdaaniol and am trying to follow it.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| revising annotation by prodigy--here only one label (DATE) | 16 | 1959 | May 20, 2019 | |
| Alignment of NER tokens when creating suggestions using Transformers | 7 | 1101 | August 12, 2022 | |
| data-to-spacy is not using my custom tokenizer | 7 | 1123 | May 15, 2023 | |
| Mismatched Tokenization on NER | 2 | 1158 | June 25, 2021 | |
| Using Prodigy to annotate data and train a tokenizer, or to fix the default tokenizer. | 4 | 1360 | March 11, 2020 |