You might also find this thread insightful. It discusses a similar phenomenon but for Arabic.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to get db-out to use unicode symbols | 2 | 1028 | March 12, 2019 | |
| ner.manual and terms.to_patterns save to utf-16 | 4 | 470 | June 26, 2021 | |
| db-out utf-8 character problem | 2 | 1154 | July 14, 2020 | |
| db-out format | 1 | 834 | March 3, 2022 | |
| Language with macrons (āēīōūĀĒĪŌŪ) in output | 3 | 679 | June 26, 2020 |