I'm working with german language.
I'm using ner.manual to label text and then I do db.out and terms.to_patterns, and both files convert german umlauts to utf16 symbols. I've tried to change "save file to utf8" as csv and jsonl - doesn't work. Tried Locale (on mac) - doesn't work.
I work on windows. And both files are saved with encoding utf16. Why?
Is there any way or key word in commands to save those files as utf8?