Create a jsonl pre-populated with annoatations from .txt file

[ines (Ines Montani)]

@eyalho I wrote a longer reply on your other thread:

Create a dataset out of many txt_files documents (Best Practice)

Hi! The main reason is that JSON is just more flexible and lets you attach meta information, represent nested data, different types of values (strings, integers, lists) and so on. .txt is just plain text – so once your data is more than just plain text, it becomes harder to represent it as plain text (without needing your own conversion logic). JSON on the other hand is super standard, and you can load it in pretty much any common programming language. For NLP specifically, .txt files that are…