How to produce a full dataset without conflicts and duplicates.

I am reviewing one dataset and its only save the reviews notes. Is there any way to combine two datasets without duplicate text? :upside_down_face:

Hi Alvaro,

could you elaborate on which commands you used and what you expected? Do you have a reproducible example that we can run on our own machine? Are you referring to the review recipe for NER?