The first posts on here discussing the topic were all written before the ner_manual
and dep
interfaces existed. You'd probably want to use a custom recipe without a model in the loop and start off by highlighting the phrases using the ner_manual
interface – for example, MAJOR_CLAIM
, PREMISE
etc.
When you're done with that, you could export the data and run one experiment where you link up highlighted spans close to each other and collect binary feedback on whether they are connected. You could either create data in the dep
format (with a head and child), or use the choice
interface with the options “For”, “Against”, “Support” and “Attack”.
Alternatively, you could also use more labels in the ner_manual
interface and do two things at once: annotate the claims and the “For”, “Against”, “Support” and “Attack” phrases. To help with visual indicators, you could even create a custom label color scheme (red for negative, green for positive, or something like that).