Same task presented for every pattern match

[nix411 (Nicolai Bjerre Pedersen)]

Running textcat.teach with patterns I am getting the same task presented multiple times (one time for every pattern match). Afaik textcat.teach is labelling the document and not the tokens so is this a bug or?

[ines (Ines Montani)]

This is currently an expected limitation, because the matter will just yield out every match and doesn't do any filtering or make assumptions about what the matches "mean". We do want to add an option to change the default for text classification, it just requires some rewrites of how the pattern matcher works internally.

In the meantime, see this thread for details and how to add your own filter function:

textcat.teach presents same annotation task if text snippet contains multiple patterns

Hi! This is currently expected behaviour because the pattern matcher just yields out every result – but you’re right that it’s not very practical and we probably want to change this and make “one match per example” the default behaviour. If you’re annotating for text classification, you’re giving feedback on the text plus label. The patterns are mostly a means to an end, so if you do see an example with the correct label, you should accept it. That said, if you do get a lot of duplicate matche…