ner.teach - couple of questions

, , ,
8

I'm using Prodigy v1.11 and have several concerns that are similar to above.

  1. ner.teach appears only to show me examples with a score = 1.0. It doesn't sound like this is expected behavior. The underlying model has an F-score of 0.80, so there should be plenty of lower score examples.

  2. For records with multiple entities of the same label, ner.teach appears to show the record with only one entity highlighted at a time. That is, it shows me me a record with 1 of 2 entities highlighted. I reject. It then shows me the same record with the other entity highlighted. I'm also rejecting this. Both times, the score was 1.0. This seems strange.