Additional metrics (recall, precision, accuracy F1) in textcat.train-curve

[ryanwesslen]

@sofiejb

Hi, since I cannot find the batch-train recipe in texcat.py now. I assume we use handle_scores_per_type to evaluate now? Where would you recommend making these changes now?

Yes, batch-train was replaced with train in v1.9 (Dec 2019).

Does this answer your question?

`train-curve textcat` - display AUC for each classification label

Hi! The new train recipe function returns a (best_scores, baseline) tuple – best_scores is an instance of spaCy's Scorer, which includes overall accuracy scores, as well as scores per label. The train-curve mostly just runs train with different portions of the data and then outputs the best score for each training run at the end. So you could write your own version of the recipe that prints the best_scores.textcats_per_cat instead of using the default results printer. (You can find the recipe i…