PRF Calculation at Entity Level for BILUO Scheme

[sigitpurnomo]

Hello,

How does the prodigy calculate the PRF(Precision, Recall, and F-score) score at the entity level? As I know, the dataset is labeled at the token level using the BILUO scheme.

Thank you

[ryanwesslen]

Hi @sigitpurnomo!

Sorry for the delay! Does this post answer your question?

Specific formula for F score, precision and recall NER

I know that prodigy uses span level evaluation in a way that if span start or end or label is wrong it is considered as wrong, is it possible to give me more details about the evaluation formulas ? I'm trying to compare prodigy ner results with Bert ner ? specific formulas for recall, precision and f score would be great.

[sigitpurnomo]

Hi @ryanwesslen

It's OK. Thank you for your response.