precision, recall and F-Score

ryanwesslen · August 26, 2022, 1:22pm

Thanks for your question and welcome to the Prodigy community

The scoring is on the evaluation.

The default scoring all happens within spaCy and doesn't depend on Prodigy. You can view the code (for spaCy 3.0) here:

explosion/spaCy/blob/master/spacy/scorer.py

from collections import defaultdict
from typing import (
    TYPE_CHECKING,
    Any,
    Callable,
    Dict,
    Iterable,
    List,
    Optional,
    Set,
    Tuple,
)

import numpy as np

from .errors import Errors
from .morphology import Morphology
from .tokens import Doc, Span, Token
from .training import Example
from .util import SimpleFrozenList, get_lang_class

This file has been truncated. show original

We also have several posts that explain the scoring (e.g., what does it mean) more in detail like:

Topic		Replies	Views
Evaluation data for ner model ner	2	366	October 11, 2023
Specific formula for F score, precision and recall NER usage , spacy , training	1	968	July 10, 2021
Ner evaluation probability threshold usage , ner , spacy	2	423	September 15, 2020
Evaluation metric: Scorer function returns same values for F,P,R ner , spacy , solved	1	584	May 21, 2019
How to use Scorer function toevaluate a custom model. usage , ner , spacy	1	1278	February 1, 2023

precision, recall and F-Score

Related topics