# evaluate text classification model using spacy evaluate?

**URL:** <https://support.prodi.gy/t/evaluate-text-classification-model-using-spacy-evaluate/2547>\
**Category:** Uncategorized\
**Tags:** textcat, spacy, solved\
**Created:** [February 13, 2020, 8:02pm UTC](https://support.prodi.gy/t/evaluate-text-classification-model-using-spacy-evaluate/2547 "2020-02-13T20:02:25Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![medina](https://avatars.discourse-cdn.com/v4/letter/m/e99b99/32.png) [@medina](https://support.prodi.gy/u/medina)\
**Post date:** [February 13, 2020, 8:02pm UTC](https://support.prodi.gy/t/evaluate-text-classification-model-using-spacy-evaluate/2547/1 "2020-02-13T20:02:26Z")

</div>

Hello,

I am trying to use spacy's `evaluate` with my model made from prodigy along with my evaluation dataset (also exported from prodigy). I already converted the evaluation dataset from .jsonl to .json using

> python -m spacy convert file.jsonl . --converter jsonl --lang en

and that seemed to work to get it in a format that spacy's `evaluate` recipe can iterate over but now im getting an error: Cannot evaluate textcat model on data with different labels  
Labels in model: {'LABEL\_NAME'}  
Labels in evaluation data: set()

when looking at the json file i got from using the convert function i dont see my label in the structure? Am i doing something wrong?

Thank you!

---

<div class="post-metadata">

**Author:** ![adriane](https://avatars.discourse-cdn.com/v4/letter/a/46a35a/32.png) [@adriane](https://support.prodi.gy/u/adriane)\
**Post date:** [February 14, 2020, 11:23am UTC](https://support.prodi.gy/t/evaluate-text-classification-model-using-spacy-evaluate/2547/2 "2020-02-14T11:23:49Z")

</div>

Hi, that spacy converter only converts NER annotation, not textcat annotation. Try the new `prodigy data-to-spacy` command instead, which has support for textcat. (And check that the `--textcat_exclusive` option is set correctly.)

---

<div class="post-metadata">

**Author:** ![medina](https://avatars.discourse-cdn.com/v4/letter/m/e99b99/32.png) [@medina](https://support.prodi.gy/u/medina)\
**Post date:** [February 14, 2020, 6:55pm UTC](https://support.prodi.gy/t/evaluate-text-classification-model-using-spacy-evaluate/2547/3 "2020-02-14T18:55:39Z")

</div>

Thanks Adriane! Worked like a charm 👏