Hi - I’m trying to use textcat.eval on a Windows machine. I can’t seem to get it working with a jsonl file containing the examples I want to evaluate on. I’ve tried:
python -m prodigy textcat.eval products_textcat_eval models\product_cat data\processed\train_paragraphs.jsonl --label
which gets me:
OSError: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions
I read the documentation and it seems like it would work with stdin, but if I try this way:
python -m prodigy pipe data\processed\train_paragraphs.jsonl | python -m prodigy textcat.eval products_textcat_eval models\product_cat --label
I first get an error indicating that ‘Source’ is a required argument, and when I supply something for source I get the socket error again. Is there something I’m missing here?