prodigy-hf installation

[aureliusnoble]

Hi, I'm trying to install prodigy-hf, but am running in to some issues. I am using the latest stable version of prodigy (1.12.7).

I have tried installing prodigy 3 times in a new conda environment, for Python 3.8, 3.10, 3.12. Each time it works fine. However, when I try and install prodigy-hf the installation breaks.

It seems there is a compatibility issue with the typing-extensions library. Running the install I get, prodigy 1.12.7 requires typing-extensions<4.6.0, if I uninstall and reinstall an earlier version I get torch 2.2.0 requires typing-extensions>=4.8.0

After attempting installation all commands (except help) are broken. They return ImportError: cannot import name 'Arg' from 'prodigy.core'

If you can offer any advice that would be much appreciated.

[ryanwesslen]

hi @aureliusnoble,

Thanks for your question.

@aureliusnoble

I am using the latest stable version of prodigy (1.12.7).

Prodigy plugins work with the latest version of Prodigy. 1.12.7 isn't the most recent stable version; we've had multiple updates, namely v1.14 where we switched our CLI to radicli.

This previous post mentions more about it.

prodigy-hf throws error

hi @riccardopinosio, Thanks for your question. I'm fairly certain yes, it's because you're using an older version of Prodigy (v1.12.7). The problem is in v1.14.0 we switched our CLI to radicli from plac and the Arg it's looking for is from radicli. You could try to install radicli since it's open source (pip install radicli). But this still wouldn't read from prodigy.core -- you'd need to refactor this to import directly from radicli. I would also expect since we've made a ton of new updates…

Hope this helps!