Hi @Vinoth ,
Prodigy OpenAI recipes were our early response to the availability of LLM-services and OpenAI API was probably the main service available back then so the recipes are pretty much dependent on the OpenAI API endpoints.
We are currently working on integrating more flexible recipes powered by spacy-llm library but you can already achieve the same results with a bit of custom scripting and using spacy-llm
directly.
Please see this post for an example of how to set up a NER annotation task with a custom LLM vendor via spacy-llm
.
If you'd rather wait for built-in support of spacy-llm
based ner
, textcat
and spancat
recipes, they will be available out of the box in Prodigy 1.13 due early next week at the latest.