Duplicated annotation when changing version

hi @JulieSarah!

Yes! You are correct. I had some time to run your custom recipe and was able to see the same issue with v1.11.8 when using JSONL. It was all about the get_stream.

I spoke with one of our core developers who confirmed around v1.11 (over a year ago), Prodigy switched to get_stream to give more flexibility beyond the JSONL loader. Using get_stream will also work with the new v1.12 that we will be releasing soon.

The move in a few months to v2 will also include a small change to get_stream to make it more typesafe as v2 with pydantic. It is only adding one new argument so it won't change a lot, but could have something significant so definitely be on the lookout when we release v2.

Given these changes and to prevent breaking changes like this for upcoming releases, we're starting to make preparations for both v1.12 and v2 communications which should include social media threads, updated docs, and a dedicated FAQ post on support. So keep a look out for details.

Hope this answers your question. Let us know if you have other questions!