hi @JulieSarah!
Yes! You are correct. I had some time to run your custom recipe and was able to see the same issue with v1.11.8
when using JSONL
. It was all about the get_stream
.
I spoke with one of our core developers who confirmed around v1.11 (over a year ago), Prodigy switched to get_stream
to give more flexibility beyond the JSONL
loader. Using get_stream
will also work with the new v1.12
that we will be releasing soon.
The move in a few months to v2
will also include a small change to get_stream
to make it more typesafe as v2
with pydantic. It is only adding one new argument so it won't change a lot, but could have something significant so definitely be on the lookout when we release v2
.
Given these changes and to prevent breaking changes like this for upcoming releases, we're starting to make preparations for both v1.12
and v2
communications which should include social media threads, updated docs, and a dedicated FAQ post on support. So keep a look out for details.
Hope this answers your question. Let us know if you have other questions!