Using Prodigy to Rank Classifications

[dmnapolitano (Diane M. Napolitano)]

Hello!

I have texts which have been pre-classified with any number of labels, each of which has some yet-to-be-determined relevancy to the text. It's a ranking task, although ties are allowed. But because it's a ranking task, the labels aren't independent, meaning I can't display them one-at-a-time and have the ranks be the annotation categories.

How can I use Prodigy to do this kind of annotation?

Thanks!

[ryanwesslen]

hi @dmnapolitano!

Thanks for your great question and welcome to the Prodigy community

Ranking & Ordering texts with Prodigy

Hi and sorry for only getting to this now, I somehow missed the thread! I can't immediately think of a way to implement the ranking with one of the built-in interfaces, although you could definitely add a feature like this using custom HTML and a bit of JavaScript: https://prodi.gy/docs/custom-interfaces#js-css One option would be to show all your texts with a simple <input type="number"> to specify the rank (with a min/max value based on the number of options). Each input can have an event li…

Ines mentioned two suggestions for creating a custom interface for ranking with HTML and a little JavaScript.

Does this sound like it would fit your use case?

[dmnapolitano (Diane M. Napolitano)]

Hi @ryanwesslen , thanks for the quick response!

Something like that could work! There are some interesting ideas in that post...hmmm...

Thanks again!