Cannot select a different option in multiple choice review recipe

,
1

I ran the review recipe with some multiple choice datasets. And I wasn’t able to select any other option. I also tested the recipe with ner_manual annotations, where I was able to manipulate the annotation - so I think not being able to do the same for multiple choice annotations is a bug.

I am using prodigy 1.8.3

2

Thanks for the report – I’ll have a look at this. Do you have an example of the multiple choice review examples it created? You can run Prodigy with PRODIGY_LOGGING=verbose and it should output the examples in the stream. (Feel free to remove/replace the actual text – I’m mostly interested in the IDs and format it generated.)

3

Sure. I tested with 1 file that contained 2 choice options per task.

Here is an example I got from the logs (with text replaced):

{
    'text': 'Sentence A. Sentence B',
    '_input_hash': -462874117,
    '_task_hash': 899318158,
    'spans': [{'start':9 , 'end': 10, 'text': 'A', 'score': 1}],
    'meta': {},
    'options': [
        {'id': 'label_c', 'text': 'C'},
        {'id': 'label_d', 'text': 'D'}
    ],
    'accept': ['label_c'],
    'answer': 'accept',
    '_session_id': 'my_dataset',
    '_view_id': 'review',
    'sessions': ['annotator1'],
    'versions': [
        {
            'text': 'Sentence A. Sentence B',
            '_input_hash': -462874117,
            '_task_hash': 899318158,
            'spans': [{'start':9 , 'end': 10, 'text': 'A', 'score': 1}],
            'meta': {},
            'options': [{'id': 'label_c', 'text': 'C'}, {'id': 'label_d', 'text': 'D'}],
            'accept': ['label_c'],
            'answer': 'accept',
            '_session_id': 'annotator1',
            '_view_id': 'choice',
            'sessions': ['annotator1'],
            'default': True
        }
    ],
    'view_id': 'choice'
}

Happy to help with more info if needed.