Deleting certain annotation sessions

Yes, this definitely looks like your event_labels dataset has 12385 total examples. Maybe you accidentally added all of your annotations to the same dataset?

To get to the bottom of this, you could run the db-out command, export it to a file and inspect it – maybe this will give you a better idea of what’s going on here? For example:

prodigy db-out event_labels > event_labels.jsonl

This will give you a JSONL file with all the records. You can edit it manually, or use a script to filter it. When you’re done, you can use the db-in command to add the updated data to a new dataset.