If anyone is interested, this is part of an upcoming paper using transformers for adverse drug reaction detection. We're using Prodigy for all our annotation. Here is the repo (GitHub - AustinMOS/adr-nlp) for training a NER model using a JSONL file of annotations exported from Prodigy.