Using Stanford CoreNLP during active learning

Yes, you should be able to implement this with a similar approach to the one I outline here:

One thing that's important to keep in mind for active learning-powered NER is that your model needs to handle updates with sparse labels. For example, if you receive an accepted entity annotation back, your model shouldn't accidentally assume that all other tags are O (outside an entity) and instead treat them as missing values.