built-in wrappers for scikit-learn, Pytorch and TensorFlow / Keras: those will be available via spaCy’s machine learning library Thinc. You can already test the experimental PyTorch integration in the latest release.
Prodigy Annotation Manager
Status: ️ active development Public beta: September 2018 (earlier for existing Prodigy users)
set up large annotation projects with multiple annotators, perform quality control and check concordance
add-on product and library that integrates with Prodigy, orchestrates recipes and tasks, and manages your cluster
admin console for settings, statistics and annotator management
full data privacy, support for internal and external networks
Database and Corpus Management
Status: ️ planning
separate open-source library for managing and reconciling annotation layers
integrates with seamlessly with Prodigy – but can also be used standalone!
out-of-the-box support for training spaCy models and adapters for other libraries
possible add-on: web UI for viewing data and annotations
In a recent release of Thinc, we quietly shipped the first version of a PyTorch wrapper so we can start testing it The wrappers will be open-source so they can evolve and be updated quickly. It also means that Prodigy won’t have to ship with a bunch of super specific code that may have to change often, and it allows you to reuse them across applications, without having to depend on Prodigy.
For the “Prodigy Annotation Manager” do you need help? Beta testing, developing some parts? I am asking because we are launching an annotation project for our medical data. I have tested prodigy by adding two entity, it all worked out. I can generate my models etc. Therefore I am ready to move to the next step
@ines Sorry to keep bugging you about the Annotation Manager (really excited!), but do you have a sense of how close you are to a private beta (a week, a month)? I’ve been putting off building an internal solution, but we have a use case that likely can’t wait until the end of September.
@steve Ah, sorry, I totally missed your comment! We actually just started our Prodigy Annotation Manager sprint to finish up the app, and we’d obviously love to get it out to people as soon as possible. We’ll hopefully have an update and an announcement to make about the results this week!
However, I still wouldn’t be comfortable making any promises at this point, especially if you have to meet your deadlines. So in the meantime, you might want to check out @andy’s open-source multi-user extension. The annotation manager will be fully compatible with Prodigy’s existing database formats, so you’ll always be able to make the switch later.