Hey everyone! We're happy to introduce a new Prodigy plugin we've been working on that's now available for beta testing.
Prodigy Dashboard adds a new command dashboard
that starts a web application for viewing annotations, data analytics, metrics and progress. It runs in your Prodigy environment and automatically connects to your database.
At the moment, the dashboard is view-only, but we're planning to add non-destructive editing for data as well. (This requires some deeper breaking changes to the database tables, though.) We also want to include more detailed inter-annotator agreement metrics, similar to the metric
recipes. See below for a list of planned features and known improvements.
Requirements for joining the beta:
- You're using the latest version of Prodigy with a company license.
- You have some existing datasets in your Prodigy database, ideally even from multiple annotators and of different data types.
- You have some time to try it out and give feedback.
If you're interested, email us at contact@explosion.ai and include your license key or order ID, and we'll give you access to the plugin package
Future plans and features already on our list:
- Non-destructive editing for individual examples.
- Richer previews of annotated examples in the overview, e.g. for images.
- Widgets for metrics, e.g. inter-annotator agreement and confusion matrix.
- Improve label visualisation widgets for data with lots of labels.
- Add
--host
and--port
configuration todashboard
command.