📊 Prodigy Dashboard: beta testers wanted for new plugin

Hey everyone! :wave: We're happy to introduce a new Prodigy plugin we've been working on that's now available for beta testing.

Prodigy Dashboard adds a new command dashboard that starts a web application for viewing annotations, data analytics, metrics and progress. It runs in your Prodigy environment and automatically connects to your database.

At the moment, the dashboard is view-only, but we're planning to add non-destructive editing for data as well. (This requires some deeper breaking changes to the database tables, though.) We also want to include more detailed inter-annotator agreement metrics, similar to the metric recipes. See below for a list of planned features and known improvements.

Requirements for joining the beta:

  • You're using the latest version of Prodigy with a company license.
  • You have some existing datasets in your Prodigy database, ideally even from multiple annotators and of different data types.
  • You have some time to try it out and give feedback.

If you're interested, email us at contact@explosion.ai and include your license key or order ID, and we'll give you access to the plugin package :blush:

Future plans and features already on our list:

  • Non-destructive editing for individual examples.
  • Richer previews of annotated examples in the overview, e.g. for images.
  • Widgets for metrics, e.g. inter-annotator agreement and confusion matrix.
  • Improve label visualisation widgets for data with lots of labels.
  • Add --host and --port configuration to dashboard command.
4 Likes