# Prodigy Annotation Manager release date

**URL:** https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103
**Category:** Uncategorized
**Tags:** usage, meta
**Created:** [November 20, 2017, 11:28am UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103 "2017-11-20T11:28:54Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![SanchesS](https://avatars.discourse-cdn.com/v4/letter/s/3be4f8/32.png) [@SanchesS](https://support.prodi.gy/u/SanchesS)
#### Post date: [November 20, 2017, 11:28am UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103/1 "2017-11-20T11:28:54Z")

</div>

Hi!

I just read that you plan to release Prodigy Annotation Manager for managing tasks for multiply annotators – is there any projected due date for this feature?

Currently we looking for a tool for managing multiply machine learning tasks between tens of annotators and we have two options – try to adapt your tool or investigate into option of writing our own tool in next two months, so projected date will help us to choose best option

---

<div class="post-metadata">

### Author: ![honnibal](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/honnibal/32/35_2.png) [@honnibal](https://support.prodi.gy/u/honnibal)
#### Post date: [November 21, 2017, 3:01pm UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103/2 "2017-11-21T15:01:04Z")

</div>

We’d probably be looking at mid next year for the annotation manager, so you should probably build your own tooling if you need something sooner than that. I hope you’ll find Prodigy a good basis for your work. There are several ways you could work with multiple annotators, depending on your requirements.

In the basic case where you run Prodigy on your machine and do some annotations by yourself, you’ve got two queues, each with one producer and one consumer. One queue gives the questions, and the other receives the answers. If you have multiple annotators, then the forward queue is single producer, multiple consumer, and the backward queue is multiple producer, single consumer. So: how to structure that?

It’s often useful to let the server hold some state that’s specific to the annotation session. To do this, you can let each annotator talk to a single Prodigy service, and have those Prodigy services communicating with an upstream endpoint. This lets the Prodigy service stay single consumer, single producer, so you don’t have to make any changes within Prodigy itself. You just need to stream tasks from a local endpoint you provide. To get the annotations as they’re produced, the upstream service would be pulling changes from the annotation instances’ data stores.

The upstream service is the part you would have to implement yourself, based on your own requirements. It needs to send the work to the annotator instances. You may or may not need to fetch the annotations in real-time — it depends on whether you need the annotation queue to react to the decisions. If you don’t need that (e.g. if you can reconcile the annotations in a background process), the upstream service can be very simple.

Hope that helps!

---

<div class="post-metadata">

### Author: ![akshitasood63](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/akshitasood63/32/455_2.png) [@akshitasood63](https://support.prodi.gy/u/akshitasood63)
#### Post date: [March 14, 2018, 12:54pm UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103/3 "2018-03-14T12:54:44Z")

</div>

If you could provide some codeblock to show the flow ,it would be really helpful.Thank You!

---

<div class="post-metadata">

### Author: ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)
#### Post date: [March 14, 2018, 1:14pm UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103/4 "2018-03-14T13:14:13Z")

</div>

@akshitasood63 There are a few threads on the forum discussing custom workflows with multiple annotators – [see this search query](https://support.prodi.gy/search?q=%22multiple%20annotators%22) for more examples. You might also find this post helpful, which describes a custom use case of Prodigy at scale with multiple annotators:

> [@FullFact + Prodigy: Customising annotation tools for factchecking at scale](https://support.prodi.gy/t/fullfact-prodigy-customising-annotation-tools-for-factchecking-at-scale/317):
>
> Interesting blog post by [FullFact](https://fullfact.org/) on using Prodigy to collect data for automated factchecking – including some insights on how to customise Prodigy for multiple annotators and large-scale projects. (Props to @lev.konst and team!)

On a related note, we've started work on the annotation manager and it's coming together very nicely so far 😊 I'm hoping we can share some work in progress soon!

---

<div class="post-metadata">

### Author: ![akshitasood63](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/akshitasood63/32/455_2.png) [@akshitasood63](https://support.prodi.gy/u/akshitasood63)
#### Post date: [March 15, 2018, 5:33am UTC](https://support.prodi.gy/t/prodigy-annotation-manager-release-date/103/5 "2018-03-15T05:33:38Z")

</div>

Thanks a lot.I will be looking forward 😄
