It should be possible to run Prodigy in a mode in which it keeps track of how long it takes to make each individual annotation, the time between when the task is displayed and when the user makes a decision. This will generally be on the order of a second.
This occurred to me because I’m thinking about experiments to measure the effectiveness of active learning, and a good metric is the time the user spends annotating. Obviously, you could also measure wall-clock time for an annotation session, the finer detail could be helpful.
This is easy enough to write for myself, but might be a nice feature in general. For instance, having instrumented annotation time may allow you to better demonstrate the usefulness of Prodigy and sell more copies.