"Refreshing" the stream of examples

[andy (Andy Halterman)]

I wrote up some short notes on how I did it here: How to keep count of annotations done by a person ?. Take a look at that and at the code on my Github repo. Hope that helps!