# ner.manual skips 10 lines in text file when browser is refreshed

**URL:** <https://support.prodi.gy/t/ner-manual-skips-10-lines-in-text-file-when-browser-is-refreshed/847>\
**Category:** Uncategorized\
**Tags:** usage, front-end, solved\
**Created:** [September 26, 2018, 10:54pm UTC](https://support.prodi.gy/t/ner-manual-skips-10-lines-in-text-file-when-browser-is-refreshed/847 "2018-09-26T22:54:25Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\
**Post date:** [September 27, 2018, 8:47am UTC](https://support.prodi.gy/t/ner-manual-skips-10-lines-in-text-file-when-browser-is-refreshed/847/2 "2018-09-27T08:47:00Z")

</div>

Yes, this is currently expected, because on each load, the app makes a request to the server and asks for the next batch (by default, the batch size is 10). The annotated tasks are sent back to the server periodically, so when a new batch is requested, Prodigy can't yet know whether a question that was previously sent out was already annotated or not. (Annotating all sentences / examples is also a pretty specific goal that only applies to some use cases and data streams.)

If it's important to you that all sentences are annotated, and you do want to handle cases where the annotator refreshes their browser, you ideally want to reconcile the questions/answers at the end of a session, and compare the `_task_hash` to find examples in your data that you don't have an answer for in the dataset. You can either do this in a custom recipe within the stream generator, or as a separate session that you run after the previous one finished.

> [@sked](#):
>
> Another problem is when I have some annotated samples stored in the database, and I have to restart the service, it steps through all the samples in the jsonl file even if they were previously annotated.

Prodigy is very agnostic to what existing annotations in a dataset "mean". But you can tell it to explicitly ignore identical questions that are already present in one or more datasets by using the `--exclude` option – for example, `--exclude dataset_one,dataset_two`.

---

_[View the full topic](https://support.prodi.gy/t/ner-manual-skips-10-lines-in-text-file-when-browser-is-refreshed/847)._