# Can I do annotation for BERT on prodigy

**URL:** <https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300>\
**Category:** Uncategorized\
**Tags:** transformers\
**Created:** [January 30, 2023, 8:46am UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300 "2023-01-30T08:46:04Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mohammad](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mohammad](https://support.prodi.gy/u/Mohammad)\
**Post date:** [January 30, 2023, 8:46am UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/1 "2023-01-30T08:46:04Z")

</div>

Can I do annotation and convert to BERT on prodigy

---

<div class="post-metadata">

**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\
**Post date:** [January 30, 2023, 12:16pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/2 "2023-01-30T12:16:37Z")

</div>

hi @Mohammad,

> [@Mohammad](#):
>
> Can I do annotation and convert to BERT on prodigy

Yes. Please see our documentation on using [Prodigy for BERT](https://prodi.gy/docs/named-entity-recognition#transformers-tokenizers).

There are also many posts with the [transformers tag](https://support.prodi.gy/tag/transformers) that may help as well.

---

<div class="post-metadata">

**Author:** ![Mohammad](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mohammad](https://support.prodi.gy/u/Mohammad)\
**Post date:** [January 30, 2023, 2:03pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/3 "2023-01-30T14:03:20Z")

</div>

I got this error below when I tried this commend 🙂

Can't find recipe or command 'bert.ner.manual'

python3 -m prodigy bert.ner.manual correctd\_drsv1 ./model\_drsv1 ./CV\_json\_English\_Format.jsonl --label Skill  
,University,Designation,Degree,Experience --patterns patternsv1.jsonl ./bert-base-uncased-vocab.txt --lowercase --hide-wp-prefix -F transformers\_tokenizers.py

---

<div class="post-metadata">

**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\
**Post date:** [January 30, 2023, 2:06pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/4 "2023-01-30T14:06:45Z")

</div>

That means you're having a lookup error.

Is the `transformers_tokenizers.py` script in the same folder where you ran that command?

> [@Can't find recipe or command 'bert.ner.manual'](https://support.prodi.gy/t/cant-find-recipe-or-command-bert-ner-manual/5965/7):
>
> Thanks. It worked now. The issue was that transformers\_tokenizers.py was not in the current directory.

---

<div class="post-metadata">

**Author:** ![Mohammad](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mohammad](https://support.prodi.gy/u/Mohammad)\
**Post date:** [January 30, 2023, 2:18pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/5 "2023-01-30T14:18:36Z")

</div>

yes also the commend below give me the same error

python3 -m prodigy bert.ner.manual --help

---

<div class="post-metadata">

**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\
**Post date:** [January 30, 2023, 2:22pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/6 "2023-01-30T14:22:07Z")

</div>

> [@Mohammad](#):
>
> python3 -m prodigy bert.ner.manual --help

Yes, you would because you haven't correctly referenced your script.

How can Prodigy get help information about `bert.ner.manual` when it hasn't been pointed to where the script is?

Again, your problem is you're not pointing to the correct path for your script. Try putting the absolute path directory to where you have saved your `transformers_tokenizers.py`, e.g., `-F ~/Downloads/my_folder/transformers_tokenizers.py`

---

<div class="post-metadata">

**Author:** ![Mohammad](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mohammad](https://support.prodi.gy/u/Mohammad)\
**Post date:** [January 30, 2023, 2:52pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/7 "2023-01-30T14:52:21Z")

</div>

now I get this error  
usage: prodigy bert.ner.manual [-h] [-lo None] [-l None] [-tv None] [-LC] [-HS] [-HW] dataset source  
prodigy bert.ner.manual: error: unrecognized arguments: ./bert-base-uncased-vocab.txt

python3 -m prodigy bert.ner.manual BERT\_drsv1 ./CV\_json\_English\_Format.jsonl --label Skill,MaritalStatus,University,Designation,Degree,Experience ./bert-base-uncased-vocab.txt --lowercase --hide-wp-prefix -F transformers\_tokenizers.py

---

<div class="post-metadata">

**Author:** ![ryanwesslen](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ryanwesslen/32/2969_2.png) [@ryanwesslen](https://support.prodi.gy/u/ryanwesslen)\
**Post date:** [January 30, 2023, 3:39pm UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/8 "2023-01-30T15:39:10Z")

</div>

hi @Mohammad!

> [@Mohammad](#):
>
> now I get this error  
> usage: prodigy bert.ner.manual [-h] [-lo None] [-l None] [-tv None] [-LC] [-HS] [-HW] dataset source  
> prodigy bert.ner.manual: error: unrecognized arguments: ./bert-base-uncased-vocab.txt

Yes, that looks because you don't have the [`bert-base-uncased-vocab.txt`](https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-vocab.txt). Save it from the link I provided and make sure your path reference is correct.

---

<div class="post-metadata">

**Author:** ![Mohammad](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mohammad](https://support.prodi.gy/u/Mohammad)\
**Post date:** [January 31, 2023, 7:47am UTC](https://support.prodi.gy/t/can-i-do-annotation-for-bert-on-prodigy/6300/9 "2023-01-31T07:47:20Z")

</div>

Thanks it working now
