# Segmentation Fault **URL:** \ **Category:** Uncategorized\ **Tags:** ner, done, spacy\ **Created:** [January 24, 2018, 1:23pm UTC](https://support.prodi.gy/t/segmentation-fault/247 "2018-01-24T13:23:38Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![mmars9](https://avatars.discourse-cdn.com/v4/letter/m/f9ae1b/32.png) [@mmars9](https://support.prodi.gy/u/mmars9)\ **Post date:** [January 24, 2018, 1:23pm UTC](https://support.prodi.gy/t/segmentation-fault/247/1 "2018-01-24T13:23:38Z")
Hi there, I just want to be sure I’m understanding this error correctly. I’m working on further training the ‘ORG’ label from a spacy model. The model had been trained once in spacy, renamed “ner\_train\_v3”, and I used ner\_train\_v3 in prodigy’s ner.teach recipe. That all goes okay, but when I try using prodigy’s ner.batch-train recipe, I invariably get an error like the below: line 1: 1914 Segmentation fault: 11 python -m prodigy “$@” (spacy\_pycharm\_ner) bash-3.2$ Navigating to that line in the relevant dataset, I can see the sentence is has some issues, because the stream data I’m throwing in the dataset hasn’t been meticulously cleaned: {“text”:“Romania posted the European Union\*\*\u201a\u00c4\u00f4s\*\* highest economic growth rate in the third quarter at 8.8 percent year-on-year, but it also had the largest rate of household deprivation, Eurostat data showed, with one in two Romanians struggling to keep their home warm or pay their bills on time. **"** ”,“spans”:[{“start”:176,“end”:184,“text”:“Eurostat”,“rank”:0,“label”:“ORG”,“score”:0.6449537913,“source”:“core\_web\_lg”,“input\_hash”:762417285}],“meta”:{“score”:0.6449537913},"\_input\_hash":762417285,"\_task\_hash":-1449057813,“answer”:“accept”} Does the inclusion of quotes ( \u201a, etc) throw it off, or is it the strange break at the end of the sentence? ---
**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\ **Post date:** [January 24, 2018, 1:42pm UTC](https://support.prodi.gy/t/segmentation-fault/247/2 "2018-01-24T13:42:48Z")
Thanks for the report and finding the example it likely fails on! Errors like this are often difficult to debug, so having a concrete example is very valuable. “Weird” formatting and unicode characters should never cause a segfault – this is definitely a bug, either in Prodigy’s NER model or somewhere in spaCy. (In the meantime, you could always try removing that example from your set and see if you can run `ner.batch-train` without any problems?) ---
**Author:** ![mmars9](https://avatars.discourse-cdn.com/v4/letter/m/f9ae1b/32.png) [@mmars9](https://support.prodi.gy/u/mmars9)\ **Post date:** [January 24, 2018, 2:03pm UTC](https://support.prodi.gy/t/segmentation-fault/247/3 "2018-01-24T14:03:16Z")
> [@mmars9](#): > > mania posted the European Union\*\*\u201a\u00c4\u00f4s\*\* highest economic growth rate in the third quarter at 8.8 percent year-on-year, but it also had the largest rate of household deprivation, Eurostat data showed, with one in two Romanians struggling to keep their home warm or pay their bills on time."”,“spans”:[{“start”:176,“end”:184,“text”:“Eurostat”,“rank”:0,“label”:“ORG”,“score”:0.644953 Good to know, and I'll be doing that -- thanks! ---
**Author:** ![nikeqiang](https://avatars.discourse-cdn.com/v4/letter/n/c5a1d2/32.png) [@nikeqiang](https://support.prodi.gy/u/nikeqiang)\ **Post date:** [February 5, 2018, 5:21am UTC](https://support.prodi.gy/t/segmentation-fault/247/4 "2018-02-05T05:21:38Z")
Hi @mmars9, @ines , I’m experiencing a similar problem training the NER on anything but a very small set of examples. Training on anything over 1000 examples throws the following error. Is this a memory error? Has either of you come up with a temporary solution? Example Error messages when running prodigy: line 1: 41665 Segmentation fault: 11 python -m prodigy “$@” Info about spaCy Python version: 3.6.3 spaCy version: 2.0.5 Models: en, en\_core\_sm Platform: MacOS I note that I got the same error when trying to train using each of (a) the Prodigy ner.batch-train recipe and (b) the regular spacy train\_ner.py script. FYI I’ve left a note on the spacy boards too ([https://github.com/explosion/spaCy/issues/1757](https://github.com/explosion/spaCy/issues/1757)) since I assume its the same issue. Thanks! ---
**Author:** ![baeumer](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/baeumer/32/260_2.png) [@baeumer](https://support.prodi.gy/u/baeumer)\ **Post date:** [April 16, 2018, 7:40pm UTC](https://support.prodi.gy/t/segmentation-fault/247/5 "2018-04-16T19:40:14Z")
Unfortunately, I now also have to fight with this error. If I only have a few annotations (ner.teach), then I can work with ner.batch-train. But if I have processed about 1000 texts, then the error appears. But I don’t see any problem with the memory and CPU usage. **Segmentation fault: 11** python3.6 -m prodigy ner.batch-train db /Users/frederik/mdl/modell -l label1,label2 -e db -o modell2 ---
**Author:** ![sooheon](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/sooheon/32/351_2.png) [@sooheon](https://support.prodi.gy/u/sooheon)\ **Post date:** [June 30, 2018, 7:43pm UTC](https://support.prodi.gy/t/segmentation-fault/247/6 "2018-06-30T19:43:10Z")
I’m seeing this every time that I run ner.train-curve or ner.batch-train now, and like @baeumer I have just over 1000 annotations. I also do not see too much memory or CPU usage. ---
**Author:** ![aniruddha](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/aniruddha/32/411_2.png) [@aniruddha](https://support.prodi.gy/u/aniruddha)\ **Post date:** [August 25, 2018, 5:15am UTC](https://support.prodi.gy/t/segmentation-fault/247/7 "2018-08-25T05:15:29Z")
After I just got over a thousand annotations in the NER, `ner.batch-train` isn’t succeeding at all. Every single time I am stopped with a segfault. ---
**Author:** ![aniruddha](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/aniruddha/32/411_2.png) [@aniruddha](https://support.prodi.gy/u/aniruddha)\ **Post date:** [August 25, 2018, 12:28pm UTC](https://support.prodi.gy/t/segmentation-fault/247/8 "2018-08-25T12:28:44Z")
I think I found my problem. I know about the character limitation on spaCy. In the database I found a few very long strings of text. I dropped them and training seems to work marvelous! (Except the fact that 1107 sentences took 14 GB of RAM and 5 GB of swap on Ubuntu 18.04) ---
**Author:** ![honnibal](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/honnibal/32/35_2.png) [@honnibal](https://support.prodi.gy/u/honnibal)\ **Post date:** [August 30, 2018, 9:22am UTC](https://support.prodi.gy/t/segmentation-fault/247/9 "2018-08-30T09:22:27Z")
@aniruddha Thanks for the update! Could you try decreasing your batch size, to see if it solves your memory usage issues? ---
**Author:** ![trevorwelch](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/trevorwelch/32/775_2.png) [@trevorwelch](https://support.prodi.gy/u/trevorwelch)\ **Post date:** [April 25, 2019, 9:22pm UTC](https://support.prodi.gy/t/segmentation-fault/247/10 "2019-04-25T21:22:29Z")
Same error, `prodigy: line 1: 9693 Segmentation fault: 11 python -m prodigy "$@"` This was during an annotation task, which was launched via `prodigy ner.teach menu_brand_tagging en_core_web_sm menu_data_1018.jsonl --label BRAND --patterns brand_patterns.jsonl` Unfortunately it was accompanied by this in the annotation front-end as well! ![30%20PM](https://us1.discourse-cdn.com/flex020/uploads/prodigy/original/1X/1116a978197174317b33d852f9e8650ed8809b25.png) I don’t think I lost too many, but a good reminder to hit save often. ---
**Author:** ![ines](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/ines/32/3_2.png) [@ines](https://support.prodi.gy/u/ines)\ **Post date:** [April 26, 2019, 9:34am UTC](https://support.prodi.gy/t/segmentation-fault/247/11 "2019-04-26T09:34:51Z")
What type of texts are in your `menu_data_1018.jsonl`? Are they long or short? Any particularly long texts, or texts with lots of whitespace? The errors in the app are a direct response to the server dying, btw. As soon as the Prodigy app fails to connect to the server, it will show you the error, so you know that something is up. (Otherwise, you’d have to keep checking the terminal, which is pretty inconvenient.) Prodigy auto-saves the annotations in batches and also uses them to update the model in the loop (if you’re using an active learning recipe like `ner.teach`). If you’re using the default batch size of 10, the maximum amount of annotations you could theoretically ever lose at a time is 19 (10 items in the history and 9 waiting to be sent out as soon as they become 10). If Prodigy is unable to save, the examples are still all in your browser btw – so you can always restart the server in the terminal and then hit save in the web app, and the “stranded” examples should be saved.