# Prodigy with Jupyter Notebook **URL:** \ **Category:** Uncategorized\ **Tags:** jupyter\ **Created:** [June 14, 2022, 6:00pm UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703 "2022-06-14T18:00:07Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Vadym\_Kostyuk](https://avatars.discourse-cdn.com/v4/letter/v/fbc32d/32.png) [@Vadym\_Kostyuk](https://support.prodi.gy/u/Vadym_Kostyuk)\ **Post date:** [June 14, 2022, 6:00pm UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/1 "2022-06-14T18:00:08Z")
Hi, I'm new with Prodigy, so I want to ask you maybe trivial questions, but I can't work without them 😔 I use Jupyter Notebook to work in prodigy, but when running simple commands such as "textcat.teach, ner.manual", processing can take 20-40 minutes. Although previously working with machine learning models with millions of lines processing took a maximum of 4-5 minutes. Maybe you have tips on how to speed it up or change something in the settings. Or tips on which environment to use to work effectively with Prodigy in Windows. Thank you! ---
**Author:** ![koaning](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/koaning/32/230_2.png) [@koaning](https://support.prodi.gy/u/koaning)\ **Post date:** [June 14, 2022, 6:38pm UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/2 "2022-06-14T18:38:39Z")
Hi Vadym, could you share some more details about your situation? Are you dealing with a very large dataset or a dataset with very large documents? When you say "processing can take 20-40" are you referring to starting the Prodigy server or something else? Was it fast before and did something change that made it slow? Is there a reason why you're using Prodigy from Jupyter? Does it not run outside of Jupyter? Could you also share your Prodigy/Python versions? ---
**Author:** ![Vadym\_Kostyuk](https://avatars.discourse-cdn.com/v4/letter/v/fbc32d/32.png) [@Vadym\_Kostyuk](https://support.prodi.gy/u/Vadym_Kostyuk)\ **Post date:** [June 15, 2022, 9:07am UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/3 "2022-06-15T09:07:20Z")
Hi KOANING, thank you for your quick response! Dataset with text articles, which contains about 10 thousand copies. But slow processing occurs even at the stage of creating text patterns. "When you say "processing can take 20-40" are you referring to starting the Prodigy server or something else? " - starting the Prodigy server "Was it fast before and did something change that made it slow?" - in the Prodigy from the first launch of recipes processing takes a very long time and sometimes just does not happen. "Was it fast before and did something change that made it slow?" - Earlier, before working with Prodigy, I worked with different models of machine learning and processing large amounts of data and Jupyter processed it quickly. "Is there a reason why you're using Prodigy from Jupyter? Does it not run outside of Jupyter?" - I work in Jupiter, because I always use it to work with models of data science and it is quite convenient for me. If I try to run programs via anaconda prompt, the processing takes seconds, but anaconda prompt is very inconvenient to use and there are always errors that are difficult to find a solution. So I'm wondering if there are any better environments that were more intuitive and convenient. Or you have detailed manuals for working with anaconda prompt or Jupyter to speed up the work with Prodigy. Prodigy version - 1.11.7 Platform Windows-10-10.0.19044-SP0 Python Version 3.9.7 ---
**Author:** ![koaning](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/koaning/32/230_2.png) [@koaning](https://support.prodi.gy/u/koaning)\ **Post date:** [June 15, 2022, 11:21am UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/4 "2022-06-15T11:21:18Z")
Could you try running Prodigy with a very small example? Maybe just a `example.jsonl` file with: ```python {"text": "this is really just one example"} ``` When you run this with `ner.manual` like so: ```python !python -m prodigy ner.manual demodataset example.jsonl --label A,B ``` Is it still slow? If not, could you share the commands that you use to start Prodigy? ---
**Author:** ![Vadym\_Kostyuk](https://avatars.discourse-cdn.com/v4/letter/v/fbc32d/32.png) [@Vadym\_Kostyuk](https://support.prodi.gy/u/Vadym_Kostyuk)\ **Post date:** [June 28, 2022, 12:51pm UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/5 "2022-06-28T12:51:02Z")
Hi, sorry for the long answer, i tried but processing even a single line file took more than 20 minutes to process and I just turned it off. At this stage, I fully use Anaconda promt to work in Prodigy, but it is not very convenient, because if you make different versions of the code or many recipes they need to be stored in a separate document ![Screenshot 06-28-2022 15.44.34](https://us1.discourse-cdn.com/flex020/uploads/prodigy/original/2X/9/976bd55697e1d8871eaf5c77d5795fb5617326da.png) ![Screenshot 06-28-2022 15.44.50](https://us1.discourse-cdn.com/flex020/uploads/prodigy/original/2X/9/97a9186098cae1ded2b551bf39b3340bd2c24800.png) ---
**Author:** ![koaning](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/koaning/32/230_2.png) [@koaning](https://support.prodi.gy/u/koaning)\ **Post date:** [June 28, 2022, 12:56pm UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/6 "2022-06-28T12:56:37Z")
That's indeed very strange. Let's try to debug this. Could you try to add some [logging](https://prodi.gy/docs/install#debugging-logging)? Maybe if you start with basic logging we'll be able to spot an irregularity. ---
**Author:** ![Vadym\_Kostyuk](https://avatars.discourse-cdn.com/v4/letter/v/fbc32d/32.png) [@Vadym\_Kostyuk](https://support.prodi.gy/u/Vadym_Kostyuk)\ **Post date:** [July 1, 2022, 7:13am UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/7 "2022-07-01T07:13:52Z")
Maybe I specified something wrong but I have this error ![Screenshot_6](https://us1.discourse-cdn.com/flex020/uploads/prodigy/original/2X/2/26c8199c0efefa5f4914378062e0872dffb01a44.png) ---
**Author:** ![koaning](https://sea2.discourse-cdn.com/flex020/user_avatar/support.prodi.gy/koaning/32/230_2.png) [@koaning](https://support.prodi.gy/u/koaning)\ **Post date:** [July 1, 2022, 7:48am UTC](https://support.prodi.gy/t/prodigy-with-jupyter-notebook/5703/8 "2022-07-01T07:48:19Z")
I fear you've switched around the order there. The `PRODIGY_LOGGING=basic` needs to occur at the start of the prompt, per the docs [here](https://prodi.gy/docs/install#debugging-logging).