Windows 10 OMP: Error #15: Initializing libiomp5md.dll

, ,
1

I am posting this, because it may help some other new user.

I purchased Prodigy a couple of days ago. I have read enought to begin a tutorial. Today I am following tutorial NER: Analyzing how mentions of ingredients change over time.

My environment is Windows 10, Anaconda and vscode.

I was stuck because of this error.

$ prodigy sense2vec.teach food_terms ./s2v_reddit_2015_md --seeds "garlic, avocado, cottage cheese, olive oil, cumin, chicken breast, beef, iceberg lettuce"
Starting with seed keys: ['garlic|NOUN', 'avocado|NOUN', 'cottage_cheese|NOUN', 'olive_oil|NOUN', 'cumin|NOUN', 'chicken_breast|NOUN', 'beef|NOUN', 'iceberg_lettuce|NOUN']
OMP: Error #15: Initializing libiomp5md.dll, but found libiomp5md.dll already initialized.
OMP: Hint This means that multiple copies of the OpenMP runtime have been linked into the program. That is dangerous, since it can degrade performance or cause incorrect results. The best thing to do is to ensure that only a single OpenMP runtime is linked into the process, e.g. by avoiding static linking of the OpenMP runtime in any library. As an unsafe, unsupported, undocumented workaround you can set the environment variable KMP_DUPLICATE_LIB_OK=TRUE to allow the program to continue to execute, but that may cause crashes or silently produce incorrect results. For more information, please see http://www.intel.com/software/products/support/.

I read a stackoverflow post about how this is related to nomkl module. So, I installed it.

conda install -c conda-forge nomkl

That did not help. The message suggest one would be able to get past this error by setting the environment parameter in Python:

import os
os.environ["KMP_DUPLICATE_LIB_OK"]="TRUE"

From the command line

$ export var KMP_DUPLICATE_LIB_OK=TRUE

However, I was running the tutorial as is, from the command line. So now,

$ prodigy sense2vec.teach food_terms ./s2v_reddit_2015_md --seeds "garlic, avocado, cottage cheese, olive oil, cumin, chicken breast, beef, iceberg lettuce"
Starting with seed keys: ['garlic|NOUN', 'avocado|NOUN', 'cottage_cheese|NOUN', 'olive_oil|NOUN', 'cumin|NOUN', 'chicken_breast|NOUN', 'beef|NOUN', 'iceberg_lettuce|NOUN']      

✨  Starting the web server at http://localhost:8080 ...
Open the app in your browser and start annotating!

:smiling_face_with_three_hearts:

1 Like
2

Thanks for reporting this, @dandrade, and welcome to Prodigy! :slight_smile:

For other users who are reading this thread, note that setting KMP_DUPLICATE_LIB_OK=True, according to the error message, is potentially unsafe and may lead to worse performance or incorrect results. One particular solution is to reinstall numpy as it's dependent on MKL. Another way is to install nomkl via conda (although OP already mentioned that this doesn't work).

1 Like