I’m trying to upgrade from Prodigy 1.6.1 to 1.7.1 in a virtual machine. I keep getting a ‘killed’ message. To try to increase disk and memory space, I uninstalled the old version, but I still can’t get the new one installed!
This is the error message:
(env) xxxxx@xxxxx:~$ pip install prodigy-1.7.1-cp35.cp36.cp37-cp35m.cp36m.cp37m-linux_x86_64.whl
Processing ./prodigy-1.7.1-cp35.cp36.cp37-cp35m.cp36m.cp37m-linux_x86_64.whl
Requirement already satisfied: ujson==1.35 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (1.35)
Requirement already satisfied: toolz<=1.0.0,>=0.8.2 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (0.9.0)
Requirement already satisfied: waitress<2.0.0,>=1.0.2 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (1.1.0)
Requirement already satisfied: peewee<3.0.0,>=2.10.1 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (2.10.2)
Requirement already satisfied: murmurhash<1.1.0,>=1.0.2 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (1.0.2)
Requirement already satisfied: hug<3.0.0,>=2.4.1 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (2.4.1)
Requirement already satisfied: requests<3.0.0,>=2.0.0 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (2.21.0)
Requirement already satisfied: plac<1.0.0,>=0.9.6 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (0.9.6)
Collecting spacy<2.1.0,>=2.0.16 (from prodigy==1.7.1)
Using cached https://files.pythonhosted.org/packages/f9/7a/388e439439c4e3ebc26ea3ef66e1767ba923c3783c1055216ed5ec26fc15/spacy-2.0.18-cp35-cp35m-manylinux1_x86_64.whl
Collecting thinc<6.13.0,>=6.12.0 (from prodigy==1.7.1)
Using cached https://files.pythonhosted.org/packages/2a/a3/3c760f8653abd725ddd0d3662a4ef51f3642a1388202ae52219f14f95b52/thinc-6.12.1-cp35-cp35m-manylinux1_x86_64.whl
Requirement already satisfied: jsonschema<3.0.0,>=2.6.0 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (2.6.0)
Requirement already satisfied: msgpack==0.5.6 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (0.5.6)
Requirement already satisfied: msgpack-numpy<0.4.4.0 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (0.4.3.2)
Requirement already satisfied: cachetools>=2.1.0 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (3.0.0)
Requirement already satisfied: pyjwt<2.0.0,>=1.6.1 in ./env/lib/python3.5/site-packages (from prodigy==1.7.1) (1.7.1)
Requirement already satisfied: falcon==1.4.1 in ./env/lib/python3.5/site-packages (from hug<3.0.0,>=2.4.1->prodigy==1.7.1) (1.4.1)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in ./env/lib/python3.5/site-packages (from requests<3.0.0,>=2.0.0->prodigy==1.7.1) (1.24.2)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in ./env/lib/python3.5/site-packages (from requests<3.0.0,>=2.0.0->prodigy==1.7.1) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.5/site-packages (from requests<3.0.0,>=2.0.0->prodigy==1.7.1) (2019.3.9)
Requirement already satisfied: idna<2.9,>=2.5 in ./env/lib/python3.5/site-packages (from requests<3.0.0,>=2.0.0->prodigy==1.7.1) (2.8)
Requirement already satisfied: dill<0.3,>=0.2 in ./env/lib/python3.5/site-packages (from spacy<2.1.0,>=2.0.16->prodigy==1.7.1) (0.2.8.2)
Requirement already satisfied: preshed<2.1.0,>=2.0.1 in ./env/lib/python3.5/site-packages (from spacy<2.1.0,>=2.0.16->prodigy==1.7.1) (2.0.1)
Requirement already satisfied: numpy>=1.15.0 in ./env/lib/python3.5/site-packages (from spacy<2.1.0,>=2.0.16->prodigy==1.7.1) (1.16.3)
Requirement already satisfied: regex==2018.01.10 in ./env/lib/python3.5/site-packages (from spacy<2.1.0,>=2.0.16->prodigy==1.7.1) (2018.1.10)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in ./env/lib/python3.5/site-packages (from spacy<2.1.0,>=2.0.16->prodigy==1.7.1) (2.0.2)
Requirement already satisfied: wrapt<1.11.0,>=1.10.0 in ./env/lib/python3.5/site-packages (from thinc<6.13.0,>=6.12.0->prodigy==1.7.1) (1.10.11)
Requirement already satisfied: six<2.0.0,>=1.10.0 in ./env/lib/python3.5/site-packages (from thinc<6.13.0,>=6.12.0->prodigy==1.7.1) (1.11.0)
Requirement already satisfied: tqdm<5.0.0,>=4.10.0 in ./env/lib/python3.5/site-packages (from thinc<6.13.0,>=6.12.0->prodigy==1.7.1) (4.31.1)
Requirement already satisfied: cytoolz<0.10,>=0.9.0 in ./env/lib/python3.5/site-packages (from thinc<6.13.0,>=6.12.0->prodigy==1.7.1) (0.9.0.1)
Requirement already satisfied: python-mimeparse>=1.5.2 in ./env/lib/python3.5/site-packages (from falcon==1.4.1->hug<3.0.0,>=2.4.1->prodigy==1.7.1) (1.6.0)
Installing collected packages: thinc, spacy, prodigy
Found existing installation: thinc 7.0.4
Uninstalling thinc-7.0.4:
Successfully uninstalled thinc-7.0.4
Killed
I have some 14GB of disk space and 1.4GB of free memroy in the VM:
Filesystem Size Used Avail Use% Mounted on
udev 840M 0 840M 0% /dev
tmpfs 171M 4.0M 167M 3% /run
/dev/sda1 30G 15G 14G 52% /
tmpfs 851M 0 851M 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 851M 0 851M 0% /sys/fs/cgroup
tmpfs 171M 0 171M 0% /run/user/1002
And memory:
total used free shared buff/cache available
Mem: 1.7G 187M 1.4G 4.0M 44M 1.4G
Swap: 0B 0B 0B
Do I need to increase the memory of the VM? Anything I can do differently to be able to install?
Thanks!
SOLVED - I checked kern.log and found the error messages:
Out of memory: Kill process 998 (pip) score 852 or sacrifice child
Killed process 998 (pip) total-vm:1615872kB, anon-rss:1482220kB, file-rss:0kB, shmem-rss:0kB
I increased the VM memory to 3.75GB and Prodigy installed fine!
