Pipenv: tensorflow/html5lib "Your dependencies could not be resolved" but can't see problem

omg is this real

to top it off, these wacky versions have security vulnerabilities

$ pipenv check
Checking PEP 508 requirements…
Passed!
Checking installed package safety…
25846: html5lib <0.99999999 resolved (0.9999999 installed)!
html5lib before 0.99999999 is vulnerable to a XSS attack. Upgrading avoids the XSS bug potentially caused by serializer allowing attribute values to be escaped out of in old browser versions, changing the quote_attr_values option on serializer to take one of three values, "always" (the old True value), "legacy" (the new option,  and the new default), and "spec" (the old False value, and the old default).

35693: html5lib <0.99999999 resolved (0.9999999 installed)!
The serializer in html5lib before 0.99999999 might allow remote attackers to conduct cross-site scripting (XSS) attacks by leveraging mishandling of the < (less than) character in attribute values.

35694: html5lib <0.99999999 resolved (0.9999999 installed)!
The serializer in html5lib before 0.99999999 might allow remote attackers to conduct cross-site scripting (XSS) attacks by leveraging mishandling of special characters in attribute values, a different vulnerability than CVE-2016-9909.

34965: bleach <2.1 resolved (1.5.0 installed)!
bleach 2.1 converts control characters (backspace particularly) to "?" preventing malicious copy-and-paste situations.

I think the problem part is:
Could not find a version that matches html5lib...==0.9999999,>=0.99999999pre

I don't see where the >=0.99999999pre specifier is coming from, it's not mentioned in the pipenv graph output

it apparently comes from bleach package, but not the installed version:

bleach [required: ==1.5.0, installed: 1.5.0]

compare:
https://github.com/mozilla/bleach/blob/v1.5/setup.py

https://github.com/mozilla/bleach/blob/v2.1.3/setup.py

I downloaded the 1.5.0 tarball from PyPI to confirm

the setup.py contains:

install_requires = [
    'six',
    # 3 9s up to but not including 8 9s, but not 4 9s or 5 9s because they're
    # busted
    'html5lib>=0.999,!=0.9999,!=0.99999,<0.99999999',
]

but the meta info on the PyPI page for the package shows the requirements from the latest version (naturally):

Requires Distributions
html5lib (!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre)
six

some problem here?

reading further up the tensorboard issue thread linked above...

to confuse matters further, pip has its own vendored version of html5lib
https://github.com/pypa/pip/blob/9.0.1/pip/_vendor/html5lib/__init__.py
https://github.com/pypa/pip/blob/9.0.1/pip/_vendor/vendor.txt

html5lib==1.0b10

not sure if that's involved in some awful way

are you using latest?

I'm inside my project's pipenv shell

pipenv, version 11.6.1
pip 9.0.1
python 3.6

metadata inside the bleach 1.5.0 _wheel_ from PyPI also looks correct

the conflict reported:

Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre

seems to exactly match the requirements in _latest_ (2.1.3) version of bleach instead

install_requires = [
    'six',
    # >= 8 9s because of breaking API change
    # the 'pre' suffix is needed for supporting '1.0b*' versions
    'html5lib>=0.99999999pre,!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8',
]

added to the requirement from tensorboard https://github.com/tensorflow/tensorboard/blob/0.1.8/tensorboard/pip_package/setup.py

REQUIRED_PACKAGES = [
    'numpy >= 1.11.0',
    'six >= 1.10.0',
    'protobuf >= 3.2.0',
    'werkzeug >= 0.11.10',
    'html5lib == 0.9999999',  # identical to 1.0b8
    'markdown >= 2.6.8',
    'bleach == 1.5.0',
]

So seems like something weird going on when determining requirements for bleach==1.5.0

I am having the same problem. pipenv install complains that the dependencies need cryptography<1.0,>=1.7.2,>=1.8.1,>=1.8.2,>=1.9 (which can obviously never resolve), but I can't see any of my packages requiring cryptography<1.0 in pipenv graph. I don't know what to do, because it won't install at all.

@skorokithakis please open a seperate issue

@anentropic have you tried the latest version of pipenv?

@anentropic also please don't run pipenv from _inside_ the pipenv shell, this isn't intended to work. Try again from _outside_ the pipenv shell and let us know if it is still broken

@techalchemy uh, yes it is.

that is literally the primary design principal behind this project

Ok, I've upgraded pipenv 11.6.1 --> 11.6.9

same problem

$ pipenv --version
pipenv, version 11.6.9
$ pipenv lock
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

I can't tell what's going on with these version numbers.

I can tell you that this isn't likely to change any time soon, though.

sure, I will keep looking into it if I can find anything

some more details:

• I have no Pipfile.lock at the moment (it's unable to create one)
• I tried deactivating my pipenv shell, deleting the associated virtualenv folder and running pipenv install (i.e. start over from scratch)... same problem

I can also reproduce with a minimal example... in a new shell, create an empty directory, the following Pipfile and run pipenv install

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

tensorflow = "*"


[requires]

python_version = "3.6"

pipenv lock --verbose should shed some light on this

==0.9999999,>=0.99999999pre appears to be unresolvable to me.

this versioning scheme is just absurd

the point is that >=0.99999999pre requirement is attributed to bleach==1.5.0 but that project in that version does not specify that dependency

I don't know where pipenv or underlying tools get the dependency info from, is the PyPI server lying somehow?

Here is the verbose output:

Locking [dev-packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:

Finding the best candidates:

Finding secondary dependencies:
------------------------------------------------------------
Result of round 1: stable, done

Locking [packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:
  tensorflow

Finding the best candidates:
  found candidate tensorflow==1.6.0 (constraint was <any>)

Finding secondary dependencies:
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26

New dependencies found in this round:
  adding ['absl-py', '>=0.1.6', '[]']
  adding ['astor', '>=0.6.0', '[]']
  adding ['gast', '>=0.2.0', '[]']
  adding ['grpcio', '>=1.8.6', '[]']
  adding ['numpy', '>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['tensorboard', '<1.7.0,>=1.6.0', '[]']
  adding ['termcolor', '>=1.1.0', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  gast>=0.2.0
  grpcio>=1.8.6
  numpy>=1.13.3
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate numpy==1.14.2 (constraint was >=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0)
  found candidate six==1.11.0 (constraint was >=1.10.0)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  absl-py==0.1.11           requires six
  wheel==0.30.0             requires -
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  termcolor==1.1.0          requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  protobuf==3.5.2           requires setuptools, six>=1.9
  gast==0.2.0               requires -
  astor==0.6.2              requires -
  numpy==1.14.2             requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  six==1.11.0               requires -

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '==0.9999999', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0,>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0,>=3.5.0.post1', '[]']
  adding ['six', '>=1.10.0,>=1.5.2,>=1.9', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
Removed dependencies in this round:
  removing ['numpy', '>=1.13.3', '[]']
  removing ['protobuf', '>=3.4.0', '[]']
  removing ['six', '>=1.10.0', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib==0.9999999
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate html5lib==0.9999999 (constraint was ==0.9999999)
  found candidate markdown==2.6.11 (constraint was >=2.6.8)
  found candidate numpy==1.14.2 (constraint was >=1.12.0,>=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0,>=3.5.0.post1)
  found candidate six==1.11.0 (constraint was >=1.10.0,>=1.5.2,>=1.9)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate werkzeug==0.14.1 (constraint was >=0.11.10)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  numpy==1.14.2             requires -
  werkzeug==0.14.1          requires -
  absl-py==0.1.11           requires six
  html5lib==0.9999999       requires six>=1.9, webencodings
  gast==0.2.0               requires -
  bleach==1.5.0             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  protobuf==3.5.2           requires setuptools, six>=1.9
  markdown==2.6.11          requires -
  six==1.11.0               requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  astor==0.6.2              requires -
  termcolor==1.1.0          requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2

New dependencies found in this round:
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['webencodings', '', '[]']
Removed dependencies in this round:
  removing ['html5lib', '==0.9999999', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 3: not stable

                          ROUND 4
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  webencodings
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:
  tensorflow

Finding the best candidates:
  found candidate tensorflow==1.6.0 (constraint was <any>)

Finding secondary dependencies:
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26

New dependencies found in this round:
  adding ['absl-py', '>=0.1.6', '[]']
  adding ['astor', '>=0.6.0', '[]']
  adding ['gast', '>=0.2.0', '[]']
  adding ['grpcio', '>=1.8.6', '[]']
  adding ['numpy', '>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['tensorboard', '<1.7.0,>=1.6.0', '[]']
  adding ['termcolor', '>=1.1.0', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  gast>=0.2.0
  grpcio>=1.8.6
  numpy>=1.13.3
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate numpy==1.14.2 (constraint was >=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0)
  found candidate six==1.11.0 (constraint was >=1.10.0)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  astor==0.6.2              requires -
  six==1.11.0               requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  numpy==1.14.2             requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  wheel==0.30.0             requires -
  protobuf==3.5.2           requires setuptools, six>=1.9
  termcolor==1.1.0          requires -
  absl-py==0.1.11           requires six
  gast==0.2.0               requires -

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '==0.9999999', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0,>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0,>=3.5.0.post1', '[]']
  adding ['six', '>=1.10.0,>=1.5.2,>=1.9', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
Removed dependencies in this round:
  removing ['numpy', '>=1.13.3', '[]']
  removing ['protobuf', '>=3.4.0', '[]']
  removing ['six', '>=1.10.0', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib==0.9999999
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate html5lib==0.9999999 (constraint was ==0.9999999)
  found candidate markdown==2.6.11 (constraint was >=2.6.8)
  found candidate numpy==1.14.2 (constraint was >=1.12.0,>=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0,>=3.5.0.post1)
  found candidate six==1.11.0 (constraint was >=1.10.0,>=1.5.2,>=1.9)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate werkzeug==0.14.1 (constraint was >=0.11.10)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  protobuf==3.5.2           requires setuptools, six>=1.9
  html5lib==0.9999999       requires six>=1.9, webencodings
  gast==0.2.0               requires -
  bleach==1.5.0             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  markdown==2.6.11          requires -
  termcolor==1.1.0          requires -
  astor==0.6.2              requires -
  numpy==1.14.2             requires -
  six==1.11.0               requires -
  absl-py==0.1.11           requires six
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  wheel==0.30.0             requires -
  werkzeug==0.14.1          requires -

New dependencies found in this round:
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['webencodings', '', '[]']
Removed dependencies in this round:
  removing ['html5lib', '==0.9999999', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 3: not stable

                          ROUND 4
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  webencodings
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

look, we're not going to be able to do anything about this.

try 11.8.0

Success!

I think I found a similar error with django and django_pyodbc_azure. I need to install versions <2 so I run this command:

pipenv install django<2 django-pyodbc-azure<2

Here is what I get:

Installing django<2…
Collecting django<2
  Using cached Django-1.11.11-py2.py3-none-any.whl
Collecting pytz (from django<2)
  Using cached pytz-2018.3-py2.py3-none-any.whl
Installing collected packages: pytz, django
Successfully installed django-1.11.11 pytz-2018.3

Adding django<2 to Pipfile's [packages]…
Installing django-pyodbc-azure<2…
Collecting django-pyodbc-azure<2
  Using cached django_pyodbc_azure-1.11.11.0-py2.py3-none-any.whl
Collecting pyodbc>=3.0 (from django-pyodbc-azure<2)
  Using cached pyodbc-4.0.22-cp36-cp36m-win_amd64.whl
Requirement already satisfied: Django<2.0,>=1.11.11 in c:\users\msopko\.virtualenvs\kml_internal--4e53ydp\lib\site-packages (from django-pyodbc-azure<2)
Requirement already satisfied: pytz in c:\users\msopko\.virtualenvs\kml_internal--4e53ydp\lib\site-packages (from Django<2.0,>=1.11.11->django-pyodbc-azure<2)
Installing collected packages: pyodbc, django-pyodbc-azure
Successfully installed django-pyodbc-azure-1.11.11.0 pyodbc-4.0.22

Adding django-pyodbc-azure<2 to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches django<2,<2.1,>=2.0.3
Tried: 1.1.3, 1.1.4, 1.2, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.7, 1.3, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.4, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.4.10, 1.4.11, 1.4.12, 1.4.13, 1.4.14, 1.4.15, 1.4.16, 1.4.17, 1.4.18, 1.4.19, 1.4.20, 1.4.21, 1.4.22, 1.5, 1.5.1, 1.5.2, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.5.8, 1.5.9, 1.5.10, 1.5.11, 1.5.12, 1.5.12, 1.6, 1.6, 1.6.1, 1.6.1, 1.6.2, 1.6.2, 1.6.3, 1.6.3, 1.6.4, 1.6.4, 1.6.5, 1.6.5, 1.6.6, 1.6.6, 1.6.7, 1.6.7, 1.6.8, 1.6.8, 1.6.9, 1.6.9, 1.6.10, 1.6.10, 1.6.11, 1.6.11, 1.7, 1.7, 1.7.1, 1.7.1, 1.7.2, 1.7.2, 1.7.3, 1.7.3, 1.7.4, 1.7.4, 1.7.5, 1.7.5, 1.7.6, 1.7.6, 1.7.7, 1.7.7, 1.7.8, 1.7.8, 1.7.9, 1.7.9, 1.7.10, 1.7.10, 1.7.11, 1.7.11, 1.8a1, 1.8b1, 1.8b2, 1.8rc1, 1.8, 1.8, 1.8.1, 1.8.1, 1.8.2, 1.8.2, 1.8.3, 1.8.3, 1.8.4, 1.8.4, 1.8.5, 1.8.5, 1.8.6, 1.8.6, 1.8.7, 1.8.7, 1.8.8, 1.8.8, 1.8.9, 1.8.9, 1.8.10, 1.8.10, 1.8.11, 1.8.11, 1.8.12, 1.8.12, 1.8.13, 1.8.13, 1.8.14, 1.8.14, 1.8.15, 1.8.15, 1.8.16, 1.8.16, 1.8.17, 1.8.17, 1.8.18, 1.8.18, 1.8.19, 1.8.19, 1.9a1, 1.9b1, 1.9rc1, 1.9rc2, 1.9, 1.9, 1.9.1, 1.9.1, 1.9.2, 1.9.2, 1.9.3, 1.9.3, 1.9.4, 1.9.4, 1.9.5, 1.9.5, 1.9.6, 1.9.6, 1.9.7, 1.9.7, 1.9.8, 1.9.8, 1.9.9, 1.9.9, 1.9.10, 1.9.10, 1.9.11, 1.9.11, 1.9.12, 1.9.12, 1.9.13, 1.9.13, 1.10a1, 1.10a1, 1.10b1, 1.10b1, 1.10rc1, 1.10rc1, 1.10, 1.10, 1.10.1, 1.10.1, 1.10.2, 1.10.2, 1.10.3, 1.10.3, 1.10.4, 1.10.4, 1.10.5, 1.10.5, 1.10.6, 1.10.6, 1.10.7, 1.10.7, 1.10.8, 1.10.8, 1.11a1, 1.11b1, 1.11rc1, 1.11rc1, 1.11, 1.11, 1.11.1, 1.11.1, 1.11.2, 1.11.2, 1.11.3, 1.11.3, 1.11.4, 1.11.4, 1.11.5, 1.11.5, 1.11.6, 1.11.6, 1.11.7, 1.11.7, 1.11.8, 1.11.8, 1.11.9, 1.11.9, 1.11.10, 1.11.10, 1.11.11, 1.11.11, 2.0a1, 2.0b1, 2.0rc1, 2.0, 2.0, 2.0.1, 2.0.1, 2.0.2, 2.0.2, 2.0.3, 2.0.3

I got around this error by specifying the branch:
django-pyodbc-azure = {git = "https://github.com/michiya/django-pyodbc-azure", ref = "azure-1.11"}

I have upgraded to 11.8.0 but have same problem still

however my colleague could not reproduce it from my minimal example

I am currently debugging and will post more info when I have some

ok, this is weird

I got it to work by:

$ pyenv virtualenv pipenvtemp
$ pyenv activate pipenvtemp
pipenvtemp > $ pip install pipenv
pipenvtemp > $ pipenv lock

This has now broken my 'outside' install of pipenv though:

pipenvtemp > $ source deactivate
$ pipenv lock
pyenv: pipenv: command not found

The `pipenv' command exists in these Python versions:
  2.7.11/envs/pipenvtemp
  pipenvtemp

$ pipsi install pipenv
pipenv is already installed

so I have some horrible interaction between pyenv-virtualenv, pipsi and pipenv on my system

I thought I had faithfully followed the install instructions, but maybe existing state of my system was not compatible

I think now I have to try blowing away all my Pythons and set up my dev environment from scratch 😢

Oh it's specific to python 3 somehow, I tried the pyenv-virtualenv trick above with my actual project and it didn't work.

And if I try it again with the minimal example, but using Python 3.6.4 instead of 2.7, then it doesn't work:

$ pyenv virtualenv 3.6.4 pipenvtemp-py3
$ pyenv activate pipenvtemp-py3
pipenvtemp-py3 > $ pip install pipenv
pipenvtemp-py3 > $ rm Pipfile.lock
pipenvtemp-py3 > $ pipenv lock
Courtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project.
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

@anentropic just uninstall all of the pipenvs you have, everywhere, and reinstall using system 3.6.4 with --user

Well I found the problem and a solution, if not an explanation for how it happened.

I spent a while stepping through the underlying code, i.e.

from pipenv.patched.piptools.repositories import PyPIRepository
from pipenv.patched.piptools.scripts.compile import get_pip_command
from pipenv.patched.notpip.req.req_install import InstallRequirement
from pipenv.patched.piptools.resolver import Resolver

pip_command = get_pip_command()
pip_options, _ = pip_command.parse_args([])
session = pip_command._build_session(pip_options)
pypi = PyPIRepository(pip_options=pip_options, use_json=False, session=session)

# first observe that this returns correct constraints:
ireq = InstallRequirement.from_line('bleach==1.5.0')
pypi.get_dependencies(ireq)
{<InstallRequirement object: six (from bleach==1.5.0) editable=False>,
 <InstallRequirement object: html5lib!=0.9999,!=0.99999,<0.99999999,>=0.999 (from bleach==1.5.0) editable=False>}

# I added the following breakpoint at pipenv/patched/piptools/resolver.py:200
            if str(best_match.req) == 'bleach==1.5.0':
                import ipdb; ipdb.set_trace()

# then ran the resolver:
ireq = InstallRequirement.from_line('tensorflow==1.3.0')
resolver = Resolver(constraints=[ireq], repository=pypi)
resolver.resolve()

# stepping through we fail this check, showing that 'html5lib' is already in the cache
    if ireq not in self.dependency_cache:

# so next it fetches dep from cache:
ipdb> pp self.dependency_cache[ireq]
['html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre',
 'six']
# aha!
ipdb> self.dependency_cache._cache_file
'/Users/anentropic/Library/Caches/pipenv/depcache-py3.6.json'

Somehow the bogus html5lib>=0.99999999pre requirement had got stuck in the dependency cache file.

Now I knew what to do...

pipenvtemp-py3 $ rm /Users/anentropic/Library/Caches/pipenv/depcache-py3.6.json
pipenvtemp-py3 $ pipenv lock
Courtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project.
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Success - lock file was created without error.

This also explains why it worked under Python 2.7 - I assume because pipenv has a separate dependency cache file per python version.

@anentropic thanks for the update! We should have recommended that directly, bug I'm glad you got it sorted out!

@anentropic @techalchemy I'm facing the same issue but removing /Users/.../Library/Caches/pipenv/depcache-py3.6.json didn't help me. Any suggestions on what else I can try? Thanks!

  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==1.0b8,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

@henadzit Please provide information for your platform. Open a new issue to see what information are expected to debug your problem. You don’t need to submit a new issue, only need to check the fields and provide them accordingly here.

@uranusjr, sure! Here it is

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

falcon = "==1.3.0"
gunicorn = "==19.7.1"
hunspell = "==0.5.0"
nltk = "==3.2.4"
pysolr = "==3.7.0"
pytest = "==3.1.2"
pytest-mock = "==1.6.3"
requests = "==2.18.4"


[dev-packages]

jupyter = "*"
spacy = "*"
matplotlib = "*"


[requires]

python_version = "3.6.4"

@uranusjr, sorry for bothering you, but have you had a chance to look at the output in my previous comment? Thanks a lot!

@henadzit don't activate the pipenv shell before you run dependency resolution. From _outside_ of the pipenv shell, try pipenv lock --verbose --clear and see if this resolves the problem

@techalchemy, thank you for the suggestion! I tried it but ended up with the same error unfortunately.

Here's the output of pipenv.help without pipenv shell.

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

falcon = "==1.3.0"
gunicorn = "==19.7.1"
hunspell = "==0.5.0"
nltk = "==3.2.4"
pysolr = "==3.7.0"
pytest = "==3.1.2"
pytest-mock = "==1.6.3"
requests = "==2.18.4"


[dev-packages]

jupyter = "*"
spacy = "*"
matplotlib = "*"


[requires]

python_version = "3.6.4"

🤔 Try removing the whole cache directory manually.

@henadzit try pipenv lock --clear or wipe any of the following directories if they exist:

/Users/.../Library/Caches/pipenv
/Users/.../Library/Caches/pip-tools
/Users/.../Library/Caches/pip

@uranusjr @techalchemy, thank you for trying to help me out! I tried everything you suggested and no luck. I created a new Pipfile with just two packages and I'm getting the same error. Below is the output of pipenv.help. I'm about to try running this PIpfile in docker to see if it's just my environment.

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]
jupyter = "==1.0.0"
spacy = "==2.0.10"

[dev-packages]

[requires]

python_version = "3.6.4"

@uranusjr @techalchemy, looks like the issue isn't related to my environment. I was able to reproduce the issue in the completely clean environment of docker. I created a repo to show the issue, please, have a look if you get a chance - https://github.com/henadzit/pipenv-html5lib-issue.

@henadzit Your dependencies actually don't resolve. This is an issue with spaCy: https://github.com/explosion/spaCy/issues/2181.

@henadzit Because spaCy is dropping its required version in 2.0.11, it felt more correct to use the TensorFlow version. I'm not sure what the canonical way to do this is, but I just (temporarily, I hope) pulled tensorflow out of my Pipfile and installed my packages like this:

pipenv install
pip install tensorflow

@romanczuk, I upgraded spacy and it resolved the issue! Thank all for your help!

For me the issue still persists. I am trying to install both tensorflow and jupyter[notebook]. Whereas the former pinns bleach==1.5.0, the later has a transitive unpinned bleach dependency. This dependency seems to adds the constraint >=0.99999999pre.

I can recreate the behavior by trying to install bleach (unpinned) and tensorboard (which pins the bleach version):

pipenv install bleach tensorboard
Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing bleach…
Collecting bleach
  Using cached bleach-2.1.3-py2.py3-none-any.whl
Collecting six (from bleach)
  Using cached six-1.11.0-py2.py3-none-any.whl
Collecting html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre (from bleach)
  Using cached html5lib-1.0.1-py2.py3-none-any.whl
Collecting webencodings (from html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre->bleach)
  Using cached webencodings-0.5.1-py2.py3-none-any.whl
Installing collected packages: six, webencodings, html5lib, bleach
Successfully installed bleach-2.1.3 html5lib-1.0.1 six-1.11.0 webencodings-0.5.1

Adding bleach to Pipfile's [packages]…
Installing tensorboard…
Collecting tensorboard
  Using cached tensorboard-1.7.0-py3-none-any.whl
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Using cached Werkzeug-0.14.1-py2.py3-none-any.whl
Collecting bleach==1.5.0 (from tensorboard)
  Using cached bleach-1.5.0-py2.py3-none-any.whl
Collecting numpy>=1.12.0 (from tensorboard)
  Using cached numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
Collecting markdown>=2.6.8 (from tensorboard)
  Using cached Markdown-2.6.11-py2.py3-none-any.whl
Collecting protobuf>=3.4.0 (from tensorboard)
  Using cached protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
Requirement already satisfied: six>=1.10.0 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting html5lib==0.9999999 (from tensorboard)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Installing collected packages: werkzeug, html5lib, bleach, numpy, markdown, protobuf, tensorboard
  Found existing installation: html5lib 1.0.1
    Uninstalling html5lib-1.0.1:
      Successfully uninstalled html5lib-1.0.1
  Found existing installation: bleach 2.1.3
    Uninstalling bleach-2.1.3:
      Successfully uninstalled bleach-2.1.3
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

When running install --skip-lock and graph there is no sign of this constraint:

$ pipenv install bleach tensorboard --skip-lock
...

$ pipenv graph | grep html5lib
    - html5lib [required: >=0.999,!=0.9999,!=0.99999,<0.99999999, installed: 0.9999999]
  - html5lib [required: ==0.9999999, installed: 0.9999999]

$ pipenv graph | grep bleach
  - bleach [required: ==1.5.0, installed: 1.5.0]

Removing the cache directories, does not change the behavior. I am running pipenv version 11.8.0. There does seem to be some interaction with global state. While searching for a minimal example, I tried the setup above multiple times. For one run, locking worked. However, I could not reproduce this behavior.

Further details:

$ pipenv --version
pipenv, version 11.8.0

$ pipenv graph
tensorboard==1.7.0
  - bleach [required: ==1.5.0, installed: 1.5.0]
    - html5lib [required: !=0.99999,!=0.9999,>=0.999,<0.99999999, installed: 0.9999999]
      - six [required: Any, installed: 1.11.0]
    - six [required: Any, installed: 1.11.0]
  - html5lib [required: ==0.9999999, installed: 0.9999999]
    - six [required: Any, installed: 1.11.0]
  - markdown [required: >=2.6.8, installed: 2.6.11]
  - numpy [required: >=1.12.0, installed: 1.14.2]
  - protobuf [required: >=3.4.0, installed: 3.5.2.post1]
    - setuptools [required: Any, installed: 39.0.1]
    - six [required: >=1.9, installed: 1.11.0]
  - six [required: >=1.10.0, installed: 1.11.0]
  - werkzeug [required: >=0.11.10, installed: 0.14.1]
  - wheel [required: >=0.26, installed: 0.31.0]
webencodings==0.5.1


$ cat Pipfile 
[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

bleach = "*"
tensorboard = "*"


[dev-packages]



[requires]

python_version = "3.6"

$ pipenv lock --clear --verbose
Locking [dev-packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:

Finding the best candidates:

Finding secondary dependencies:
------------------------------------------------------------
Result of round 1: stable, done

Locking [packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:
  bleach
  tensorboard

Finding the best candidates:
  found candidate bleach==2.1.3 (constraint was <any>)
  found candidate tensorboard==1.7.0 (constraint was <any>)

Finding secondary dependencies:
  tensorboard==1.7.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  bleach==2.1.3             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  bleach==1.5.0
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:
  bleach
  tensorboard

Finding the best candidates:
  found candidate bleach==2.1.3 (constraint was <any>)
  found candidate tensorboard==1.7.0 (constraint was <any>)

Finding secondary dependencies:
  bleach==2.1.3             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  tensorboard==1.7.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  bleach==1.5.0
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate bleach==1.5.0 (constraint was ==1.5.0)

INFO:pip9._vendor.requests.packages.urllib3.connectionpool:Starting new HTTPS connection (1): pypi.python.org
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

Okay looking at this carefully this is a legitimate dependency conflict. html5lib>=0.99999999pre is a bigger number than html5lib==0.9999999 so this can’t actually be resolved. Just put tensorboard in the dev-packages section for now and pipenv install —dev — pipenv will favor the non-dev resolution this way

Thanks for the workaround. I'll give a try.

What puzzles me: why does html5lib>=0.99999999pre even come up as a constraint? Tensorboard fixes bleach==1.5.0. Therefore, the additional bleach package passed to pipenv install should not affect the dependency graph, should it?

Concretely: given that tensorboard fixes bleach==1.5.0, I would expect the dependency graph for both these calls to be exactly the same:

pipenv install tensorboard

pipenv install bleach tensorboard

It does because you have it listed first, which might be fixed if you swap the ordering? Not sure. Try that too and let me know

If I add bleach to the commandline it fails (first two options). If I only install tensorboard, it works (last option). The pipenv output is inside the details blocks.

$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile 
$ pipenv install tensorboard bleach

# fails

Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting six>=1.10.0 (from tensorboard)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: six, html5lib, werkzeug, markdown, numpy, protobuf, bleach, tensorboard
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 six-1.11.0 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Installing bleach…
Requirement already satisfied: bleach in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages
Requirement already satisfied: six in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from bleach)
Requirement already satisfied: html5lib!=0.9999,!=0.99999,<0.99999999,>=0.999 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from bleach)

Adding bleach to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile
$ pipenv install bleach tensorboard 

# fails

Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing bleach…
Collecting bleach
  Downloading bleach-2.1.3-py2.py3-none-any.whl
Collecting html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre (from bleach)
  Downloading html5lib-1.0.1-py2.py3-none-any.whl (117kB)
Collecting six (from bleach)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting webencodings (from html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre->bleach)
  Downloading webencodings-0.5.1-py2.py3-none-any.whl
Installing collected packages: six, webencodings, html5lib, bleach
Successfully installed bleach-2.1.3 html5lib-1.0.1 six-1.11.0 webencodings-0.5.1

Adding bleach to Pipfile's [packages]…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: six>=1.10.0 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: werkzeug, markdown, html5lib, bleach, numpy, protobuf, tensorboard
  Found existing installation: html5lib 1.0.1
    Uninstalling html5lib-1.0.1:
      Successfully uninstalled html5lib-1.0.1
  Found existing installation: bleach 2.1.3
    Uninstalling bleach-2.1.3:
      Successfully uninstalled bleach-2.1.3
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock (d84f24) out of date, updating to (930330)…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile 
$ pipenv install tensorboard

# works

Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting six>=1.10.0 (from tensorboard)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: markdown, six, html5lib, bleach, numpy, werkzeug, protobuf, tensorboard
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 six-1.11.0 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…
Updated Pipfile.lock (d84f24)!
Installing dependencies from Pipfile.lock (d84f24)…
  🐍   ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 9/9 — 00:00:04
To activate this project's virtualenv, run the following:
 $ pipenv shell

@techalchemy thanks again for the work around. It solved my actual problem (installing jupyter + tensorflow): I put jupyter into the development packages and kept tensorflow in the production packages. This way, all packages can be locked.