-
Notifications
You must be signed in to change notification settings - Fork 249
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Removal of LegacyVersion
and LegacySpecifier
#530
Comments
This is what the pip warnings/errors should look like, to users:
|
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
Pinning this for visibility, since this has now been released. |
LegacyVersion
and LegacySpecifier
LegacyVersion
and LegacySpecifier
While I agree this was a good idea, dropping LegacyVersion is still creating quite a bit of churn for several of my packages and the packages that depend on these. In particular tools that process PyPI packages in a generic way using packaging will fail for older packages that use legacy versions. An important aspect of such tool is to compare versions, and failing to process and sort the whole set of versions of a package is problematic. pytz is an example where old versions such as 2004d fail with v22 and up. Basically, pip and other packaging tools will fail processing the whole PyPI package index and this is a use case where processing the legacy past is a feature. For now I ended up coping with adding a https://github.com/nexB/pip-requirements-parser/blob/main/src/packaging_legacy_version.py for instance (as this would otherwise break pip-audit and scancode-toolkit) ... and I am considering either:
I am looking for help or ideas there 💡 ! |
I've said this elsewhere: folks are welcome to create a lnient-version library on PyPI that takes the LegacyVersion / LegacySpecifier objects from the last release as-is and makes it available for reuse. |
This comment was marked as resolved.
This comment was marked as resolved.
* Work around changes in packaging by replacing it with packvers to avoid issues with missing packaging.version.LegacyVersion. * Also bump the versions of dparse2 and pip-requirements-parser with new versions that are not subject the LegcacyVersion issue. * Adjust the code and tests accordingly. Reference: aboutcode-org#108 Reference: pypa/packaging#530 Signed-off-by: swastik <[email protected]>
* Work around changes in packaging by replacing it with packvers to avoid issues with missing packaging.version.LegacyVersion. * Also bump the versions of dparse2 and pip-requirements-parser with new versions that are not subject the LegcacyVersion issue. * Adjust the code and tests accordingly. Reference: aboutcode-org#108 Reference: pypa/packaging#530 Signed-off-by: swastik <[email protected]>
- this release does not add any new functionality nor modify existing functionality - **SUMMARY** - see commit 21bd027 for the initial attempt at fixing the upload error - this change fixed the upload error, but changed the functionality of `python_requires` since any `3.0.N` version of python would become incompatible with this change - see commit d3e02a7 for the proper fix to the original upload error while maintaining compatibility for any `3.0.N` version of python - **EXPLANATION (taken from pull request thread)** After doing some digging, this is the likely culprit for what caused this problem: - pypa/packaging#407 - which was the result of pypa/packaging#566 (related: pypa/packaging#530 and pypa/packaging#321) - which in turn looks like the result of the discussion at https://discuss.python.org/t/how-to-pin-a-package-to-a-specific-major-version-or-lower/17077/8 It looks like this is the expected behavior as defined in PEP 440 under the [Inclusive ordered comparison section](https://peps.python.org/pep-0440/#inclusive-ordered-comparison): > An inclusive ordered comparison clause includes a comparison operator and a version identifier, and will match any version where the comparison is correct based on the relative position of the candidate version and the specified version given the consistent ordering defined by the standard [Version scheme](https://peps.python.org/pep-0440/#version-scheme). Following the link to the [Version scheme](https://peps.python.org/pep-0440/#version-scheme) section and looking at the specification under the [Public version identifiers](https://peps.python.org/pep-0440/#public-version-identifiers) section: > The canonical public version identifiers MUST comply with the following scheme: > `[N!]N(.N)*[{a|b|rc}N][.postN][.devN]` > Public version identifiers MUST NOT include leading or trailing whitespace. > > Public version identifiers MUST be unique within a given distribution. > ... The last line included above seems to be the "loose implementation" of the version modifier that the issues and pull requests I linked to at the very top were discussing ("After doing some digging, this is the likely culprit for what caused this problem"). Once that "loose implementation" was fixed, any package that didn't follow the PEP 440 specification for version identifiers broke. In this package, the break occurred because of the `>=3.0.*` comparison, which IS NOT unique within a given distribution, as opposed to `>=3` (what commit d3e02a7 does), which IS unique within a given distribution. To clarify: it looks like the problem we see in this issue is because of implementation fixes in the packaging tools to more closely follow PEP 440, specifically **"Public version identifiers MUST be unique within a given distribution."** Any package that relied on the previous implementation that loosely verified the PEP 440 specification but did not strictly follow PEP 440 broke after the implementation of the packaging tool(s) were fixed to more closely follow PEP 440. More explicitly (from [this comment](https://discuss.python.org/t/how-to-pin-a-package-to-a-specific-major-version-or-lower/17077/8) on the [How to pin a package to a specific major version or lower](https://discuss.python.org/t/how-to-pin-a-package-to-a-specific-major-version-or-lower/17077) discussion): > Christopher already made the response I was going to make: for PEP 440 as written, using wildcards outside of “==” and “!=” comparisons isn’t valid. > > Allowing them for “>=” and “<=” would be reasonable, but it would involve a PEP to fix the spec. (It wasn’t a conscious choice to exclude them, we just didn’t notice at the time that the inclusive ordered comparison operators weren’t formally defined as combining an exclusive ordered comparison with a version match, so the tools have been written to ignore the wildcard instead of paying attention to it) > > Making a coherent definition wouldn’t be too hard: just ignore the wildcard for the exclusive ordered comparison part and keep it for the version matching part. Here are some other posts that aren't directly relevant, but might be interesting tangents for anyone interested in packaging problems: - https://stackoverflow.com/questions/19534896/enforcing-python-version-in-setup-py - https://packaging.python.org/en/latest/guides/distributing-packages-using-setuptools/#python-requires - https://packaging.python.org/en/latest/guides/distributing-packages-using-setuptools/#package-data - https://setuptools.pypa.io/en/latest/userguide/datafiles.html - https://peps.python.org/pep-0345/#requires-python - https://stackoverflow.com/questions/8795617/how-to-pip-install-a-package-with-min-and-max-version-range - https://python3statement.org/practicalities/ - https://discuss.python.org/t/requires-python-upper-limits/12663/20 - https://stackoverflow.com/questions/13924931/setup-py-restrict-the-allowable-version-of-the-python-interpreter/13925176#13925176
The lasting use of LeagacySpeifiers has detrimental impact on intuitive pipenv usability when parsing a Pipfile with a typo pypa/pipenv#4247.
|
This issue is an obvious follow up to #321. I'm mostly filing this to serve as the issue that the changelog points to, for coalescing the discussion/planning for this change into a single location, and for having the PR close an issue. :)
This "feature" has been deprecated (#321) for nearly two years as of April 2022.
PyPI has not permitted uploading packages with invalid versions for even more years. The latest versions of pip should be rejecting/erroring out on wheels with such versions as well. The stricter metadata validation helps pip's dependency resolver's logic, along with helping the broader ecology avoid needing to deal with outside-of-standard tooling/behaviours.
For users who might be impacted by this, they have hopefully caught this issue in (a) their test suites, (b) through the "warnings" presented during the execution of legacy code, during the deprecation period, or (c) as part of warnings presented by pip.
Users who encounter breakage due to this change can adopt the following broad strategy for dealing with it:
packaging
(or pip, if your error containspip._vendor.packaging
in the traceback), to deal with the immediate breakage.Requirement
,Version
orSpecifierSet
classes from this package, it can be used going forward. Notably, you won't be able to compare between legacy versions outside of the=== arbitrary-equality
operator.If there's anything we can do to help you catch these issues earlier, please write your suggestion in a comment with a 💡 emoji in it (
:bulb:
). :)The text was updated successfully, but these errors were encountered: