Upgrade python package detection

[AyanSinhaMahapatra]

• Add pyproject.toml support SCTK: Detect pyproject.toml correctly #3753
• Add poetry support SCTK: Parse Python poetry lockfile and manifest  #2109
• Improve python package assembly
• Add support for pip-inspect.deplock files SCIO: Detect frozen Python requirements locked with deplock scancode.io#1262

Fixes #3753

Tasks

• Reviewed contribution guidelines
• PR is descriptively titled 📑 and links the original issue above 🔗
• Tests pass -- look for a green checkbox ✔️ a few minutes after opening your PR
  Run tests locally to check for errors.
• Commits are in uniquely-named feature branch and has no merge conflicts 📁
• Updated documentation pages (if applicable)
• Updated CHANGELOG.rst (if applicable)

[keshav-space]

Thanks @AyanSinhaMahapatra. LGTM!
For some reason macos-13 CIs are failing.

[AyanSinhaMahapatra]

We are failing tests in two places:

1. tests which require linux specific configuration it seems, like rpm. Maybe this is because we don't install them in macos specific cases? Like at c06705c @pombredanne need your input here. [Edit, this might actually be the heisenbug we often get, I forgot about that actually]
2. @keshav-space you added a removesuffix() method on a string but this is only available python 3.9+ it seems. See https://dev.azure.com/nexB/scancode-toolkit/_build/results?buildId=13829&view=logs&j=3dfa68ff-d50a-53ee-7b58-12d58c76da63&t=1b7369b2-e2fc-5889-2082-a49dded9cbd4&l=7020 and https://stackoverflow.com/questions/66683630/removesuffix-returns-error-str-object-has-no-attribute-removesuffix. I'm not sure why this only fails in macos13 though. 🤔

[keshav-space]

1. tests which require linux specific configuration it seems, like rpm. Maybe this is because we don't install them in macos specific cases?

Maybe we should skip these tests on macOS?

2. @keshav-space you added a removesuffix() method on a string but this is only available python 3.9+ it seems. See https://dev.azure.com/nexB/scancode-toolkit/_build/results?buildId=13829&view=logs&j=3dfa68ff-d50a-53ee-7b58-12d58c76da63&t=1b7369b2-e2fc-5889-2082-a49dded9cbd4&l=7020 and https://stackoverflow.com/questions/66683630/removesuffix-returns-error-str-object-has-no-attribute-removesuffix. I'm not sure why this only fails in macos13 though. 🤔

Ah, I missed that we're still supporting 3.8 :)

[AyanSinhaMahapatra]

Thanks @keshav-space , merging! This seems like the heisenbug, I will deal with this seperately if this persists.