ci: automate package version updates

[quinna-h]

• Calls scripts/freshvenvs to generate a list of "outdated" packages (packages where we don't test the full range from MIN_SUPPORTED_VERSION to MAX_SUPPORTED_VERSION)
• Automate regenerating riot requirements.txt files for each out-of-date packages
• Gets called in GH workflow weekly cron job
  - Can adjust frequency / time - currently Sunday midnight
• TODO: open a new PR for every venv with outdated versions - right now it stops at one.

Testing:

Github Actions workflows: https://github.com/DataDog/dd-trace-py/actions/workflows/generate-package-versions.yml
Example PR: #10333

Checklist

• PR author has checked that all the criteria below are met
• The PR description includes an overview of the change
• The PR description articulates the motivation for the change
• The change includes tests OR the PR description describes a testing strategy
• The PR description notes risks associated with the change, if any
• Newly-added code is easy to change
• The change follows the library release note guidelines
• The change includes or references documentation updates if necessary
• Backport labels are set (if applicable)

Reviewer Checklist

• Reviewer has checked that all the criteria below are met
• Title is accurate
• All changes are related to the pull request's stated goal
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Newly-added code is easy to change
• Release note makes sense to a user of the library
• If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[github-actions]

CODEOWNERS have been resolved as:

.github/workflows/generate-package-versions.yml                         @DataDog/python-guild @DataDog/apm-core-python
scripts/freshvenvs.py                                                   @DataDog/apm-core-python
scripts/regenerate-riot-latest.sh                                       @DataDog/apm-core-python

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-08-23 17:32:13

Comparing candidate commit 0af3eb6 in PR branch quinna.halim/regenerate-riot-latests with baseline commit 05b2bbe in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 214 metrics, 2 unstable metrics.

[romainkomorndatadog]

Logic makes sense to me. I have a couple of non-blocking nits.

[P403n1x87]

just a few nits

[emmettbutler]

This is great progress. I mentioned a bit of complexity that will need to be addressed, but I don't think it needs to happen before this change is merged.

[bouwkast]

Great work!

(Defer to the python experts for python code review 😄)

I just had a few nitpicks on the generated PR title/body - real small stuff