Update datasets requirement from <3,>=2.4 to >=2.4,<4

[dependabot]

Updates the requirements on datasets to permit the latest version.

Release notes

Sourced from datasets's releases.

3.0.0

Dataset Features

• Use Polars functions in .map()

  • Allow Polars as valid output type by @​psmyth94 in huggingface/datasets#6762

  • Example:

    >>> from datasets import load_dataset
    >>> ds = load_dataset("lhoestq/CudyPokemonAdventures", split="train").with_format("polars")
    >>> cols = [pl.col("content").str.len_bytes().alias("length")]
    >>> ds_with_length = ds.map(lambda df: df.with_columns(cols), batched=True)
    >>> ds_with_length[:5]
    shape: (5, 5)
    ┌─────┬───────────────────────────────────┬───────────────────────────────────┬───────────────────────┬────────┐
    │ idx ┆ title                             ┆ content                           ┆ labels                ┆ length │
    │ --- ┆ ---                               ┆ ---                               ┆ ---                   ┆ ---    │
    │ i64 ┆ str                               ┆ str                               ┆ str                   ┆ u32    │
    ╞═════╪═══════════════════════════════════╪═══════════════════════════════════╪═══════════════════════╪════════╡
    │ 0   ┆ The Joyful Adventure of Bulbasau… ┆ Bulbasaur embarked on a sunny qu… ┆ joyful_adventure      ┆ 180    │
    │ 1   ┆ Pikachu's Quest for Peace         ┆ Pikachu, with his cheeky persona… ┆ peaceful_narrative    ┆ 138    │
    │ 2   ┆ The Tender Tale of Squirtle       ┆ Squirtle took everyone on a memo… ┆ gentle_adventure      ┆ 135    │
    │ 3   ┆ Charizard's Heartwarming Tale     ┆ Charizard found joy in helping o… ┆ heartwarming_story    ┆ 112    │
    │ 4   ┆ Jolteon's Sparkling Journey       ┆ Jolteon, with his zest for life,… ┆ celebratory_narrative ┆ 111    │
    └─────┴───────────────────────────────────┴───────────────────────────────────┴───────────────────────┴────────┘

• Support NumPy 2
  • Allow numpy-2.1 and test it without audio extra by @​albertvillanova in huggingface/datasets#7118

Cache Changes

• Use huggingface_hub cache by @​lhoestq in huggingface/datasets#7105
  • use the huggingface_hub cache for files downloaded from HF, by default at ~/.cache/huggingface/hub
  • cached datasets (Arrow files) will still be reloaded from the datasets cache, by default at ~/.cache/huggingface/datasets

Breaking changes

• Remove deprecated code by @​albertvillanova in huggingface/datasets#6996
  • removed deprecated arguments like use_auth_token, fs or ignore_verifications
• Remove beam by @​albertvillanova in huggingface/datasets#6987
  • removed deprecated apache beam datasets support
• Remove metrics by @​albertvillanova in huggingface/datasets#6983
  • remove deprecated load_metric, please use the evaluate library instead
• Remove tasks by @​albertvillanova in huggingface/datasets#6999
  • remove deprecated task argument in load_dataset() .prepare_for_task() method, datasets.tasks module

General improvements and bug fixes

• Improved the tutorial by adding a link for loading datasets by @​AmboThom in huggingface/datasets#7042
• Automatically create cache_dir from cache_file_name by @​ringohoffman in huggingface/datasets#7096
• remove more script docs by @​lhoestq in huggingface/datasets#7104
• Fix args of feature docstrings by @​albertvillanova in huggingface/datasets#7103
• Temporarily pin numpy<2.1 to fix CI by @​albertvillanova in huggingface/datasets#7114
• Fix ConnectionError for gated datasets and unauthenticated users by @​albertvillanova in huggingface/datasets#7110

... (truncated)

Commits

• 3505ed9 Release: 3.0.0 (#7145)
• ca58154 fix streaming from arrow files (#7083)
• be5cff0 Test get_dataset_config_info with non-existing/gated/private dataset (#7124)
• e4c87a6 Disable implicit token in CI (#7126)
• 880a52c Fix wrong SHA in CI tests of HubDatasetModuleFactoryWithParquetExport (#7125)
• 88f646c Rename LargeList.dtype to LargeList.feature (#7106)
• 3813ce8 Fix typed examples iterable state dict (#7121)
• cedffa5 don't mention the script if trust_remote_code=False (#7120)
• 2878019 Use huggingface_hub cache (#7105)
• 70bac27 Install transformers with numpy-2 CI (#7119)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[mvpatel2000]

LGTM, @dakinggg any objections

[mvpatel2000]

Da King has approved