Split atmospheric products by variables and time

[jlahovnik]

• adds the "split configuration" for wekeo, cop cds, cop ads and ecmwf providers
• splitting is added for the cds and ecmwf api plugin and data request search plugin
• products can be split by year or by month (currently one month configured for all providers)
• splitting by additional parameters (e.g. leadtime hour) also possible
• one asset per selected/available parameter is created
• handling of constraints with either select boxes for year, month, day or date ranges available

[github-actions]

Test Results

       4 files  ±  0         4 suites  ±0   3m 33s ⏱️ ±0s
   447 tests +15     444 ✔️ +15    3 💤 ±0  0 ❌ ±0 
1 788 runs  +60  1 712 ✔️ +60  76 💤 ±0  0 ❌ ±0 

Results for commit e1a315f. ± Comparison against base commit a3f8296.

♻️ This comment has been updated with latest results.

[github-actions]

Code Coverage (Ubuntu)

File	Coverage
All files	81%	✅

Minimum allowed coverage is 70%

Generated by 🐒 cobertura-action against e1a315f

[github-actions]

Code Coverage (Windows)

File	Coverage
All files	76%	✅

Minimum allowed coverage is 70%

Generated by 🐒 cobertura-action against e1a315f

[alambare]

@jlahovnik can you rebase this PR and resolve the conflicts ?

[sbrunato]

please add a new cached_requests_get in eodag.utils and use it in request_splitter to speedup multiple requests to the same url

[sbrunato]

please add a new cached_requests_get in eodag.utils and use it in request_splitter to speedup multiple requests to the same url

done

[sbrunato]

Please

• rename product_data to product_type_conf
• rename provider_product to provider_product_type
• replace hard-coded "dataset" with a new provider setting: <provider>.search.metadata_mapping.providerProductType: $.dataset
• rename constraints_param setting to constraints_entry
• do not use any server_mode parameter, and directly use assets instead of downloadLinks in server mode
• http://127.0.0.1:5000/catalogs/CAMS_GACF_MR/year/2021/items responds fast but http://127.0.0.1:5000/catalogs/CAMS_GACF_MR/items hangs forever
• use HTTP_REQ_TIMEOUT for constraints request
• in server mode, use {item}/download/{variable} pattern for assets href

[jlahovnik]

Please

* [x]  rename `product_data` to `product_type_conf`

* [x]  rename `provider_product` to `provider_product_type`

* [ ]  replace hard-coded `"dataset"` with a new provider setting: `<provider>.search.metadata_mapping.providerProductType: $.dataset`

* [x]  rename `constraints_param` setting to `constraints_entry`

* [ ]  do not use any `server_mode` parameter, and directly use `assets` instead of `downloadLinks` in server mode

* [ ]  http://127.0.0.1:5000/catalogs/CAMS_GACF_MR/year/2021/items responds fast but http://127.0.0.1:5000/catalogs/CAMS_GACF_MR/items hangs forever

* [x]  use `HTTP_REQ_TIMEOUT` for constraints request

* [ ]  in server mode, use `{item}/download/{variable}` pattern for assets `href`

renaming of variables done, timeout added
I don't understand the 3rd point. Where should that change be done?

[jlahovnik]

issue with http://127.0.0.1:5000/catalogs/CAMS_GACF_MR/items request is fixed