Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(pipeline) : Ensure the zone_diffusion_codes for DROM/COM #288

Merged
merged 6 commits into from
Sep 19, 2024
Merged

feat(pipeline) : Ensure the zone_diffusion_codes for DROM/COM #288

merged 6 commits into from
Sep 19, 2024

Commits on Sep 19, 2024

  1. feat(pipeline) : Ensure the zone_diffusion_codes for DROM/COM 

    There were cases where we did have the zone_diffusion_code set to "97"
which can't be right, as it would mean that a given service coyuld be
available across the oceans.

Let's fix it and set the correct, 3-digit department number.

This will also enable their search as we now (since the "new" communes)
search for a match agains commune.departement, which can be 3 digits.

There is also now a complete data validation that leaves the errors as a
specific table in the public_dbt_test__audit schema.
    @vperron @vmttn
    vperron authored and vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    3107741 View commit details
    Browse the repository at this point in the history

  2. chore(pipeline): cleanup model configs

    @vmttn
    vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f59b672 View commit details
    Browse the repository at this point in the history

  3. test(pipeline): store all failures

    @vmttn
    vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    8de3feb View commit details
    Browse the repository at this point in the history

  4. chore(pipeline): add tests on geo data

    @vmttn
    vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    474fd3f View commit details
    Browse the repository at this point in the history

  5. chore(pipeline): add indexes on geo data

    @vmttn
    vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    3b84a63 View commit details
    Browse the repository at this point in the history

  6. chore(pipeline): remove bad zone diffusion codes

    @vmttn
    vmttn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    e8ffb87 View commit details
    Browse the repository at this point in the history