Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: support for gcs storage #520

Merged
merged 19 commits into from
Aug 14, 2024
Merged

feat: support for gcs storage #520

merged 19 commits into from
Aug 14, 2024

Commits on Aug 2, 2024

  1. chore: include opendal/services-gcs

    @jdockerty
    jdockerty committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    6abab33 View commit details
    Browse the repository at this point in the history

  2. feat: basic gcs scaffolding

    @jdockerty
    jdockerty committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    4b86f54 View commit details
    Browse the repository at this point in the history

  3. feat: populate config parse with basic details

    @jdockerty
    jdockerty committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    10a124d View commit details
    Browse the repository at this point in the history

  4. feat: include docker-compose integration tests

    @jdockerty
    jdockerty committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    d5a009e View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. feat: add extra iceberg properties

    @jdockerty
    jdockerty committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    ab2eb6f View commit details
    Browse the repository at this point in the history

  2. feat: add tests for gcs read/write 

    These are currently conditional tests with a todo comment using the
test_with proc macro. More work needs to be done on
investigating/potentially expanding OpenDAL to allow unauthenticated
requests to fake-gcs-server. At the moment this always ends up reaching
the final VM metadata check.
    @jdockerty
    jdockerty committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    6a595c9 View commit details
    Browse the repository at this point in the history

  3. chore: minor cleanup for compose todo

    @jdockerty
    jdockerty committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    3a2f166 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. fix: do not introduce new properties

    @jdockerty
    jdockerty committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    0900c15 View commit details
    Browse the repository at this point in the history

  2. feat: infer bucket from path

    @jdockerty
    jdockerty committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    5e171cc View commit details
    Browse the repository at this point in the history

  3. chore: add user-project const

    @jdockerty
    jdockerty committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    f741055 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. feat: add allow_anonymous for test

    @jdockerty
    jdockerty committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    30f90d1 View commit details
    Browse the repository at this point in the history

  2. chore: remove test-with dep

    @jdockerty
    jdockerty committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    6fa4b77 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. feat: update with allow_anonymous functionality 

    This requires the opendal allow_anonymous funcitonality with the GCS
service to work.
    @jdockerty
    jdockerty committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    c9f7c64 View commit details
    Browse the repository at this point in the history

  2. ci: use cargo sort

    @jdockerty
    jdockerty committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    e4e7dad View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. chore: undo storage-gcs default feature

    @jdockerty
    jdockerty committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    5284405 View commit details
    Browse the repository at this point in the history

  2. feat: include disable_ params for GCS_NO_AUTH

    @jdockerty
    jdockerty committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    7f2e8d8 View commit details
    Browse the repository at this point in the history

  3. ci: use storage-all for async-std tests

    @jdockerty
    jdockerty committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    f44cc97 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. chore: merge branch 'main' into feat/storage-backend-gcs

    @jdockerty
    jdockerty committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    9cbcb8e View commit details
    Browse the repository at this point in the history

  2. revert: use opendal from workspace 

    Now that v0.49 has been released, this work does not need to pin to a
particular version!
    @jdockerty
    jdockerty committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    3ab0a37 View commit details
    Browse the repository at this point in the history