Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.17] Add support to upload snapshot shard blobs with hashed prefix #15649

Merged
merged 5 commits into from
Sep 4, 2024

Conversation

ashking94
Copy link
Member

Backport c308b98 from #15426.
Backport 4c98c7e from #15559.
Backport 758c2aa from #15560.

…arch-project#15426)

* Add snapshot shard blobs with hashed prefix

Signed-off-by: Ashish Singh <[email protected]>

* Add UTs

Signed-off-by: Ashish Singh <[email protected]>

* Address comments and add UTs

Signed-off-by: Ashish Singh <[email protected]>

* Change default snapshot shard path type to hashed_prefix for testing

Signed-off-by: Ashish Singh <[email protected]>

* Fix failing tests

Signed-off-by: Ashish Singh <[email protected]>

* Introduce single method for all create/put repository calls

Signed-off-by: Ashish Singh <[email protected]>

* Move the index shard path upload to sync upload

Signed-off-by: Ashish Singh <[email protected]>

* Fix spotless errors

Signed-off-by: Ashish Singh <[email protected]>

* Do minor code refactor

Signed-off-by: Ashish Singh <[email protected]>

* Fix tests

Signed-off-by: Ashish Singh <[email protected]>

* More tests to use common methods for repo creation

Signed-off-by: Ashish Singh <[email protected]>

* Address comments and fix multiple failing tests

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>
@ashking94 ashking94 changed the title [Backport 2.x] Add support to upload snapshot shard blobs with hashed prefix [Backport 2.17] Add support to upload snapshot shard blobs with hashed prefix Sep 4, 2024
Copy link
Contributor

github-actions bot commented Sep 4, 2024

❌ Gradle check result for f67be03: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Sep 4, 2024

❌ Gradle check result for 00da4f3: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Sep 4, 2024

✅ Gradle check result for 00da4f3: SUCCESS

Copy link

codecov bot commented Sep 4, 2024

Codecov Report

Attention: Patch coverage is 72.48521% with 93 lines in your changes missing coverage. Please review.

Project coverage is 71.67%. Comparing base (3f95aa2) to head (00da4f3).
Report is 3 commits behind head on 2.17.

Files with missing lines Patch % Lines
...ch/repositories/blobstore/BlobStoreRepository.java 71.24% 58 Missing and 9 partials ⚠️
...ava/org/opensearch/snapshots/SnapshotsService.java 30.00% 6 Missing and 1 partial ⚠️
...a/org/opensearch/snapshots/SnapshotShardPaths.java 85.36% 3 Missing and 3 partials ⚠️
...mote/directory/RemoteSnapshotDirectoryFactory.java 0.00% 5 Missing ⚠️
...main/java/org/opensearch/repositories/IndexId.java 73.33% 1 Missing and 3 partials ⚠️
...va/org/opensearch/repositories/RepositoryData.java 76.92% 1 Missing and 2 partials ⚠️
...arch/index/recovery/RemoteStoreRestoreService.java 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               2.17   #15649      +/-   ##
============================================
+ Coverage     71.62%   71.67%   +0.04%     
- Complexity    63996    64107     +111     
============================================
  Files          5248     5249       +1     
  Lines        299513   299749     +236     
  Branches      43609    43638      +29     
============================================
+ Hits         214524   214840     +316     
+ Misses        67022    66921     -101     
- Partials      17967    17988      +21     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@gbbafna gbbafna merged commit 63524e3 into opensearch-project:2.17 Sep 4, 2024
35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants