Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.x] Change default batch size of bulk API to Integer.MAX_VALUE #14881

Merged
merged 2 commits into from
Jul 23, 2024

Conversation

opensearch-trigger-bot[bot]
Copy link
Contributor

Backport 97f26cc from #14725.

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
(cherry picked from commit 97f26cc)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Copy link
Contributor

❌ Gradle check result for 50d32ab: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

❌ Gradle check result for 50d32ab: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@dblock
Copy link
Member

dblock commented Jul 22, 2024

2024-07-22T21:43:09.9282635Z /home/runner/work/OpenSearch/OpenSearch/server/src/test/java/org/opensearch/ingest/IngestServiceTests.java:1988: error: cannot find symbol
2024-07-22T21:43:09.9284554Z 
2024-07-22T21:43:09.9285829Z         final List<Integer> dropHandler = new ArrayList<>();
2024-07-22T21:43:09.9286997Z                                               ^
2024-07-22T21:43:09.9288157Z   symbol:   class ArrayList
2024-07-22T21:43:09.9289050Z   location: class IngestServiceTests
2024-07-22T21:43:09.9290046Z > Task :server:compileTestJava

@dblock
Copy link
Member

dblock commented Jul 22, 2024

Doesn't look like a fluke, @chishui

@chishui
Copy link
Contributor

chishui commented Jul 23, 2024

@dblock import java.util.ArrayList; is missing in 2.x but in main, but I don't have permission to update backport PR, is it possible that you can help add this line to the file or grant me permission to this PR?

Signed-off-by: Gao Binlong <[email protected]>
Copy link
Contributor

❌ Gradle check result for 0a97145: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

✅ Gradle check result for 0a97145: SUCCESS

Copy link

codecov bot commented Jul 23, 2024

Codecov Report

Attention: Patch coverage is 75.00000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 71.56%. Comparing base (7e7e775) to head (0a97145).
Report is 8 commits behind head on 2.x.

Files Patch % Lines
...pensearch/rest/action/document/RestBulkAction.java 50.00% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##                2.x   #14881      +/-   ##
============================================
- Coverage     71.59%   71.56%   -0.04%     
+ Complexity    62621    62537      -84     
============================================
  Files          5110     5110              
  Lines        293685   293651      -34     
  Branches      42801    42791      -10     
============================================
- Hits         210265   210151     -114     
- Misses        65801    65851      +50     
- Partials      17619    17649      +30     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@gaobinlong gaobinlong merged commit ed24a14 into 2.x Jul 23, 2024
32 checks passed
@gaobinlong gaobinlong deleted the backport/backport-14725-to-2.x branch July 23, 2024 06:43
kkewwei pushed a commit to kkewwei/OpenSearch that referenced this pull request Jul 24, 2024
…ALUE (opensearch-project#14881)

* Deprecate batch_size parameter on bulk API (opensearch-project#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
(cherry picked from commit 97f26cc)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Gao Binlong <[email protected]>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gao Binlong <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants