Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tune http logs workload params for remote store nightly runs #3948

Merged
merged 1 commit into from
Aug 31, 2023

Conversation

ashking94
Copy link
Member

@ashking94 ashking94 commented Aug 31, 2023

Description

This tunes the workload params that are passed during the nightly perf runs for http logs workload for the nighly runs. Summary of the changes -

  • remote translog buffer interval changed to 250 ms : This interval is time for which the translog upload is buffered and performed periodically.
  • refresh interval 10s : We propose to increase the refresh interval to higher number since a round of segment replication using remote store requires certain duration. With 10s, a user would be certain to have the docs refreshed on replica as well.
  • bulk indexing client doubled - This has been done to allow more number of calls to be made to remote store enabled cluster. A remote enabled index gives request level durability to the user by acknowledging a write request only after it has been persisted durably on remote store. With it, it also leads to higher latency for workloads which have very low end to end latency (150-200ms was the p50 during the OSB runs that I observed). This leads to lesser throughput as the cluster is not getting exposed to enough concurrency and stays much below in terms of cpu in comparison to segrep or docrep run clusters.
  • bulk size changed to 20K - this allows the remote upload buffering to be more optimal.

Issues Resolved

None

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@codecov
Copy link

codecov bot commented Aug 31, 2023

Codecov Report

Merging #3948 (7e55d6a) into main (4743a92) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #3948   +/-   ##
=======================================
  Coverage   92.06%   92.06%           
=======================================
  Files         187      187           
  Lines        5669     5669           
=======================================
  Hits         5219     5219           
  Misses        450      450           

@rishabh6788 rishabh6788 merged commit 7232a94 into opensearch-project:main Aug 31, 2023
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants