New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add high performance readVectored API #1072

Open

priyanshu-beep wants to merge 2 commits into GoogleCloudDataproc:master from priyanshu-beep:feature/vectored-io

priyanshu-beep commented Nov 7, 2023

Changes Made

Introduces a new high-performance readVectored API that optimizes data retrieval.
Smaller ranges are merged and sliced byte buffers are returned to the readers.
All merged ranges are asynchronously fetched from Google Cloud Storage (GCS).

Testing

Extensive unit testing has been conducted to validate the new API.
The functionality has been tested by substituting the JAR files within the cluster to utilize the newly added API.
Further testing was performed by running TPCH benchmarks to assess its performance and reliability.

priyanshu-beep and others added 2 commits

November 7, 2023 20:25


          add high performance readVectored API

7af652d


          Merge branch 'master' into feature/vectored-io

fc56c1a

Contributor

singhravidutt commented Apr 25, 2024

/gcbrun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet