Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Creating big query tables for perf tests - 3 #1450

Merged
merged 64 commits into from
Nov 1, 2023
Merged

Creating big query tables for perf tests - 3 #1450

merged 64 commits into from
Nov 1, 2023

Commits on Oct 10, 2023

  1. Fix DiffFiles utility function 

    1. It chunkifies DiffFiles utility function.
This rationalizes the memory requirement
of file-op of this utility. This utility
earlier used to the read the complete files
in memory, but now only a chunk is read and
compared at a time.

2. Rename DiffFiles to AreFilesIdentical

Renames file-op utility DiffFiles to AreFilesIdentical
and changes it to return bool instead of int.
    @gargnitingoogle
    gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    a01390d View commit details
    Browse the repository at this point in the history

  2. Copying logs on kokoro artifacts incase of integration test failure. (#… 

    …1380)

* adding print log file statement

* failure test

* testing error

* undo testing changes

* formating

* fix comment

* adding test error

* small fix

* small fix

* testing

* adding action artifacts

* small fix

* small fix

* removing error statement

* testing

* testing

* testing

* undo changes

* undo testing changes

* fixing comments
    @Tulsishah @gargnitingoogle
    Tulsishah authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    7f16488 View commit details
    Browse the repository at this point in the history

  3. Upgrading go version from 1.21.0 to 1.21.1 (#1401) 

    * Upgrading go version to 1.21.1

* Temp changes to run perf/integration test

* Revert "Temp changes to run perf/integration test"

This reverts commit 18dd533.
    @raj-prince @gargnitingoogle
    raj-prince authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    d38a7f1 View commit details
    Browse the repository at this point in the history

  4. Updating semantics docs (#1407)

    @raj-prince @gargnitingoogle
    raj-prince authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    bf09c7c View commit details
    Browse the repository at this point in the history

  5. Print stack-trace on crash 

    For now, it just prints stack-trace
whenever anyone calls logger.Fatalf(...).
This needs to be enhanced further to
include more scenarios (i.e. more
sources of crashes).
    @gargnitingoogle
    gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    241e4c1 View commit details
    Browse the repository at this point in the history

  6. Throw error in case of unexpected fields (#1416) 

    Also, improved the doc for config-file.
    @sethiay @gargnitingoogle
    sethiay authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    14736a2 View commit details
    Browse the repository at this point in the history

  7. Upgraded the fuse library (#1419)

    @raj-prince @gargnitingoogle
    raj-prince authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    f11347a View commit details
    Browse the repository at this point in the history

  8. add "create-empty-file: true" tests to run_tests_mounted_directory.sh (… 

    …#1413)
    @ashmeenkaur @gargnitingoogle
    ashmeenkaur authored and gargnitingoogle committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    5fba84e View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Upgrade golang from 1.21.1 to 1.21.2 (#1431) 

    Upgrade from golang 1.21.1 to 1.21.2
    @gargnitingoogle
    gargnitingoogle authored Oct 12, 2023
    Configuration menu
    Copy the full SHA
    7448f21 View commit details
    Browse the repository at this point in the history

  2. Update yaml package version from v2 to v3 in integration tests (#1434) 

    * update go yaml package version from v2 to v3 in integration tests

* Empty-Commit
    @ashmeenkaur
    ashmeenkaur authored Oct 12, 2023
    Configuration menu
    Copy the full SHA
    0ae1b1f View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Passing gcsfuse flags from build.sh to mount the test bucket for perf… ( 

    #1430)

* Passing gcsfuse flags from build.sh to mount the test bucket for performing list benchmarking

* removing __pycache

* small fix

* small fix

* unmount after fio tests

* small fix

* empty commit

* testing kokoro perf tests

* undo testing changes

* adding upload flag

* small fix

* small fix

* upload to upload_gs

* unnecessary change
    @Tulsishah
    Tulsishah authored Oct 13, 2023
    Configuration menu
    Copy the full SHA
    1a5db44 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. adding big query table setup

    @Tulsishah
    Tulsishah committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    8ac2103 View commit details
    Browse the repository at this point in the history

  2. changes for small pr

    @Tulsishah
    Tulsishah committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    7a7afbd View commit details
    Browse the repository at this point in the history

  3. adding requirements and setup scripts

    @Tulsishah
    Tulsishah committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    ebb0d61 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. indentation fix

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    cd50167 View commit details
    Browse the repository at this point in the history

  2. removing unnecessary changes

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    5e988ea View commit details
    Browse the repository at this point in the history

  3. adding start build time

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    62d439b View commit details
    Browse the repository at this point in the history

  4. adding requirements and setup scripts

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    caab8cb View commit details
    Browse the repository at this point in the history

  5. python file changes

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    2953cb7 View commit details
    Browse the repository at this point in the history

  6. small fix

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    1f9d7d4 View commit details
    Browse the repository at this point in the history

  7. testing

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    59d321d View commit details
    Browse the repository at this point in the history

  8. testing gsheet upload

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    bc02e85 View commit details
    Browse the repository at this point in the history

  9. perfmetrics/scripts/ls_metrics/listing_benchmark.py

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    628e303 View commit details
    Browse the repository at this point in the history

  10. testing

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    1f7f219 View commit details
    Browse the repository at this point in the history

  11. removing unnecessary changes

    @Tulsishah
    Tulsishah committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    7bbf477 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. Creating big query tables for perf tests - 1 (#1444) 

    * adding big query table setup

* changes for small pr

* indentation fix

* removing unnecessary changes

* adding start build time
    @Tulsishah
    Tulsishah authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    791ba58 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'nov_2023_release' into create_big_query_tables_2

    @Tulsishah
    Tulsishah authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    5587485 View commit details
    Browse the repository at this point in the history

  3. changes for small pr

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    53ee6be View commit details
    Browse the repository at this point in the history

  4. indentation fix

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    9b5753b View commit details
    Browse the repository at this point in the history

  5. removing unnecessary changes

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    47cef50 View commit details
    Browse the repository at this point in the history

  6. adding requirements and setup scripts

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d9fbbdf View commit details
    Browse the repository at this point in the history

  7. merge with parent

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    7bee459 View commit details
    Browse the repository at this point in the history

  8. testing

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4d5861f View commit details
    Browse the repository at this point in the history

  9. testing gsheet upload

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c503213 View commit details
    Browse the repository at this point in the history

  10. merge with parent

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c4c415e View commit details
    Browse the repository at this point in the history

  11. removing unnecessary changes

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b9a7d2d View commit details
    Browse the repository at this point in the history

  12. merge

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    1fb946b View commit details
    Browse the repository at this point in the history

  13. fixing requirements.in

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    618c570 View commit details
    Browse the repository at this point in the history

  14. merge with parent

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    1629dd2 View commit details
    Browse the repository at this point in the history

  15. Creating big query tables for perf tests - 2 (#1445) 

    * adding big query table setup

* changes for small pr

* adding requirements and setup scripts

* fixing requirements.in
    @Tulsishah
    Tulsishah authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    157af46 View commit details
    Browse the repository at this point in the history

  16. merge

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    826634d View commit details
    Browse the repository at this point in the history

  17. merge

    @Tulsishah
    Tulsishah committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    60c5654 View commit details
    Browse the repository at this point in the history

  18. Merge branch 'nov_2023_release' into create_big_query_tables_3

    @Tulsishah
    Tulsishah authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e219dc0 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. small fixes

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    5d893e9 View commit details
    Browse the repository at this point in the history

  2. small fixes

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    0e648bf View commit details
    Browse the repository at this point in the history

  3. small fix

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    e2a999e View commit details
    Browse the repository at this point in the history

  4. undo testing changes

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    d7305a2 View commit details
    Browse the repository at this point in the history

  5. formating

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    da0b7ab View commit details
    Browse the repository at this point in the history

  6. testing changes

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2f1b768 View commit details
    Browse the repository at this point in the history

  7. undo testing changes

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    31c45df View commit details
    Browse the repository at this point in the history

  8. remove unnecessary functions

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    41e62b1 View commit details
    Browse the repository at this point in the history

  9. fixing indentation

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    f743ad2 View commit details
    Browse the repository at this point in the history

  10. small fix

    @Tulsishah
    Tulsishah committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6b324af View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Merge branch 'master' into create_big_query_tables_3

    @Tulsishah
    Tulsishah authored Oct 26, 2023
    Configuration menu
    Copy the full SHA
    cbb88c7 View commit details
    Browse the repository at this point in the history

  2. adding testing changes

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    f7de439 View commit details
    Browse the repository at this point in the history

  3. small fix

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    93166fa View commit details
    Browse the repository at this point in the history

  4. undo testing changes

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    3497883 View commit details
    Browse the repository at this point in the history

  5. formating

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    fb9f165 View commit details
    Browse the repository at this point in the history

  6. fixing unit tests

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    794118b View commit details
    Browse the repository at this point in the history

  7. formatting

    @Tulsishah
    Tulsishah committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    cd03358 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. merge with master

    @Tulsishah
    Tulsishah committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    fbdad0d View commit details
    Browse the repository at this point in the history

  2. merge with master

    @Tulsishah
    Tulsishah committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    c26b6cc View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. fixing commets and adding test changes

    @Tulsishah
    Tulsishah committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    6e4a05e View commit details
    Browse the repository at this point in the history

  2. undo testing changes

    @Tulsishah
    Tulsishah committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    48367ad View commit details
    Browse the repository at this point in the history