Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation for mpio driver with selection I/O. #3058

Closed
wants to merge 46 commits into from

Commits on Jun 6, 2023

  1. Implementation for mpio driver with selection I/O.

    This is a draft for preliminary review.
    vchoi-hdfgroup committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    3168cae View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d298b10 View commit details
    Browse the repository at this point in the history
  3. Correct CI errors.

    vchoi-hdfgroup committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    02adecf View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6180c41 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    96e11a5 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Configuration menu
    Copy the full SHA
    e655a8f View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Configuration menu
    Copy the full SHA
    045b313 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2023

  1. Configuration menu
    Copy the full SHA
    a64ca62 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Configuration menu
    Copy the full SHA
    d383ad3 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Configuration menu
    Copy the full SHA
    ae4cf79 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. Configuration menu
    Copy the full SHA
    28d3774 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Configuration menu
    Copy the full SHA
    7359426 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Configuration menu
    Copy the full SHA
    7c3c746 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Fix use_vector on read/write_vector() != NULL and skip_vector_cb.

    This is in response to one of the PR review comments.
    vchoi-hdfgroup committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    9c1f825 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    046a9eb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ec50a83 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. 1) Restore link_piece_collective_io() back to its original state in H…

    …5Dmpio.c
    
    (with the frees of the arrays moved to before the IO)
    2) Move H5FD_selection_build_types() to H5FDmpio.c
    This is in response to one of the PR review comments.
    vchoi-hdfgroup committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    11e9fe6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    40e572a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5fb29a5 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5bbdadd View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    bbf78af View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    fbf7f47 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    5bb536f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    6a37764 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    564fe53 View commit details
    Browse the repository at this point in the history
  10. This is the fix for a failure from one of the tests in testpar/t_2Gio…

    ….c when selection I/O is ON by default in the library.
    
    a) Create internal functions H5FD_read/write_vector_from_selection() and H5FD_read/write_from_selection() that correspond to the 4 new APIs H5FDread/write_vector_from_selection() and H5FDread/write_from_selection().
    --Call the internal functions H5FD_read/write_vector_from_selection in H5FD__mpio_read/write_selection() for independent xfer_mode.
    vchoi-hdfgroup committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    4c0fe6c View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    d62be34 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    61df96f View commit details
    Browse the repository at this point in the history
  13. This is the fix for the test failure from running testpar/t_pread.c

    when selection I/O is ON by default in the library.
    --Undo the base address addition in internal routines before passing down to the mpio driver
    vchoi-hdfgroup committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    081ebf6 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    a90f382 View commit details
    Browse the repository at this point in the history
  15. This is the fix for a failure from dataset_writeAll() test in testpar…

    …/t_dsets.c (via testpar/testphdf5.c)
    
    when selection I/O is ON by default in the library:
    --need to check for fixed bufs when trying to figure out mpi_bufs_base in H5FD__selection_build_types().
    vchoi-hdfgroup committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    3a12e6c View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    35f9fed View commit details
    Browse the repository at this point in the history
  17. Fix CI errors.

    vchoi-hdfgroup committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    7052ecd View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    1c4d042 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    d03c4b1 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Corrections to the previous fix and commit message:

    This is the fix for a failure from test_link_chunk_io_sort_chunk_issue() test in
    testpar/t_coll_md.c (via testpar/testphdf5.c) when selection I/O is ON by default
    in the library:
    --need to check for fixed bufs when trying to figure out mpi_bufs_base in H5FD__selection_build_types().
    vchoi-hdfgroup committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    e962b8e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3d3b88f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9e47124 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5ca9b55 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d34769c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    48d3304 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    853fed6 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. Configuration menu
    Copy the full SHA
    93cd897 View commit details
    Browse the repository at this point in the history
  2. Rename HDsystem() to system() (HDFGroup#3197)

    system() is only used in the iopipe test and the things it calls
    (which are POSIX-y) are protected by an ifdef.
    derobins authored and vchoi-hdfgroup committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    ebd95ae View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0e306c2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1f8903d View commit details
    Browse the repository at this point in the history