Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pack/Unpack data for user-data #1224

Open
wants to merge 74 commits into
base: main
Choose a base branch
from
Open

Pack/Unpack data for user-data #1224

wants to merge 74 commits into from

Conversation

Davknapp
Copy link
Collaborator

@Davknapp Davknapp commented Aug 20, 2024

An interface for arbitrary data.
For new user-data it suffies to implement how a single element should be packed/unpacked.
The routines for vectors of user-data make use of this routine and pack/unpack the data accordingly.

Furthermore it provides a wrapper around the send/recv routine from MPI for to avoid code duplication and easy usage. This part of the interface should be extended in the future to other MPI send/recv routines.

All these boxes must be checked by the reviewers before merging the pull request:

As a reviewer please read through all the code lines and make sure that the code is fully understood, bug free, well-documented and well-structured.

General

  • The reviewer executed the new code features at least once and checked the results manually

  • The code follows the t8code coding guidelines

  • New source/header files are properly added to the Makefiles

  • The code is well documented

  • All function declarations, structs/classes and their members have a proper doxygen documentation

  • All new algorithms and data structures are sufficiently optimal in terms of memory and runtime (If this should be merged, but there is still potential for optimization, create a new issue)

Tests

  • The code is covered in an existing or new test case using Google Test

Github action

  • The code compiles without warning in debugging and release mode, with and without MPI (this should be executed automatically in a github action)

  • All tests pass (in various configurations, this should be executed automatically in a github action)

    If the Pull request introduces code that is not covered by the github action (for example coupling with a new library):

    • Should this use case be added to the github action?
    • If not, does the specific use case compile and all tests pass (check manually)

Scripts and Wiki

  • If a new directory with source-files is added, it must be covered by the script/find_all_source_files.scp to check the indentation of these files.
  • If this PR introduces a new feature, it must be covered in an example/tutorial and a Wiki article.

Licence

  • The author added a BSD statement to doc/ (or already has one)

@Davknapp Davknapp added New feature Adds a new feature to the code draft Enhance the visibility that this is a draft. C++ priority: low Should be solved eventually workload: medium Would take a week or less labels Aug 20, 2024
Comment on lines 26 to 31
#include <t8.h>
#include <vector>
#include <t8_data/t8_data_handler_base.hxx>
#include <algorithm>
#include <memory>
#include <type_traits>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you maybe want to sort them?

* \param[in] comm The MPI communicator used for the operation.
*/
virtual void
pack_vector_prefix (void *buffer, const int num_bytes, int &pos, sc_MPI_Comm comm)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there no other way than using a void pointer? Couldn't this be templatized?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, because the buffer used by MPI is a void* buffer. We want to pass this buffer to the MPI-function and it expects a void *

*
* \param[in, out] buffer A pointer to the buffer where the vector prefix will be packed.
* \param[in] num_bytes The number of bytes to be packed.
* \param[in] pos A reference to an integer representing the current position in the buffer. This will be updated as bytes are packed.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What would I need this for?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is used to fill the buffer for MPI communication for data structures that are non-trivial and do not lay linear in memory.

*
* \return An integer representing the type.
*/
virtual int
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which integer is for which type? Is there an enum for this?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is currently more a place-holder than a proper implementation. An enum over all of our types that can be used by this class would be nice.

src/t8_data/t8_data_handler.hxx Outdated Show resolved Hide resolved
test/t8_data/t8_data_handler_specs.hxx Outdated Show resolved Hide resolved
test/t8_data/t8_data_handler_specs.hxx Show resolved Hide resolved
test/t8_data/t8_gtest_data_handler.cxx Show resolved Hide resolved
test/t8_data/t8_pseudo_trees.hxx Show resolved Hide resolved
test/t8_data/t8_pseudo_trees.hxx Outdated Show resolved Hide resolved
@sandro-elsweijer sandro-elsweijer removed the draft Enhance the visibility that this is a draft. label Oct 1, 2024
@Davknapp Davknapp assigned sandro-elsweijer and unassigned Davknapp Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C++ New feature Adds a new feature to the code priority: low Should be solved eventually workload: medium Would take a week or less
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants