Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make generalised dataset splitter functions (PyTorch) #81

Open
TTitcombe opened this issue Dec 9, 2020 · 0 comments
Open

Make generalised dataset splitter functions (PyTorch) #81

TTitcombe opened this issue Dec 9, 2020 · 0 comments
Assignees
Labels
Good first issue 🎓 Perfect for beginners, welcome to OpenMined! Type: New Feature ➕ Introduction of a completely new addition to the codebase
Milestone

Comments

@TTitcombe
Copy link
Member

Feature Description

  • Create functions which split PyTorch datasets into separate datasets
  • Should work for image and non-image datasets
  • Functions should apply random IDs to datapoints
  • Unit test the functions

"Splitting" in this context means to split input features into two separate datasets. For images, split them top/bottom (a further issue will look to extend this)

Is your feature request related to a problem?

We should provide utility code to make it easy for people to turn non-vertically federated datasets into vertically federated ones, for experimental purposes.

We currently have some code built for this task, but it is not generaliseable to a wide range of datasets

What alternatives have you considered?

  • Don't provide generaliseable code: This is okay for initial experimentation, but PyVertical should be a widely useable package for VFL
@TTitcombe TTitcombe added the Type: New Feature ➕ Introduction of a completely new addition to the codebase label Dec 9, 2020
@TTitcombe TTitcombe added this to the Pip package milestone Dec 9, 2020
@TTitcombe TTitcombe added the Good first issue 🎓 Perfect for beginners, welcome to OpenMined! label Dec 9, 2020
@daler3 daler3 mentioned this issue Dec 22, 2020
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Good first issue 🎓 Perfect for beginners, welcome to OpenMined! Type: New Feature ➕ Introduction of a completely new addition to the codebase
Projects
None yet
Development

No branches or pull requests

2 participants