Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add ray grouped runtime (securefederatedai#910)
* Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <[email protected]> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update ROADMAP.md (#765) Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update README.md Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update GOVERNANCE.md Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update ROADMAP.md (#785) Typos Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated integrations to GaNDLF (#781) * renaming loader and runner Signed-off-by: sarthakpati <[email protected]> * updated plan to pick the new names Signed-off-by: sarthakpati <[email protected]> * new key name Signed-off-by: sarthakpati <[email protected]> * allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters Signed-off-by: sarthakpati <[email protected]> * checking this differently Signed-off-by: sarthakpati <[email protected]> * rename variable for clarity Signed-off-by: sarthakpati <[email protected]> --------- Signed-off-by: sarthakpati <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Introduced shard descriptor based collaborator private attributes Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Adding batch size for train, and test in config.yaml file Files modified: 1. config.yaml 2. mnist_shard_descriptor.py 3. Workflow_Interface_101_MNIST.ipynb 4. participants.py Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Introducing multiple config yaml files Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Removing unnecessary config.yaml file. Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added collaborator private atribute delayed initialization for local_runtime Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Incorporated review comments Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added multi-pricessing ray backend support and, aggregator yaml file Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated multi-processing code Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * RayExecutor class moved from participants.py to localruntime.py Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * RayExecytor moved from interface/pariticipants.py to runtime/local_runtime.py Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added Aggregator private attribute initialation in runtime Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Removed unnecessary import statements Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Code cleaned up, validated checkpoints manually Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Refactored, and added some new doc string Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolved Flake8 instructions Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Recusrsion removal + Serialization removal integrated Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Incoporated Review Comments Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Removed configuration YAML files, and added functionality to initialize private attributes by calling a callback function created by end-user Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Removed commented code Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Implemented new approach, two example files given 1. Workflow_Interface_101_MNIST.py 2. Workflow_Interface_301_MNIST_Watermarking.py Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Internal Review Comments Incorporated Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * No private attributes are required If private attributes are not provided, by default take an empty dictionary no need to pass a callable function. Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update participants.py Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added a check for GPU Resource Allocation Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Modified error message for resource allocation Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolved bug found during testing phase Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Modifide all the test cases, and following tutorials 1. Privacy Meter 2. FedProx Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added following test cases: 1. Workflow_Interface_101_MNIST.ipynb 2. Workflow_Interface_102_Aggregator_Validation.ipynb 3. Workflow_Interface_301_MNIST_Watermarking.ipynb 4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb 5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Modified and Added Global_DP tutorials. Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Modified documentation for Workflow_Interface_201 tutorial. Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * fixed flake-8 errors Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * reverted import module code Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolved merge conflicts in local_runtime.py --------- Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <[email protected]> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Parth Mandaliya <[email protected]> * Update README.md Signed-off-by: Parth Mandaliya <[email protected]> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <[email protected]> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <[email protected]> --------- Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Parth Mandaliya <[email protected]> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Co-authored-by: He, Dan H <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <[email protected]> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <[email protected]> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <[email protected]> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <[email protected]> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <[email protected]> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <[email protected]> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <[email protected]> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <[email protected]> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <[email protected]> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <[email protected]> * Format code. Signed-off-by: Fang, Xiaoran <[email protected]> * Refactor code. Signed-off-by: Fang, Xiaoran <[email protected]> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <[email protected]> * Format with flake8 Signed-off-by: Fang, Xiaoran <[email protected]> * Remove TODO comments Signed-off-by: Fang, Xiaoran <[email protected]> --------- Signed-off-by: Fang, Xiaoran <[email protected]> Co-authored-by: Wang, Wenjie <[email protected]> Co-authored-by: Lei5 Chen <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <[email protected]> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <[email protected]> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <[email protected]> Co-authored-by: Grant Baker <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <[email protected]> Co-authored-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> * Update README.md Signed-off-by: Beverly Klemme <[email protected]> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <[email protected]> --------- Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <[email protected]> Co-authored-by: Emmanuel Jillela <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <[email protected]> Co-authored-by: Grant Baker <[email protected]> Signed-off-by: Yi CAO <[email protected]> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <[email protected]> --------- Signed-off-by: Yi CAO <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Co-authored-by: Yi CAO <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <[email protected]> * Running a federation with GaNDLF Documentation (#794) * Initial commit of Running the federation with GaNDLF Documentation Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: Patrick Foley <[email protected]> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update README.md Signed-off-by: Patrick Foley <[email protected]> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <[email protected]> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <[email protected]> --------- Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Patrick Foley <[email protected]> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Co-authored-by: He, Dan H <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <[email protected]> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <[email protected]> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <[email protected]> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <[email protected]> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <[email protected]> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <[email protected]> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <[email protected]> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <[email protected]> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <[email protected]> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <[email protected]> * Format code. Signed-off-by: Fang, Xiaoran <[email protected]> * Refactor code. Signed-off-by: Fang, Xiaoran <[email protected]> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <[email protected]> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <[email protected]> * Format with flake8 Signed-off-by: Fang, Xiaoran <[email protected]> * Remove TODO comments Signed-off-by: Fang, Xiaoran <[email protected]> --------- Signed-off-by: Fang, Xiaoran <[email protected]> Co-authored-by: Wang, Wenjie <[email protected]> Co-authored-by: Lei5 Chen <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <[email protected]> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <[email protected]> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <[email protected]> Co-authored-by: Grant Baker <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <[email protected]> Co-authored-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Jiang, Jiaqiu <[email protected]> Signed-off-by: Li, Qingqing <[email protected]> Signed-off-by: Wang, Le <[email protected]> Signed-off-by: Wu, Caili <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> * Update README.md Signed-off-by: Beverly Klemme <[email protected]> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <[email protected]> --------- Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <[email protected]> Co-authored-by: Emmanuel Jillela <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <[email protected]> Co-authored-by: Grant Baker <[email protected]> Signed-off-by: Yi CAO <[email protected]> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <[email protected]> --------- Signed-off-by: Yi CAO <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Co-authored-by: Yi CAO <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <[email protected]> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <[email protected]> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <[email protected]> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <[email protected]> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <[email protected]> * Fix documentation links. Change path names and templates for CI Signed-off-by: Patrick Foley <[email protected]> * Fix paths Signed-off-by: Patrick Foley <[email protected]> * Fix paths Signed-off-by: Patrick Foley <[email protected]> * Fix breaking tests Signed-off-by: Patrick Foley <[email protected]> * Add compatible onnx version to requirements.txt file Signed-off-by: Patrick Foley <[email protected]> * Fix wrong csv file name Signed-off-by: Patrick Foley <[email protected]> * Fix wrong csv file name Signed-off-by: Patrick Foley <[email protected]> * Fix wrong names in workflow file Signed-off-by: Patrick Foley <[email protected]> * Fix wrong data path Signed-off-by: Patrick Foley <[email protected]> * Fix lint in test_gandlf.py Signed-off-by: Patrick Foley <[email protected]> * Fix lint errors Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Fang, Xiaoran <[email protected]> Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Emmanuel Jillela <[email protected]> Signed-off-by: Yi CAO <[email protected]> Co-authored-by: Sarthak Pati <[email protected]> Co-authored-by: Prashant Shah <[email protected]> Co-authored-by: akantak <[email protected]> Co-authored-by: wangleflex <[email protected]> Co-authored-by: He, Dan H <[email protected]> Co-authored-by: xiaoranf <[email protected]> Co-authored-by: Wang, Wenjie <[email protected]> Co-authored-by: Lei5 Chen <[email protected]> Co-authored-by: Beverly Klemme <[email protected]> Co-authored-by: Emmanuel Jillela <[email protected]> Co-authored-by: Yi CAO <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <[email protected]> * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841) Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Fix GaNDLF documentation links (#842) * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <[email protected]> * Fix links in GaNDLF Documentation * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <[email protected]> * Fix links in GaNDLF Documentation Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Fix incorrectly formatted link in docs (#839) Signed-off-by: Francis Storr <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolving merge conflicts in local-runtime.py Integrated aggregator as stateful actor branch, tested. Signed-off-by: Parth Mandaliya <[email protected]> -------- Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840) Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0. - [Release notes](https://github.com/onnx/onnx/releases) - [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md) - [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0) --- updated-dependencies: - dependency-name: onnx dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <[email protected]> * Merged changes of remove-torch-dependency branch Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update setup.py Upgrading protobuf to 3.20.3 as per tensorboard requirement Signed-off-by: Parth Mandaliya <[email protected]> * Resolving merge conflicts Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Accessibility updates (#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <[email protected]> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <[email protected]> --------- Signed-off-by: Francis Storr <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773) * build(deps): bump tensorflow in /openfl-workspace/keras_nlp Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update RMSProp optimizer import Signed-off-by: Patrick Foley <[email protected]> * flake8 Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * revert experimental Adam to legacy (#863) Signed-off-by: kta-intel <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: kta-intel <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Patrick Foley <[email protected]> * Update Adam Optimizer import Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Fixed breaking backages Signed-off-by: Patrick Foley <[email protected]> * Add quiet flag back to pip install Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Patrick Foley <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769) * build(deps): bump tensorflow-cpu Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow-cpu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Use legacy RMSprop optimizer Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Patrick Foley <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Accessibility color contrast fixes (#864) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <[email protected]> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <[email protected]> * Color contrast updates for accessibility Color contrast updates for accessibility - update generic `a` element - update color of links in the toggle-able read-the-docs panel - update the color of the text in search results - update the color of notes headers Signed-off-by: Francis Storr <[email protected]> --------- Signed-off-by: Francis Storr <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Tweak link color so it’s not so aggressive (#865) Signed-off-by: Francis Storr <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Update sd_requirements.txt * revert to legacy SGD and install tensorflow==2.11 for workflow Signed-off-by: kta-intel <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: kta-intel <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <[email protected]> Co-authored-by: kta-intel <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774) * build(deps): bump tensorflow in /openfl-workspace/tf_2dunet Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Update requirements.txt to retrigger CI * Update requirements.txt --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update Tensorflow, gRPC, Protobuf dependencies (#868) * Update Tensorflow to latest, finally update grpcio/protobuf Signed-off-by: Patrick Foley <[email protected]> * Lint issue fix and missing tf reference Signed-off-by: Patrick Foley <[email protected]> * pyzmq version fixed * fix taskrunner tests for windows Signed-off-by: Mansi Sharma <[email protected]> * fix taskrunner test syntax for windows Signed-off-by: Mansi Sharma <[email protected]> * adding user option to workspace pip install requirements for windows Signed-off-by: Mansi Sharma <[email protected]> * fix windows CI test Signed-off-by: Mansi Sharma <[email protected]> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <[email protected]> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <[email protected]> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <[email protected]> * testing venv for windows Signed-off-by: Mansi Sharma <[email protected]> * test venv for windows * test venv for windows * Added new KerasSerializer. Fixed other Interactive API experiments * Update taskrunner.yml * Update taskrunner.yml * Update workspace.py * Update workspace.py * Update taskrunner.yml * Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build) * Refactoring and cleaning up imports to support Windows install * Fixed logger import paths * Fix missing imports * Fix native import * Fix lint errors * Fix keras optimizer patch. Remove irrelevant unit test * Format logs in UTF-8 for windows * Update interactive-kvasir.yml * Consolidate github actions python versions to single file * Update python versions * Update python versions * Update python versions * Reduce # of DataLoader workers for Pytorch Kvasir CI test * Fix Windows encoding * Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory Signed-off-by: Patrick Foley <[email protected]> * Fix windows encoding * Fix Windows encoding --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Mansi Sharma <[email protected]> Co-authored-by: Mansi Sharma <[email protected]> Co-authored-by: Mansi Sharma <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Add FL plan description to documentation (#872) * Add plan description to documentation Signed-off-by: Mansi Sharma <[email protected]> * fix indentation Signed-off-by: Mansi Sharma <[email protected]> * Apply suggestions from code review Co-authored-by: Patrick Foley <[email protected]> --------- Signed-off-by: Mansi Sharma <[email protected]> Co-authored-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolved flake8 issues Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * GPU Added for aggregator Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolve Coverity Issues (#874) * Fix coverity issues * Resolve remaining coverity issues Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875) Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated documentation: docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Updated documentation Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update workflow_interface.rst Fixing typo Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added best model and last model extraction technique in docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Added GPU for aggregator Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Resolving merge conflicts in 103 cyclic tutorial notebook fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833) * fixing FedAvg averaging in order to be compatible with numpy v1.24+ Signed-off-by: kta-intel <[email protected]> * uncommenting installations for consistency with other tutorials Signed-off-by: kta-intel <[email protected]> * fixing 301_MNIST_Watermarking tutorial FedAvg Signed-off-by: kta-intel <[email protected]> * fixing 301_MNIST_Watermarki ng tutorial FedAvg Signed-off-by: kta-intel <[email protected]> * Switching to py38 kernel and clearing cell outputs Signed-off-by: kta-intel <[email protected]> --------- Signed-off-by: kta-intel <[email protected]> --------- Signed-off-by: Parth Mandaliya <[email protected]> * Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py Testflow for verifying stdout redirection to Metaflow datastore (#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <[email protected]> * Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update EdenPipeline in the documentation (#877) Signed-off-by: Amit Portnoy <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * WIP: CI Scans (#873) * Initial scans commit for bandit, hadolint, trivy Signed-off-by: Patrick Foley <[email protected]> * Address bandit scan results Signed-off-by: Patrick Foley <[email protected]> * Fix Trivy action Signed-off-by: Patrick Foley <[email protected]> * Fix linting Signed-off-by: Patrick Foley <[email protected]> * Add Coverity Badge Signed-off-by: Patrick Foley <[email protected]> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <[email protected]> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> * Update ROADMAP.md (#878) Signed-off-by: Parth Mandaliya <[email protected]> * initial commit * add docstrings * change importlib to import * remove unnecesary files, replace ray with ray_grouped * remove max concurency, add number of actors * Trigger CI * run tests * lint changes * flake * changed number of actors to num_actors, added docs * Fixed workflow API tests Signed-off-by: Patrick Foley <[email protected]> * lint fixes Signed-off-by: Patrick Foley <[email protected]> --------- Signed-off-by: Patrick Foley <[email protected]> Signed-off-by: ParthM-GitHub <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: sarthakpati <[email protected]> Signed-off-by: Aleksander Kantak <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: Parth Mandaliya <[email protected]> Signed-off-by: He, Dan H <[email protected]> Signed-off-by: Fang, Xiaoran <[email protected]> Signed-off-by: Grant Baker <[email protected]> Signed-off-by: Klemme, Beverly <[email protected]> Signed-off-by: Baker, Grant <[email protected]> Signed-off-by: ELizabeth Simon, Neethu <[email protected]> Signed-off-by: Jillela, Emmanuel <[email protected]> Signed-off-by: Beverly Klemme <[email protected]> Signed-off-by: Elizabeth Simon, Neethu <[email protected]> Signed-off-by: Emmanuel Jillela <[email protected]> Signed-off-by: Yi CAO <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Francis Storr <[email protected]> Signed-off-by: kta-intel <[email protected]> Signed-off-by: Mansi Sharma <[email protected]> Signed-off-by: Amit Portnoy <[email protected]> Co-authored-by: Patrick Foley <[email protected]> Co-authored-by: Olga Perepelkina <[email protected]> Co-authored-by: Joe Devon <[email protected]> Co-authored-by: Sarthak Pati <[email protected]> Co-authored-by: Prashant Shah <[email protected]> Co-authored-by: akantak <[email protected]> Co-authored-by: Parth Mandaliya <[email protected]> Co-authored-by: Parth Mandaliya <[email protected]> Co-authored-by: Parth Mandaliya <[email protected]> Co-authored-by: Keerti Talwar <[email protected]> Co-authored-by: KeertiX <[email protected]> Co-authored-by: wangleflex <[email protected]> Co-authored-by: He, Dan H <[email protected]> Co-authored-by: xiaoranf <[email protected]> Co-authored-by: Wang, Wenjie <[email protected]> Co-authored-by: Lei5 Chen <[email protected]> Co-authored-by: Beverly Klemme <[email protected]> Co-authored-by: Grant Baker <[email protected]> Co-authored-by: Emmanuel Jillela <[email protected]> Co-authored-by: Yi CAO <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Sarthak Pati <[email protected]> Co-authored-by: Francis Storr <[email protected]> Co-authored-by: Patrick Foley <[email protected]> Co-authored-by: Kevin Ta <[email protected]> Co-authored-by: kta-intel <[email protected]> Co-authored-by: Mansi Sharma <[email protected]> Co-authored-by: Mansi Sharma <[email protected]> Co-authored-by: Sachin Gupta <[email protected]> Co-authored-by: Keerti Prakash Talwar <[email protected]> Co-authored-by: Amit Portnoy <[email protected]> Signed-off-by: nammbash <[email protected]>
- Loading branch information
