Q2 2023 Roadmap #765

psfoley · 2023-03-20T23:24:57Z

No description provided.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>

Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>

* Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#765) Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update GOVERNANCE.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#785) Typos Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated integrations to GaNDLF (#781) * renaming loader and runner Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * updated plan to pick the new names Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * new key name Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * checking this differently Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * rename variable for clarity Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> --------- Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introduced shard descriptor based collaborator private attributes Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Adding batch size for train, and test in config.yaml file Files modified: 1. config.yaml 2. mnist_shard_descriptor.py 3. Workflow_Interface_101_MNIST.ipynb 4. participants.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introducing multiple config yaml files Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removing unnecessary config.yaml file. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added collaborator private atribute delayed initialization for local_runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incorporated review comments Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added multi-pricessing ray backend support and, aggregator yaml file Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated multi-processing code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecutor class moved from participants.py to localruntime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecytor moved from interface/pariticipants.py to runtime/local_runtime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added Aggregator private attribute initialation in runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed unnecessary import statements Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Code cleaned up, validated checkpoints manually Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Refactored, and added some new doc string Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved Flake8 instructions Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Recusrsion removal + Serialization removal integrated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incoporated Review Comments Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed configuration YAML files, and added functionality to initialize private attributes by calling a callback function created by end-user Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed commented code Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Implemented new approach, two example files given 1. Workflow_Interface_101_MNIST.py 2. Workflow_Interface_301_MNIST_Watermarking.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Internal Review Comments Incorporated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * No private attributes are required If private attributes are not provided, by default take an empty dictionary no need to pass a callable function. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update participants.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added a check for GPU Resource Allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified error message for resource allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved bug found during testing phase Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modifide all the test cases, and following tutorials 1. Privacy Meter 2. FedProx Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added following test cases: 1. Workflow_Interface_101_MNIST.ipynb 2. Workflow_Interface_102_Aggregator_Validation.ipynb 3. Workflow_Interface_301_MNIST_Watermarking.ipynb 4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb 5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added Global_DP tutorials. Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified documentation for Workflow_Interface_201 tutorial. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * fixed flake-8 errors Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * reverted import module code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in local_runtime.py --------- Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Running a federation with GaNDLF Documentation (#794) * Initial commit of Running the federation with GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix documentation links. Change path names and templates for CI Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix breaking tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add compatible onnx version to requirements.txt file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong names in workflow file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong data path Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint in test_gandlf.py Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint errors Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix GaNDLF documentation links (#842) * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix incorrectly formatted link in docs (#839) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in local-runtime.py Integrated aggregator as stateful actor branch, tested. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> -------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840) Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0. - [Release notes](https://github.com/onnx/onnx/releases) - [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md) - [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0) --- updated-dependencies: - dependency-name: onnx dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Merged changes of remove-torch-dependency branch Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update setup.py Upgrading protobuf to 3.20.3 as per tensorboard requirement Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility updates (#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773) * build(deps): bump tensorflow in /openfl-workspace/keras_nlp Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update RMSProp optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> * flake8 Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Adam Optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Fixed breaking backages Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add quiet flag back to pip install Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769) * build(deps): bump tensorflow-cpu Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow-cpu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Use legacy RMSprop optimizer Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility color contrast fixes (#864) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> * Color contrast updates for accessibility Color contrast updates for accessibility - update generic `a` element - update color of links in the toggle-able read-the-docs panel - update the color of the text in search results - update the color of notes headers Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Tweak link color so it’s not so aggressive (#865) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update sd_requirements.txt * revert to legacy SGD and install tensorflow==2.11 for workflow Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774) * build(deps): bump tensorflow in /openfl-workspace/tf_2dunet Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update requirements.txt to retrigger CI * Update requirements.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Tensorflow, gRPC, Protobuf dependencies (#868) * Update Tensorflow to latest, finally update grpcio/protobuf Signed-off-by: Patrick Foley <psfoley@gmail.com> * Lint issue fix and missing tf reference Signed-off-by: Patrick Foley <psfoley@gmail.com> * pyzmq version fixed * fix taskrunner tests for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix taskrunner test syntax for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * adding user option to workspace pip install requirements for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix windows CI test Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing venv for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * test venv for windows * test venv for windows * Added new KerasSerializer. Fixed other Interactive API experiments * Update taskrunner.yml * Update taskrunner.yml * Update workspace.py * Update workspace.py * Update taskrunner.yml * Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build) * Refactoring and cleaning up imports to support Windows install * Fixed logger import paths * Fix missing imports * Fix native import * Fix lint errors * Fix keras optimizer patch. Remove irrelevant unit test * Format logs in UTF-8 for windows * Update interactive-kvasir.yml * Consolidate github actions python versions to single file * Update python versions * Update python versions * Update python versions * Reduce # of DataLoader workers for Pytorch Kvasir CI test * Fix Windows encoding * Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix windows encoding * Fix Windows encoding --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add FL plan description to documentation (#872) * Add plan description to documentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix indentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * Apply suggestions from code review Co-authored-by: Patrick Foley <patrick.foley@intel.com> --------- Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved flake8 issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * GPU Added for aggregator Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolve Coverity Issues (#874) * Fix coverity issues * Resolve remaining coverity issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation: docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update workflow_interface.rst Fixing typo Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added best model and last model extraction technique in docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added GPU for aggregator Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in 103 cyclic tutorial notebook fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833) * fixing FedAvg averaging in order to be compatible with numpy v1.24+ Signed-off-by: kta-intel <kevin.ta@intel.com> * uncommenting installations for consistency with other tutorials Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarking tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarki ng tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * Switching to py38 kernel and clearing cell outputs Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py Testflow for verifying stdout redirection to Metaflow datastore (#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update EdenPipeline in the documentation (#877) Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * WIP: CI Scans (#873) * Initial scans commit for bandit, hadolint, trivy Signed-off-by: Patrick Foley <psfoley@gmail.com> * Address bandit scan results Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Trivy action Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix linting Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Coverity Badge Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#878) Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * initial commit * add docstrings * change importlib to import * remove unnecesary files, replace ray with ray_grouped * remove max concurency, add number of actors * Trigger CI * run tests * lint changes * flake * changed number of actors to num_actors, added docs * Fixed workflow API tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * lint fixes Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com> Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com> Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com> Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Co-authored-by: Keerti Talwar <keertix.talwar@intel.com> Co-authored-by: KeertiX <keertix.talwarx@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Francis Storr <francis.storr@intel.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com> Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com> Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>

* Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#765) Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update GOVERNANCE.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#785) Typos Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated integrations to GaNDLF (#781) * renaming loader and runner Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * updated plan to pick the new names Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * new key name Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * checking this differently Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * rename variable for clarity Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> --------- Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introduced shard descriptor based collaborator private attributes Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Adding batch size for train, and test in config.yaml file Files modified: 1. config.yaml 2. mnist_shard_descriptor.py 3. Workflow_Interface_101_MNIST.ipynb 4. participants.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introducing multiple config yaml files Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removing unnecessary config.yaml file. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added collaborator private atribute delayed initialization for local_runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incorporated review comments Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added multi-pricessing ray backend support and, aggregator yaml file Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated multi-processing code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecutor class moved from participants.py to localruntime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecytor moved from interface/pariticipants.py to runtime/local_runtime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added Aggregator private attribute initialation in runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed unnecessary import statements Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Code cleaned up, validated checkpoints manually Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Refactored, and added some new doc string Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved Flake8 instructions Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Recusrsion removal + Serialization removal integrated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incoporated Review Comments Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed configuration YAML files, and added functionality to initialize private attributes by calling a callback function created by end-user Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed commented code Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Implemented new approach, two example files given 1. Workflow_Interface_101_MNIST.py 2. Workflow_Interface_301_MNIST_Watermarking.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Internal Review Comments Incorporated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * No private attributes are required If private attributes are not provided, by default take an empty dictionary no need to pass a callable function. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update participants.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added a check for GPU Resource Allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified error message for resource allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved bug found during testing phase Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modifide all the test cases, and following tutorials 1. Privacy Meter 2. FedProx Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added following test cases: 1. Workflow_Interface_101_MNIST.ipynb 2. Workflow_Interface_102_Aggregator_Validation.ipynb 3. Workflow_Interface_301_MNIST_Watermarking.ipynb 4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb 5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added Global_DP tutorials. Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified documentation for Workflow_Interface_201 tutorial. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * fixed flake-8 errors Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * reverted import module code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in local_runtime.py --------- Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Running a federation with GaNDLF Documentation (#794) * Initial commit of Running the federation with GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix documentation links. Change path names and templates for CI Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix breaking tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add compatible onnx version to requirements.txt file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong names in workflow file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong data path Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint in test_gandlf.py Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint errors Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix GaNDLF documentation links (#842) * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix incorrectly formatted link in docs (#839) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in local-runtime.py Integrated aggregator as stateful actor branch, tested. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> -------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840) Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0. - [Release notes](https://github.com/onnx/onnx/releases) - [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md) - [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0) --- updated-dependencies: - dependency-name: onnx dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Merged changes of remove-torch-dependency branch Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update setup.py Upgrading protobuf to 3.20.3 as per tensorboard requirement Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility updates (#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773) * build(deps): bump tensorflow in /openfl-workspace/keras_nlp Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update RMSProp optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> * flake8 Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Adam Optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Fixed breaking backages Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add quiet flag back to pip install Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769) * build(deps): bump tensorflow-cpu Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow-cpu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Use legacy RMSprop optimizer Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility color contrast fixes (#864) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> * Color contrast updates for accessibility Color contrast updates for accessibility - update generic `a` element - update color of links in the toggle-able read-the-docs panel - update the color of the text in search results - update the color of notes headers Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Tweak link color so it’s not so aggressive (#865) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update sd_requirements.txt * revert to legacy SGD and install tensorflow==2.11 for workflow Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774) * build(deps): bump tensorflow in /openfl-workspace/tf_2dunet Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update requirements.txt to retrigger CI * Update requirements.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Tensorflow, gRPC, Protobuf dependencies (#868) * Update Tensorflow to latest, finally update grpcio/protobuf Signed-off-by: Patrick Foley <psfoley@gmail.com> * Lint issue fix and missing tf reference Signed-off-by: Patrick Foley <psfoley@gmail.com> * pyzmq version fixed * fix taskrunner tests for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix taskrunner test syntax for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * adding user option to workspace pip install requirements for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix windows CI test Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing venv for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * test venv for windows * test venv for windows * Added new KerasSerializer. Fixed other Interactive API experiments * Update taskrunner.yml * Update taskrunner.yml * Update workspace.py * Update workspace.py * Update taskrunner.yml * Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build) * Refactoring and cleaning up imports to support Windows install * Fixed logger import paths * Fix missing imports * Fix native import * Fix lint errors * Fix keras optimizer patch. Remove irrelevant unit test * Format logs in UTF-8 for windows * Update interactive-kvasir.yml * Consolidate github actions python versions to single file * Update python versions * Update python versions * Update python versions * Reduce # of DataLoader workers for Pytorch Kvasir CI test * Fix Windows encoding * Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix windows encoding * Fix Windows encoding --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add FL plan description to documentation (#872) * Add plan description to documentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix indentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * Apply suggestions from code review Co-authored-by: Patrick Foley <patrick.foley@intel.com> --------- Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved flake8 issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * GPU Added for aggregator Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolve Coverity Issues (#874) * Fix coverity issues * Resolve remaining coverity issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation: docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update workflow_interface.rst Fixing typo Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added best model and last model extraction technique in docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added GPU for aggregator Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in 103 cyclic tutorial notebook fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833) * fixing FedAvg averaging in order to be compatible with numpy v1.24+ Signed-off-by: kta-intel <kevin.ta@intel.com> * uncommenting installations for consistency with other tutorials Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarking tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarki ng tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * Switching to py38 kernel and clearing cell outputs Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py Testflow for verifying stdout redirection to Metaflow datastore (#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update EdenPipeline in the documentation (#877) Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * WIP: CI Scans (#873) * Initial scans commit for bandit, hadolint, trivy Signed-off-by: Patrick Foley <psfoley@gmail.com> * Address bandit scan results Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Trivy action Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix linting Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Coverity Badge Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#878) Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * initial commit * add docstrings * change importlib to import * remove unnecesary files, replace ray with ray_grouped * remove max concurency, add number of actors * Trigger CI * run tests * lint changes * flake * changed number of actors to num_actors, added docs * Fixed workflow API tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * lint fixes Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com> Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com> Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com> Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Co-authored-by: Keerti Talwar <keertix.talwar@intel.com> Co-authored-by: KeertiX <keertix.talwarx@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Francis Storr <francis.storr@intel.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com> Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com> Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Signed-off-by: nammbash <niroopshankar.ammbashankar@intel.com>

* Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#765) Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update GOVERNANCE.md Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#785) Typos Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated integrations to GaNDLF (#781) * renaming loader and runner Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * updated plan to pick the new names Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * new key name Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * allow the ability to pass a file to `gandlf_config_dict` in addition to fully-fledged parameters Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * checking this differently Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> * rename variable for clarity Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> --------- Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introduced shard descriptor based collaborator private attributes Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Adding batch size for train, and test in config.yaml file Files modified: 1. config.yaml 2. mnist_shard_descriptor.py 3. Workflow_Interface_101_MNIST.ipynb 4. participants.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Introducing multiple config yaml files Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removing unnecessary config.yaml file. Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added collaborator private atribute delayed initialization for local_runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incorporated review comments Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added multi-pricessing ray backend support and, aggregator yaml file Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated multi-processing code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecutor class moved from participants.py to localruntime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * RayExecytor moved from interface/pariticipants.py to runtime/local_runtime.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added Aggregator private attribute initialation in runtime Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed unnecessary import statements Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Code cleaned up, validated checkpoints manually Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Refactored, and added some new doc string Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved Flake8 instructions Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Recusrsion removal + Serialization removal integrated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Incoporated Review Comments Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed configuration YAML files, and added functionality to initialize private attributes by calling a callback function created by end-user Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Removed commented code Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Implemented new approach, two example files given 1. Workflow_Interface_101_MNIST.py 2. Workflow_Interface_301_MNIST_Watermarking.py Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Internal Review Comments Incorporated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * No private attributes are required If private attributes are not provided, by default take an empty dictionary no need to pass a callable function. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update participants.py Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added a check for GPU Resource Allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified error message for resource allocation Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved bug found during testing phase Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modifide all the test cases, and following tutorials 1. Privacy Meter 2. FedProx Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added following test cases: 1. Workflow_Interface_101_MNIST.ipynb 2. Workflow_Interface_102_Aggregator_Validation.ipynb 3. Workflow_Interface_301_MNIST_Watermarking.ipynb 4. Workflow_Interface_201_Exclusive_GPUs_with_Ray.ipynb 5. Workflow_Interface_103_Cyclic_Institutional_Incremental_Learning.ipynb Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added Global_DP tutorials. Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified and Added tutorial Workflow-Interface_201_Exclusive_GPUs_with_Ray.ipynb Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Modified documentation for Workflow_Interface_201 tutorial. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * fixed flake-8 errors Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * reverted import module code Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in local_runtime.py --------- Fix flake8 error in local runtime (#764) * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> * Removes unnecessary dict comprehension Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Running a federation with GaNDLF Documentation (#794) * Initial commit of Running the federation with GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update docs/running_the_federation_with_gandlf.rst Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Removed references to Intel's ownship, given it's now owned by the LF AI and Data. Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Flake8 C419 for Ubuntu CI (#800) C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix warnings and issues in docs (#825) * Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> * fixup! Fix warnings and issues in docs Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> --------- Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Logo (#827) * Add Logo * Update README.md Signed-off-by: Patrick Foley <psfoley@gmail.com> * Change OpenFL documentation font to improve accessibility (#809) This replaces the font of OpenFL documents with Intel One Mono font for low vision developers. Known issues: 1. The text font within the images has not been changed. 2. Some icons that do not exist in the new font cannot be displayed properly. Fixes securefederatedai#799 Co-authored-by: Wang, Le <le3.wang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update unit tests to improve code coverage (#821) * Update ci config Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add unit test for following files - openfl/federated/plan/plan.py - openfl/interface/aggregation_functions/core/adaptive_aggregation.py Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add some test cases for databases module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Fix bugs for databases module unittest Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Update unit tests for component module Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Restore workflow config and update some comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Enable save_ test case. Add yaml under test dir for unit test usage. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove plan to new dir. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add aggregator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 2 aggregator test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 aggregator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Refactor code. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add collaborator start test cases. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Add 1 collaborator test case. Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Format with flake8 Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> * Remove TODO comments Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> --------- Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add PyTorch linear regression example (#808) This adds a new tutorial example on distributing a linear regression task over OpenFL cluster. The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters. Fixes #797 Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * This prints out the hash of the CSR to disk for both the aggregator and (#813) * This prints out the hash of the CSR to disk for both the aggregator and collaborator. The user then compares and approves this hash with the hash printed out of the file to validate the CSR. In addition, a warning message is pritned if certify is run in silent mode. Fixes securefederatedai#692 Signed-off-by: Grant Baker <grant.baker@intel.com> * Refactor read_csr function to use get_csr_hash Signed-off-by: Grant Baker <grant.baker@intel.com> * Ask to check hashes before prompt --------- Signed-off-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Improve workspace requirements import (#810) Remove the dump_requirement_file operation in export_ method. Fixes securefederatedai#767 Co-authored-by: Li, Qingqing <qingqing.li@intel.com> Co-authored-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com> Signed-off-by: Li, Qingqing <qingqing.li@intel.com> Signed-off-by: Wang, Le <le3.wang@intel.com> Signed-off-by: Wu, Caili <caili.wu@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Issue 506 Added Example using FedProx (#818) * created new ineractive_api dir to hold pytorch fedprox mnist example corrected files changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example renamed FedProx notebook used mode.parrameters() to get pytorch model weights got weights using state_dict changed old wieghts to list (for serialization) and fixed README input wieghts before zero_grad [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: #506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer. Fixes: securefederatedai#506 Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * Update README.md Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> * addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README. Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * [Bug: 768] FX CLI: Separate create, cert gen commands (#807) This change separates existing command "fx collaborator.py generate-cert-request" command into two commands. "fx collaborator create -n {NAME} -d {DATA_PATH: optional}". "fx collaborator generate-cert-request -n {NAME}". Fixes #768 Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add new tutorial example to OpenFL interactive API (#812) * Add new tutorial example to OpenFL interactive API This adds a new tutorial example on distributing a linear regression task over OpenFL cluster The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters. Fixes #798 Co-authored-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> * reduced requirements.txt in workspace Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> --------- Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (#776) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * build(deps): bump tensorflow (#777) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update GaNDLF repo location and test CI with master branch Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix documentation links. Change path names and templates for CI Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix paths Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix breaking tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add compatible onnx version to requirements.txt file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong csv file name Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong names in workflow file Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix wrong data path Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint in test_gandlf.py Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix lint errors Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid (#841) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix GaNDLF documentation links (#842) * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation * Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix links in GaNDLF Documentation Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Fix incorrectly formatted link in docs (#839) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in local-runtime.py Integrated aggregator as stateful actor branch, tested. Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> -------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump onnx in /openfl-workspace/gandlf_seg_test (#840) Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0. - [Release notes](https://github.com/onnx/onnx/releases) - [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md) - [Commits](https://github.com/onnx/onnx/compare/v1.12.0...v1.13.0) --- updated-dependencies: - dependency-name: onnx dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Merged changes of remove-torch-dependency branch Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update setup.py Upgrading protobuf to 3.20.3 as per tensorboard requirement Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility updates (#861) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp (#773) * build(deps): bump tensorflow in /openfl-workspace/keras_nlp Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update RMSProp optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> * flake8 Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_mnist (#771) * build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * revert experimental Adam to legacy (#863) Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/keras_cnn_with_compression (#770) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Adam Optimizer import Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.9.3 to 2.11.1 in /openfl-tutorials/interactive_api/Flax_CNN_CIFAR (#775) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.9.3...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Fixed breaking backages Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add quiet flag back to pip install Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow-cpu from 2.8.4 to 2.11.1 in /openfl-workspace/keras_nlp_gramine_ready (#769) * build(deps): bump tensorflow-cpu Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow-cpu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Use legacy RMSprop optimizer Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Accessibility color contrast fixes (#864) * Fix incorrectly formatted link in docs Signed-off-by: Francis Storr <francis.storr@intel.com> * Font styling, color contrast, other accessibility updates This update: 1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples. 2. Adds colors (in `colors.css`) 3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future. Closes #848 Signed-off-by: Francis Storr <francis.storr@intel.com> * Color contrast updates for accessibility Color contrast updates for accessibility - update generic `a` element - update color of links in the toggle-able read-the-docs panel - update the color of the text in search results - update the color of notes headers Signed-off-by: Francis Storr <francis.storr@intel.com> --------- Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Tweak link color so it’s not so aggressive (#865) Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /tests/github/interactive_api_director/experiments/tensorflow_mnist/envoy (#772) * build(deps): bump tensorflow Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update sd_requirements.txt * revert to legacy SGD and install tensorflow==2.11 for workflow Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * build(deps): bump tensorflow from 2.8.4 to 2.11.1 in /openfl-workspace/tf_2dunet (#774) * build(deps): bump tensorflow in /openfl-workspace/tf_2dunet Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](https://github.com/tensorflow/tensorflow/compare/v2.8.4...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update requirements.txt to retrigger CI * Update requirements.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Tensorflow, gRPC, Protobuf dependencies (#868) * Update Tensorflow to latest, finally update grpcio/protobuf Signed-off-by: Patrick Foley <psfoley@gmail.com> * Lint issue fix and missing tf reference Signed-off-by: Patrick Foley <psfoley@gmail.com> * pyzmq version fixed * fix taskrunner tests for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix taskrunner test syntax for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * adding user option to workspace pip install requirements for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix windows CI test Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing virtual env for windows github actions Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * testing venv for windows Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * test venv for windows * test venv for windows * Added new KerasSerializer. Fixed other Interactive API experiments * Update taskrunner.yml * Update taskrunner.yml * Update workspace.py * Update workspace.py * Update taskrunner.yml * Remove get_model import from global namespace so dependencies are not loaded into memory unnecessarily (breaking windows build) * Refactoring and cleaning up imports to support Windows install * Fixed logger import paths * Fix missing imports * Fix native import * Fix lint errors * Fix keras optimizer patch. Remove irrelevant unit test * Format logs in UTF-8 for windows * Update interactive-kvasir.yml * Consolidate github actions python versions to single file * Update python versions * Update python versions * Update python versions * Reduce # of DataLoader workers for Pytorch Kvasir CI test * Fix Windows encoding * Fix Windows encoding and limit rounds so Github Actions CI doesn't run out of memory Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix windows encoding * Fix Windows encoding --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Add FL plan description to documentation (#872) * Add plan description to documentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * fix indentation Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> * Apply suggestions from code review Co-authored-by: Patrick Foley <patrick.foley@intel.com> --------- Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved flake8 issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * GPU Added for aggregator Fixed issue in 103 Cyclic Institutional Incremental Learning tutorial Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolve Coverity Issues (#874) * Fix coverity issues * Resolve remaining coverity issues Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Migrate to Ubuntu 22.04 LTS release (supported through 2027) (#875) Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation: docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Updated documentation Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update workflow_interface.rst Fixing typo Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added best model and last model extraction technique in docs/workflow_interface.rst Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added GPU for aggregator Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolving merge conflicts in 103 cyclic tutorial notebook fixing FedAvg in workflow interface tutorials to be compatible with latest numpy stable release (1.24.3) (#833) * fixing FedAvg averaging in order to be compatible with numpy v1.24+ Signed-off-by: kta-intel <kevin.ta@intel.com> * uncommenting installations for consistency with other tutorials Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarking tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * fixing 301_MNIST_Watermarki ng tutorial FedAvg Signed-off-by: kta-intel <kevin.ta@intel.com> * Switching to py38 kernel and clearing cell outputs Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: kta-intel <kevin.ta@intel.com> --------- Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Resolved merge conflicts in tests/github/experimental/testflow_datastore_cli.py Testflow for verifying stdout redirection to Metaflow datastore (#758) * implemented ray.wait * reverted changes back after testing * adding datastore cli test case * removed unused variables * removed stderr validation * fixed lint suggestions Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Added weighted_average aggregation function under openfl.experimental.interface.{keras,torch}.aggregation_funtions Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update EdenPipeline in the documentation (#877) Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * WIP: CI Scans (#873) * Initial scans commit for bandit, hadolint, trivy Signed-off-by: Patrick Foley <psfoley@gmail.com> * Address bandit scan results Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix Trivy action Signed-off-by: Patrick Foley <psfoley@gmail.com> * Fix linting Signed-off-by: Patrick Foley <psfoley@gmail.com> * Add Coverity Badge Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> * Update Hadolint threshold to flag errors only Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * Update ROADMAP.md (#878) Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> * initial commit * add docstrings * change importlib to import * remove unnecesary files, replace ray with ray_grouped * remove max concurency, add number of actors * Trigger CI * run tests * lint changes * flake * changed number of actors to num_actors, added docs * Fixed workflow API tests Signed-off-by: Patrick Foley <psfoley@gmail.com> * lint fixes Signed-off-by: Patrick Foley <psfoley@gmail.com> --------- Signed-off-by: Patrick Foley <psfoley@gmail.com> Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Signed-off-by: sarthakpati <sarthak.pati@hotmail.com> Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com> Signed-off-by: Parth Mandaliya <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <Parthx.Mandaliya@intel.com> Signed-off-by: He, Dan H <dan.h.he@intel.com> Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com> Signed-off-by: Grant Baker <grant.baker@intel.com> Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com> Signed-off-by: Baker, Grant <grant.baker@intel.com> Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com> Signed-off-by: Beverly Klemme <beverly.klemme@intel.com> Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com> Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Signed-off-by: Yi CAO <yi2.cao@intel.com> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Francis Storr <francis.storr@intel.com> Signed-off-by: kta-intel <kevin.ta@intel.com> Signed-off-by: Mansi Sharma <mansi.sharma@intel.com> Signed-off-by: Amit Portnoy <1131991+amitport@users.noreply.github.com> Co-authored-by: Patrick Foley <patrick.foley@intel.com> Co-authored-by: Olga Perepelkina <olga.perepelkina@intel.com> Co-authored-by: Joe Devon <138038+joedevon@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@hotmail.com> Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com> Co-authored-by: akantak <aleksander.kantak@intel.com> Co-authored-by: Parth Mandaliya <parthx.mandaliya@intel.com> Co-authored-by: Parth Mandaliya <Parthx@Mandaliya.intel.com> Co-authored-by: Parth Mandaliya <parth.mandaliya.007@gmail.com> Co-authored-by: Keerti Talwar <keertix.talwar@intel.com> Co-authored-by: KeertiX <keertix.talwarx@intel.com> Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com> Co-authored-by: He, Dan H <dan.h.he@intel.com> Co-authored-by: xiaoranf <desolatefang@gmail.com> Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com> Co-authored-by: Lei5 Chen <lei5.chen@intel.com> Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com> Co-authored-by: Grant Baker <grant.baker@intel.com> Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com> Co-authored-by: Yi CAO <yi2.cao@intel.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu> Co-authored-by: Francis Storr <francis.storr@intel.com> Co-authored-by: Patrick Foley <psfoley@gmail.com> Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com> Co-authored-by: kta-intel <kevin.ta@intel.com> Co-authored-by: Mansi Sharma <77758170+mansishr@users.noreply.github.com> Co-authored-by: Mansi Sharma <mansi.sharma@intel.com> Co-authored-by: Sachin Gupta <sachin.gupta.dsp@gmail.com> Co-authored-by: Keerti Prakash Talwar <115972088+KeertiX@users.noreply.github.com> Co-authored-by: Amit Portnoy <1131991+amitport@users.noreply.github.com>

Update ROADMAP.md

1cef9a8

psfoley merged commit f7f8232 into securefederatedai:develop Mar 20, 2023

psfoley deleted the roadmap-q2-2023 branch March 20, 2023 23:25

fangxiaoran pushed a commit to fangxiaoran/openfl that referenced this pull request Apr 29, 2023

Update ROADMAP.md (securefederatedai#765)

6c1dcc1

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

ParthM-GitHub pushed a commit to ParthMandaliya/openfl that referenced this pull request May 10, 2023

Update ROADMAP.md (securefederatedai#765)

5de3ec5

Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com>

ParthMandaliya pushed a commit to ParthMandaliya/openfl that referenced this pull request Oct 5, 2023

Update ROADMAP.md (securefederatedai#765)

10dbfa0

Signed-off-by: ParthM-GitHub <parthx.mandaliya@intel.com> Signed-off-by: Parth Mandaliya <parth.mandaliya.007@gmail.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Q2 2023 Roadmap #765

Q2 2023 Roadmap #765

psfoley commented Mar 20, 2023

Q2 2023 Roadmap #765

Q2 2023 Roadmap #765

Conversation

psfoley commented Mar 20, 2023