Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Kubeflow tensorboard viz and fix tensorflow file IO for cloud back-ends #447

Merged
merged 23 commits into from
Mar 11, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
3a71887
Added tensorboard example
htahir1 Mar 1, 2022
e038ecb
Container entrypoint updated to use tensorboard if right model type
htahir1 Mar 1, 2022
0f471eb
Fix tensorboard example
stefannica Mar 6, 2022
3d9fe5c
Don't print locals with rich traces unless in debug mode
stefannica Mar 6, 2022
031941a
Fix shared file IO support for tensorflow
stefannica Mar 6, 2022
2bbe2bf
Fix linter errors
stefannica Mar 7, 2022
2806dc5
Updated tensorboard example
stefannica Mar 7, 2022
dfebffa
Add tensorboard example to integration tests
stefannica Mar 7, 2022
7c20e0d
Fix Kubeflow metadata store implementation
stefannica Mar 8, 2022
2261c61
Fix Kubeflow Tensorboard visualizer with local artifact
stefannica Mar 8, 2022
7010889
Implement Tensorboard visualizer and merge the Kubeflow and Tensorboa…
stefannica Mar 8, 2022
3d2bc58
Fix tensorboard visualizer on windows
stefannica Mar 9, 2022
e2b0feb
Fix local artifact store detection in Kubeflow
stefannica Mar 9, 2022
db2c7cc
Fix windows integration test cases
stefannica Mar 9, 2022
2e772cb
Addressed code review
stefannica Mar 9, 2022
5c93f68
Update src/zenml/integrations/kubeflow/orchestrators/local_deployment…
stefannica Mar 9, 2022
467a59a
Update src/zenml/integrations/kubeflow/orchestrators/local_deployment…
stefannica Mar 9, 2022
f133278
Added kubeflow notebook error message
htahir1 Mar 10, 2022
412e9e4
Made small changes to example README
htahir1 Mar 10, 2022
0320de5
Merge remote-tracking branch 'origin/develop' into feature/ENG-496-ad…
htahir1 Mar 10, 2022
18c39fb
added docs
htahir1 Mar 10, 2022
be188a3
fixed a nav bar thing [ci skip]
htahir1 Mar 10, 2022
8769f25
Changed to RuntimeError [ci skip]
htahir1 Mar 11, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix shared file IO support for tensorflow
* when tensorflow is installed, TFX activates its file IO plugin
with a priority higher than the ZenML IO plugin
* the 2.6 tensorflow release moves the IO support into a separate
python package (tensorflow_io) that must be installed and imported
explicitly for the S3/GCP/Azure FS schemes to be supported
  • Loading branch information
stefannica committed Mar 7, 2022
commit 031941a9d35db49bf1efd7d8021f4e3ddc288b8a
2 changes: 1 addition & 1 deletion examples/tensorboard/requirements.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
tensorflow==2.6.2
tensorflow==2.8.0
2 changes: 1 addition & 1 deletion src/zenml/integrations/aws/io/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@

from zenml.integrations.aws.io.s3_plugin import ZenS3

DEFAULT_FILESYSTEM_REGISTRY.register(ZenS3, 15)
DEFAULT_FILESYSTEM_REGISTRY.register(ZenS3, 5)
2 changes: 1 addition & 1 deletion src/zenml/integrations/azure/io/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@

from zenml.integrations.azure.io.azure_plugin import ZenAzure

DEFAULT_FILESYSTEM_REGISTRY.register(ZenAzure, 15)
DEFAULT_FILESYSTEM_REGISTRY.register(ZenAzure, 5)
2 changes: 1 addition & 1 deletion src/zenml/integrations/gcp/io/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@

from zenml.integrations.gcp.io.gcs_plugin import ZenGCS

DEFAULT_FILESYSTEM_REGISTRY.register(ZenGCS, 15)
DEFAULT_FILESYSTEM_REGISTRY.register(ZenGCS, 5)
5 changes: 4 additions & 1 deletion src/zenml/integrations/tensorflow/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,14 @@ class TensorflowIntegration(Integration):
"""Definition of Tensorflow integration for ZenML."""

NAME = TENSORFLOW
REQUIREMENTS = ["tensorflow==2.8.0"]
REQUIREMENTS = ["tensorflow==2.8.0", "tensorflow_io==0.24.0"]

@classmethod
def activate(cls) -> None:
"""Activates the integration."""
# need to import this explicitly to load the Tensoflow file IO support
# for S3 and other file systems
import tensorflow_io as tfio # noqa
from zenml.integrations.tensorflow import materializers # noqa


Expand Down