Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic component build sample #1681

Merged
merged 8 commits into from
Aug 8, 2019
Merged

Basic component build sample #1681

Changes from 2 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
20ab04a
adding a basic sample for component build
SinaChavoshi Jul 25, 2019
2da7e0e
adding a basic command line based sample for component build
SinaChavoshi Jul 25, 2019
7e8cf4b
Merge branch 'master' of https://github.com/kubeflow/pipelines into b…
SinaChavoshi Aug 5, 2019
0eb9ece
remvoing use of global
SinaChavoshi Aug 5, 2019
360b772
Update samples/core/component_build/component_build.py
SinaChavoshi Aug 6, 2019
8bad736
Merge remote-tracking branch 'upstream/master' into basic_component_b…
SinaChavoshi Aug 6, 2019
eee0a7b
Switching to Notebook based sample
SinaChavoshi Aug 7, 2019
24d2eeb
Added Pip install KFP SDK
SinaChavoshi Aug 7, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 22 additions & 32 deletions samples/basic/component_build.py → ...s/core/component_build/component_build.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ def process_args():
"""Define arguments and assign default values to the ones that are not set.

Returns:
args: The parsed namespace with defaults assigned to the flags.
parsed_args: The parsed namespace with defaults assigned to the flags.
"""

parser = argparse.ArgumentParser(
Expand All @@ -42,21 +42,33 @@ def process_args():
'--container_repo',
default=None,
required=True,
help='Repo path ex. gcr/oi/projecID/ for output of component build.')
args, _ = parser.parse_known_args()
return args
help='Repo path ex. gcr.oi/projecID for output of component build.')
parsed_args, _ = parser.parse_known_args()
return parsed_args


args = process_args()


@dsl.python_component(
name='add_op',
description='adds two numbers',
)
def add(a: float, b: float) -> float:
"""Calculates sum of two arguments."""
print('Adding two values %s and %s' %(a, b))
return a + b

add_op = None

# Using the build component to create a new docker image with add func code.
add_op = compiler.build_python_component(
component_func=add,
staging_gcs_path=args.output_path,
# You can add additional dependencies to the image.
dependency=[kfp.compiler.VersionedDependency(
name='google-api-python-client', version='1.7.0')],
base_image='python:alpine3.6',
target_image= ''.join([
args.container_repo,
'/',
args.target_image
]))


@dsl.pipeline(
Expand All @@ -67,26 +79,4 @@ def component_build_pipeline(var1=1.0, var2=2.0):
add_task = add_op(var1, var2)


def main():
args = process_args()

# Using the build component to create a new docker image with add func code
global add_op
add_op = compiler.build_python_component(
component_func=add,
staging_gcs_path=args.output_path,
# You can add add3 tional dependencies to the image
dependency=[kfp.compiler.VersionedDependency(
name='google-api-python-client', version='1.7.0')],
base_image='python:alpine3.6',
target_image= ''.join([
args.container_repo,
'/',
args.target_image
]))

kfp.compiler.Compiler().compile(component_build_pipeline, __file__ + '.zip')


if __name__ == '__main__':
main()
kfp.compiler.Compiler().compile(component_build_pipeline, __file__ + '.zip')