Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Remove legacy fetch for workflow execution inputs #173

Merged
merged 2 commits into from
Mar 31, 2021

Conversation

katrogan
Copy link
Contributor

TL;DR

Formerly we directly passed workflow exec inputs in the response to GetWorkflowExecution. This has long since moved to a separate api call, GetExecutionData and fetching inputs from a cloud blobstore is slow and now unnecessary.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

flyteorg/flyte#879

Follow-up issue

NA

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
@codecov
Copy link

codecov bot commented Mar 31, 2021

Codecov Report

Merging #173 (2bfd09a) into master (55c3291) will increase coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #173   +/-   ##
=======================================
  Coverage   63.04%   63.04%           
=======================================
  Files         100      100           
  Lines        7295     7285   -10     
=======================================
- Hits         4599     4593    -6     
+ Misses       2114     2112    -2     
+ Partials      582      580    -2     
Flag Coverage Δ
unittests 63.04% <ø> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
pkg/manager/impl/execution_manager.go 68.98% <ø> (+0.10%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 55c3291...2bfd09a. Read the comment docs.

@katrogan katrogan merged commit e35e4f2 into master Mar 31, 2021
EngHabu pushed a commit that referenced this pull request Apr 26, 2021
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
EngHabu pushed a commit that referenced this pull request Apr 26, 2021
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
EngHabu added a commit that referenced this pull request Apr 30, 2021
…D and OAuth2 configs, OAuth2 Metadata over gRPC #minor (#168)

* wip: OAuth2 Support

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* tighten security of generated tokens

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Support storing form post values in auth code JWT

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* save secrets to k8s secrets

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Expose metadata endpoints over gRPC

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* trim OpenID Connect config further

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Selectively authenticate gRPC endpoints

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Support external oauth2 server and Okta Config

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* update config

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix nil secrets data map

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fixed the pointer overwrite issue in oauthServer metadata (#183)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Simplify config further and move auth package up

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix clusterresource Project and domain(#167)

* Fix clusterresource Project

Signed-off-by: Anand Swaminathan <aswaminathan@lyft.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Bump flyteidl version to pick up auth role field number fix (#169)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add option to use project name as namespace for the task pods (#166)

* Add option to use project name as namespace for the task pods

Signed-off-by: Jeev B <jeev.balakrishnan@freenome.com>

* rename

Signed-off-by: Jeev B <jeev.balakrishnan@freenome.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* GetExecution performance improvements (#171)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add exists check for workflow & node executions (#172)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove legacy fetch for workflow execution inputs (#173)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added release workflow (#170)

Signed-off-by: yuvraj <evalsocket@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update Flyteidl version (#175)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added version in flyteadmin (#154)

* wip: added version pkg

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: resolve conflict

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added version in rpc

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fixes

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: Added panic cache in get version service

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added flytestdlib for version package

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added version service test

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added ldflags in goreleaser

Signed-off-by: yuvraj <evalsocket@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Propagate nesting and principal for child executions (#177)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Write workflow and node execution events asynchronously (#174)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add sensible flyteadmin config defaults (#179)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Lint

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* further cleanup

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Only register authserver when auth is enabled

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update to latest flyteidl and separate auth interfaces

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* dead code

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* merge master

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Move to authorizedUris

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update to released flyteidl

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix response expiry and add unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update go mod

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix unit tests that broke because of identity changes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>
Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Co-authored-by: Anand Swaminathan <aswaminathan@lyft.com>
Co-authored-by: Katrina Rogan <katrina@nuclyde.io>
Co-authored-by: Jeev B <jeevb@users.noreply.github.com>
Co-authored-by: Yuvraj <10830562+evalsocket@users.noreply.github.com>
Co-authored-by: Flyte Bot <admin@flyte.org>
eapolinario pushed a commit that referenced this pull request Sep 6, 2023
…D and OAuth2 configs, OAuth2 Metadata over gRPC #minor (#168)

* wip: OAuth2 Support

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* tighten security of generated tokens

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Support storing form post values in auth code JWT

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* save secrets to k8s secrets

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Expose metadata endpoints over gRPC

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* trim OpenID Connect config further

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Selectively authenticate gRPC endpoints

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Support external oauth2 server and Okta Config

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* update config

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix nil secrets data map

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fixed the pointer overwrite issue in oauthServer metadata (#183)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Simplify config further and move auth package up

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix clusterresource Project and domain(#167)

* Fix clusterresource Project

Signed-off-by: Anand Swaminathan <aswaminathan@lyft.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Bump flyteidl version to pick up auth role field number fix (#169)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add option to use project name as namespace for the task pods (#166)

* Add option to use project name as namespace for the task pods

Signed-off-by: Jeev B <jeev.balakrishnan@freenome.com>

* rename

Signed-off-by: Jeev B <jeev.balakrishnan@freenome.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* GetExecution performance improvements (#171)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add exists check for workflow & node executions (#172)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove legacy fetch for workflow execution inputs (#173)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added release workflow (#170)

Signed-off-by: yuvraj <evalsocket@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update Flyteidl version (#175)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added version in flyteadmin (#154)

* wip: added version pkg

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: resolve conflict

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added version in rpc

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fixes

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: Added panic cache in get version service

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added flytestdlib for version package

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added version service test

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added ldflags in goreleaser

Signed-off-by: yuvraj <evalsocket@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Propagate nesting and principal for child executions (#177)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Write workflow and node execution events asynchronously (#174)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add sensible flyteadmin config defaults (#179)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Lint

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* further cleanup

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Only register authserver when auth is enabled

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update to latest flyteidl and separate auth interfaces

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* dead code

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* merge master

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Move to authorizedUris

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update to released flyteidl

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix response expiry and add unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update go mod

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix unit tests that broke because of identity changes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>
Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Co-authored-by: Anand Swaminathan <aswaminathan@lyft.com>
Co-authored-by: Katrina Rogan <katrina@nuclyde.io>
Co-authored-by: Jeev B <jeevb@users.noreply.github.com>
Co-authored-by: Yuvraj <10830562+evalsocket@users.noreply.github.com>
Co-authored-by: Flyte Bot <admin@flyte.org>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants