Skip to content

Commit

Permalink
Pass dynamic workflow closure in node execution events (flyteorg#141)
Browse files Browse the repository at this point in the history
Signed-off-by: Chao-Han Tsai <milton0825@gmail.com>
  • Loading branch information
Katrina Rogan authored and milton0825 committed Apr 14, 2021
1 parent 75b7edd commit 999539d
Show file tree
Hide file tree
Showing 35 changed files with 26,701 additions and 4,281 deletions.
608 changes: 543 additions & 65 deletions gen/pb-cpp/flyteidl/admin/node_execution.pb.cc

Large diffs are not rendered by default.

293 changes: 290 additions & 3 deletions gen/pb-cpp/flyteidl/admin/node_execution.pb.h

Large diffs are not rendered by default.

639 changes: 558 additions & 81 deletions gen/pb-cpp/flyteidl/event/event.pb.cc

Large diffs are not rendered by default.

301 changes: 294 additions & 7 deletions gen/pb-cpp/flyteidl/event/event.pb.h

Large diffs are not rendered by default.

202 changes: 133 additions & 69 deletions gen/pb-go/flyteidl/admin/node_execution.pb.go

Large diffs are not rendered by default.

98 changes: 98 additions & 0 deletions gen/pb-go/flyteidl/admin/node_execution.pb.validate.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

232 changes: 148 additions & 84 deletions gen/pb-go/flyteidl/event/event.pb.go

Large diffs are not rendered by default.

98 changes: 98 additions & 0 deletions gen/pb-go/flyteidl/event/event.pb.validate.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

36 changes: 36 additions & 0 deletions gen/pb-go/flyteidl/service/admin.swagger.json
Original file line number Diff line number Diff line change
Expand Up @@ -6115,6 +6115,20 @@
}
}
},
"flyteidladminDynamicWorkflowNodeMetadata": {
"type": "object",
"properties": {
"id": {
"$ref": "#/definitions/coreIdentifier",
"description": "id represents the unique identifier of the workflow."
},
"compiled_workflow": {
"$ref": "#/definitions/coreCompiledWorkflowClosure",
"description": "Represents the compiled representation of the embedded dynamic workflow."
}
},
"description": "For dynamic workflow nodes we send information about the dynamic workflow definition that gets generated."
},
"flyteidladminNodeExecution": {
"type": "object",
"properties": {
Expand Down Expand Up @@ -6170,6 +6184,10 @@
"catalog_key": {
"$ref": "#/definitions/coreCatalogMetadata",
"title": "This structure carries the catalog artifact information"
},
"dynamic_workflow": {
"$ref": "#/definitions/flyteidladminDynamicWorkflowNodeMetadata",
"description": "In the case this task launched a dynamic workflow we capture its structure here."
}
},
"title": "Metadata for the case in which the node is a TaskNode"
Expand All @@ -6195,6 +6213,20 @@
},
"description": "A strongly typed schema that defines the interface of data retrieved from the underlying storage medium."
},
"flyteidleventDynamicWorkflowNodeMetadata": {
"type": "object",
"properties": {
"id": {
"$ref": "#/definitions/coreIdentifier",
"description": "id represents the unique identifier of the workflow."
},
"compiled_workflow": {
"$ref": "#/definitions/coreCompiledWorkflowClosure",
"description": "Represents the compiled representation of the embedded dynamic workflow."
}
},
"description": "For dynamic workflow nodes we send information about the dynamic workflow definition that gets generated."
},
"flyteidleventTaskNodeMetadata": {
"type": "object",
"properties": {
Expand All @@ -6205,6 +6237,10 @@
"catalog_key": {
"$ref": "#/definitions/coreCatalogMetadata",
"title": "This structure carries the catalog artifact information"
},
"dynamic_workflow": {
"$ref": "#/definitions/flyteidleventDynamicWorkflowNodeMetadata",
"description": "In the case this task launched a dynamic workflow we capture its structure here."
}
}
},
Expand Down
2 changes: 2 additions & 0 deletions gen/pb-go/flyteidl/service/flyteadmin/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -266,11 +266,13 @@ Class | Method | HTTP request | Description
- [EventWorkflowExecutionEvent](docs/EventWorkflowExecutionEvent.md)
- [ExecutionErrorErrorKind](docs/ExecutionErrorErrorKind.md)
- [ExecutionMetadataExecutionMode](docs/ExecutionMetadataExecutionMode.md)
- [FlyteidladminDynamicWorkflowNodeMetadata](docs/FlyteidladminDynamicWorkflowNodeMetadata.md)
- [FlyteidladminNodeExecution](docs/FlyteidladminNodeExecution.md)
- [FlyteidladminTaskExecution](docs/FlyteidladminTaskExecution.md)
- [FlyteidladminTaskNodeMetadata](docs/FlyteidladminTaskNodeMetadata.md)
- [FlyteidladminWorkflowNodeMetadata](docs/FlyteidladminWorkflowNodeMetadata.md)
- [FlyteidlcoreSchema](docs/FlyteidlcoreSchema.md)
- [FlyteidleventDynamicWorkflowNodeMetadata](docs/FlyteidleventDynamicWorkflowNodeMetadata.md)
- [FlyteidleventTaskNodeMetadata](docs/FlyteidleventTaskNodeMetadata.md)
- [FlyteidleventWorkflowNodeMetadata](docs/FlyteidleventWorkflowNodeMetadata.md)
- [IoStrategyDownloadMode](docs/IoStrategyDownloadMode.md)
Expand Down
Loading

0 comments on commit 999539d

Please sign in to comment.