-
Notifications
You must be signed in to change notification settings - Fork 14.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updates to Teradata Provider #39217
Updates to Teradata Provider #39217
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice set of updates !
Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications.
Reopening due to accidental closure. |
tests/system/providers/teradata/example_azure_blob_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_azure_blob_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
Addressed following PR review comments Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
* Modified conn_id to teradata_conn_id for Teradata Operator * static check issue fixed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you also rebase please @satish-chinthanippu ?. We want to make sure all tests pass also with latest main |
rebase done. All tests are pass with latest main. |
@Taragolis @eladkal -> I reviewed and resolved all the conversations (they looked like answered/resolved) - will merge this one, byt if you have other comments possibly those can be done as a follow-up. |
* Updates to Teradata Provider with release 2.2.0 Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications. Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
* Updates to Teradata Provider with release 2.2.0 Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications. Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
Implemented enhancements to the Teradata Provider for Teradata.
This release incorporates the following features:
• Introduction of Stored Procedure Support in Teradata Hook
• Inclusion of the TeradataStoredProcedureOperator for executing stored procedures
• Integration of Azure Blob Storage to Teradata Transfer Operator
• Integration of Amazon S3 to Teradata Transfer Operator
• Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications.
Teradata Provider System Health Dashboard: https://teradata.github.io/airflow/
Teradata Provider documentation build status: https://github.com/Teradata/airflow/actions/workflows/ci-teradata-documentation.yml
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rst
or{issue_number}.significant.rst
, in newsfragments.