Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync v2-9-stable with v2-9-test to release 2.9.3 #40546

Merged
merged 85 commits into from
Jul 12, 2024
Merged

Sync v2-9-stable with v2-9-test to release 2.9.3 #40546

merged 85 commits into from
Jul 12, 2024

Conversation

utkarsharma2
Copy link
Contributor

Time for 2.9.3rc1!

techolga and others added 23 commits July 1, 2024 18:57
@techolga @utkarsharma2
Improve trigger UI for string array format validation (#39993)
d4d5cd6 
* Improve trigger UI for string array format validation

The schema argument in a Param definition is used to detemine the
relevant UI element. When the type of a Param is `array` a simple
textarea is rendered. When additionally a schema for the items of
the array is provided, the UI element previously switched to a
CodeMirror box that expects pure JSON inputs. For strings a textarea
is presented now, to keep the same behaviour than without a format
definition.

Besides that the jinja template now accesses the `items` member of the
schema correctly to avoid problems with empty `items` arrays.

* Add details about the attribute `items` for the type `array`

(cherry picked from commit 914bccc)
@bangjiehan @utkarsharma2
Update index.rst (#40040)
5d308b6 
Remove the word "docker-compose" in PyPI section.

(cherry picked from commit 32cf8cf)
@bangjiehan @utkarsharma2
Fix typos in overview.rst (#40061)
5f77291 
(cherry picked from commit 9bcf665)
@jedcunningham @utkarsharma2
Docs: Simpler command to check local scheduler is alive (#40074)
d414c9e 
(cherry picked from commit 16e0182)
@bangjiehan @utkarsharma2
Fix grammar in dags.rst (#40085)
5837721 
* Fix grammer dags.rst

To say "add Operator/Task to the DAG" even though DAG is an argument of Operator constructor, and use the word "with statement" explicitly instead of context manger to be friendly to Python beginner.

* Fix grammer in dags.rst

Because there is a direction in relationship, it's somehow confuse to say that they depend on each other.

* Fix grammer in dags.rst

(cherry picked from commit b03aa6c)
@noel-gallagher @utkarsharma2
fix typo in example_params_ui_tutorial (#40094)
e9d3722 
(cherry picked from commit a31b10e)
@bangjiehan @utkarsharma2
Remove apt-transport-https because It is a dummy transitional package(#…
2030b5f 
…40015)

Remove apt-transport-https because It is a dummy transitional package.

(cherry picked from commit 0e8d823)
@jedcunningham @utkarsharma2
Use a join for TI notes in TI batch API endpoint (#40028)
60c0c7a 
(cherry picked from commit 4723dbe)
@jedcunningham @utkarsharma2
Add warning to deprecated api docs that access control isn't applied (#…
b868630 
…40129)

(cherry picked from commit 85be186)
@potiuk @utkarsharma2
Upgrade to codecov@v4 (#40128)
67a3cb0 
Codecov3 uses deprecated node version and generates warnings.

(cherry picked from commit 27579cb)
@bangjiehan @utkarsharma2
Fix highlight of example code in dags.rst (#40114)
be1c93e 
highlight task_group decorator and dependency between task and task group.

(cherry picked from commit 340d6b0)
@kacpermuda @utkarsharma2
Fix typo in providers_manager.py (#40157)
309440d 
Signed-off-by: Kacper Muda <mudakacper@gmail.com>
(cherry picked from commit 072c63b)
@bangjiehan @utkarsharma2
Fix minor typo in dags.rst (#40169)
a724ff5 
(cherry picked from commit e9e3c93)
@dependabot @utkarsharma2
Bump braces from 3.0.2 to 3.0.3 in /airflow/www (#40180)
56f2ee3 
Bumps [braces](https://github.com/micromatch/braces) from 3.0.2 to 3.0.3.
- [Changelog](https://github.com/micromatch/braces/blob/master/CHANGELOG.md)
- [Commits](micromatch/braces@3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: braces
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit 1533ba6)
@Usiel @utkarsharma2
Ensures DAG params order regardless of backend (#40156)
92777ad 
* Ensures DAG params order regardless of backend

Fixes #40154

This change adds an extra attribute to the serialized DAG param objects which helps us decide
the order of the deserialized params dictionary later even if the backend messes with us.

I decided not to limit this just to MySQL since the operation is inexpensive and may turn
out to be helpful.

I made sure the new test fails with the old implementation + MySQL. I assume this test will be
executed with MySQL somewhere in the build actions?

* Removes GitHub reference

Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>

* Serialize DAG params as array of tuples to ensure ordering

Alternative to previous approach: We serialize the DAG params dict as a list of tuples which _should_ keep their ordering regardless of backend.

Backwards compatibility is ensured because if `encoded_params` is a `dict` (not the expected `list`) then `dict(encoded_params)` still works.

* Make backwards compatibility more explicit

Based on suggestions by @uranusjr with an additional fix to make mypy happy.

---------

Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
(cherry picked from commit 2149b4d)
@raphaelauv @utkarsharma2
doc: metrics allow_list complet example (#40120)
d4fae59 
Co-authored-by: raphaelauv <raphaelauv@users.noreply.github.com>
(cherry picked from commit 205ad57)
@phi-friday @utkarsharma2
Fix import future annotations in venv jinja template (#40208)
47b5bb6 
(cherry picked from commit d5a7544)
@bangjiehan @utkarsharma2
Fix typo in tasks.rst (#40228)
b6b076a 
(cherry picked from commit 2587295)
@htpawel @utkarsharma2
Fix dag task scheduled and queued duration metrics (#37936)
4d94071 
(cherry picked from commit bffb7b0)
@merobi-hub @utkarsharma2
Add slightly more detailed guidance about upgrading to the docs (#40227)
800b63a 
---------

Signed-off-by: merobi-hub <merobi@gmail.com>
(cherry picked from commit 16b17f7)
@bangjiehan @utkarsharma2
Fix typo in index.rst (#40245)
7202f27 
(cherry picked from commit f5079db)
@softyoungha @utkarsharma2
Change httpx to requests in file_task_handler (#39799)
81dd423 
* Change httpx to requests in file_task_handler

- httpx does not support CIDRs in NO_PROXY
- simply, convert httpx to requests, issues done
- related issue: #39794

* Add cidr no_proxy test test_log_handlers.py

* Apply monkeypatch fixture

---------

Co-authored-by: scott-py <scott.py@kakaocorp.com>
(cherry picked from commit 1ddadf5)
@bangjiehan @utkarsharma2
Fix typo in xcoms.rst (#40265)
66d5369 
(cherry picked from commit 5690439)
@potiuk
Copy link
Member

potiuk commented Jul 9, 2024

BTW. Depending how much we are in a hurry, but it might be worth to wait for the wave of providers being currently voted to be released and regenerate constraints after that, to get the latest providers - there are a few important fixes there.

@ephraimbuddy
Copy link
Contributor

BTW. Depending how much we are in a hurry, but it might be worth to wait for the wave of providers being currently voted to be released and regenerate constraints after that, to get the latest providers - there are a few important fixes there.

Yeah. Makes sense. We can wait.

@utkarsharma2 utkarsharma2 force-pushed the v2-9-test branch 2 times, most recently from 117d275 to b55aaa4 Compare July 9, 2024 09:57
@utkarsharma2 utkarsharma2 requested a review from dstandish as a code owner July 12, 2024 12:18
jedcunningham and others added 11 commits July 12, 2024 18:36
@jedcunningham @utkarsharma2
Fix param order in PythonOperator docstring (#40122)
6e805ca 
(cherry picked from commit b49db97)
@smlee729 @utkarsharma2
Recognize quotes when parsing urls in logs (#40508)
2179f2a 
---------

Co-authored-by: Jacob Lee <seungmin_lee3@apple.com>
(cherry picked from commit 2f9b23d)
@eladkal @utkarsharma2
Further clarify triage process (#40536)
b3b78e8 
* Further clarify triage process

* update

* update

(cherry picked from commit 90a6d7f)
@simi @utkarsharma2
Update best-practices.rst (#40505)
868e38b 
- minor rephrase of example

(cherry picked from commit 5b2becb)
@ayushjain2809 @utkarsharma2
Remove logging for "blocked" events (#40446)
6fdbe23 
(cherry picked from commit ed6849e)
@vincbeck @utkarsharma2
Fix bug in SchedulerJobRunner._process_executor_events (#40563)
21ed1bb 
(cherry picked from commit a8c4830)
@steffidlf @utkarsharma2
Fix import statement for DatasetOrTimetable example (#40601)
041ba02 
Fix import statement for DatasetOrTimetable example

(cherry picked from commit a984d97)
@CaselIT @utkarsharma2
Update serializers.rst (#40597)
964abfd 
Mention that ``serialize`` cannot return bytes

(cherry picked from commit 49ded9f)
@amoghrajesh @utkarsharma2
Updating airflow download links to CDN based links (#40618)
fac4962 
(cherry picked from commit 77a9850)
@abhishekbhakat @utkarsharma2
Skip checking subdagslist if taskinstance state is skipped (#40578)
7f7d638 
* Skip checking subdagslist if taskinstance state is skipped

* linter fixes

(cherry picked from commit ec5da92)
@a1ea321 @utkarsharma2
Add warning about the PostgresOperator being deprecated (#40662)
f0cb571 
PostgresOperator's reference page says it's deprecated. I am not knowledgeable enough to write a tutorial. I think if someone reads the guide (I linked to in my change) they will be able to use this tutorial as well.

(cherry picked from commit a10ac28)
@eladkal
Copy link
Contributor

eladkal commented Jul 12, 2024

BTW. Depending how much we are in a hurry, but it might be worth to wait for the wave of providers being currently voted to be released and regenerate constraints after that, to get the latest providers - there are a few important fixes there.

Yeah. Makes sense. We can wait.

Providers are released

@utkarsharma2
Copy link
Contributor Author

Providers are released

Thanks @eladkal we'll start the release process for rc1.

@utkarsharma2 @ephraimbuddy
Update RELEASE_NOTES.rst
e847879 
Update release notes

Update RELEASE_NOTES.rst

Update release notes

Update RELEASE_NOTES

Fix static checks

Update RELEASE_NOTES.rst

Updated release date

Fix static check

update release notes
@ephraimbuddy ephraimbuddy merged commit 81845de into v2-9-stable Jul 12, 2024
110 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@eladkal eladkal eladkal left review comments

@potiuk potiuk potiuk approved these changes

@ephraimbuddy ephraimbuddy ephraimbuddy approved these changes

@phanikumv phanikumv phanikumv approved these changes

@ashb ashb Awaiting requested review from ashb ashb is a code owner

@jedcunningham jedcunningham Awaiting requested review from jedcunningham jedcunningham is a code owner

@ryanahamilton ryanahamilton Awaiting requested review from ryanahamilton ryanahamilton is a code owner

@bbovenzi bbovenzi Awaiting requested review from bbovenzi bbovenzi is a code owner

@pierrejeambrun pierrejeambrun Awaiting requested review from pierrejeambrun pierrejeambrun is a code owner

@kaxil kaxil Awaiting requested review from kaxil kaxil is a code owner

@bolkedebruin bolkedebruin Awaiting requested review from bolkedebruin bolkedebruin is a code owner

@XD-DENG XD-DENG Awaiting requested review from XD-DENG XD-DENG is a code owner

@o-nikolas o-nikolas Awaiting requested review from o-nikolas o-nikolas is a code owner

@dstandish dstandish Awaiting requested review from dstandish dstandish is a code owner

Assignees
No one assigned
Labels
area:API Airflow's REST/HTTP API area:CLI area:core-operators Operators, Sensors and hooks within Core Airflow area:db-migrations PRs with DB migration area:dev-tools area:production-image Production image improvements and fixes area:providers area:Scheduler including HA (high availability) scheduler area:serialization provider:fab
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.