Pandas > 2.2 compatibility required

[ayaan-ak-1]

Is your feature request related to a problem? Please describe.
SQream connection requires pysqream-sqlalchemy which supports pandas >2.2 but GX need pandas <2.2 so its not compatible

Describe the solution you'd like
It would be good if pandas >2.2 compatibility is available

[adeola-ak]

Hi there! Thank you for submitting this feature request. I've noted it and will pass it along to the appropriate team. Please check back on the issue for any updates.

[vicentesurraco]

would definitely appreciate this, this is causing some dependency conflicts for me

[zschira]

Curious if there's any progress on this? This is basically blocking our ability to use great expectations at the moment.

[zaneselvans]

It's been a year since Pandas 2.2 came out, and 7 months since Numpy 2.0. Do y'all think this is likely to be a painful update, or have any context to share on what would be required to make it happen? Would you be open to PRs attempting to accommodate the new versions? What kind of backward compatibility with older versions of these libraries do you need to maintain?

[Kilo59]

This looks like it was meant to be a temporary pin.

• [MAINTENANCE] Temporarily update Pandas pins to unblock V1 prerelease #10175
• [MAINTENANCE] Revert "[MAINTENANCE] Temporarily update Pandas pins to unblock V1 prerelease" #10176

I would reach out to @cdkini & @billdirks

[billdirks]

Currently, to support an Airflow compatibility requirement, we need to support SqlAlchemy 1.4.X. However, Pandas 2.2 breaks SQLALchemy 1.4 compatibility. That ticket indicates this compatibility issue will be resolved in Pandas 2.3. Since we had previously heard (can't find the source currently) that Pandas 2.3 was coming out around December 2024 and we became aware of this issue in November 2024 that we would wait for that release.
This currently isn't prioritized but, in general, we do want to support the latest version of Pandas. I can bring it up for discussion internally at GX.