Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incompatible with latest version of google-cloud-bigquery #854

Open
edu230991 opened this issue Jan 16, 2025 · 8 comments
Open

Incompatible with latest version of google-cloud-bigquery #854

edu230991 opened this issue Jan 16, 2025 · 8 comments
Assignees
Labels
api: bigquery Issues related to the googleapis/python-bigquery-pandas API.

Comments

@edu230991
Copy link

pandas_gbq currently has unconstrained dependencies.
Yesterday a pretty key dependency like google-cloud-bigquery released a new version (https://pypi.org/project/google-cloud-bigquery/#history) which is incompatible with pandas_gbq at the moment.
I would strongly recommend constraining dependencies to avoid this in the future!

@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery-pandas API. label Jan 16, 2025
@parthea
Copy link
Contributor

parthea commented Jan 16, 2025

cc @Linchin @chalmerlowe

@Linchin Linchin assigned Linchin and unassigned liujiashang Jan 16, 2025
@Linchin
Copy link
Contributor

Linchin commented Jan 16, 2025

Thanks for letting us know, looking into this.

@Linchin
Copy link
Contributor

Linchin commented Jan 16, 2025

Could you give me an example of how exactly they are incompatible? It would be really helpful, thanks. @edu230991

@tswast
Copy link
Collaborator

tswast commented Jan 16, 2025

I wonder if it's related to this test failure? #855

dtypes = {}
        for field in schema_fields:
            name = str(field["name"])
            # Array BigQuery type is represented as an object column containing
            # list objects.
>           if field["mode"].upper() == "REPEATED":
E           KeyError: 'mode'

pandas_gbq/gbq.py:609: KeyError

It seems it may have been caused by my refactor of SchemaField. googleapis/python-bigquery#2097 where the "mode" no longer is populated to "NULLABLE" if not set.

@Linchin
Copy link
Contributor

Linchin commented Jan 16, 2025

Indeed, this seems to be the cause.

@edu230991
Copy link
Author

That's exactly it, sorry for not being more specific

@Linchin
Copy link
Contributor

Linchin commented Jan 16, 2025

I will yank 3.28.0

@Linchin
Copy link
Contributor

Linchin commented Jan 16, 2025

3.28.0 has been yanked

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-pandas API.
Projects
None yet
Development

No branches or pull requests

5 participants