free(): invalid next size (normal)

[plazmakeks]

python: 3.10.5
cryptography: 37.0.3
cffi: 1.15.0
pip: 21.3.1

Cryptography was installed via poetry as the complete envrionment.

I'm running ubuntu linux 20.04.4 with

❯ openssl version OpenSSL 1.1.1o 3 May 2022

I recently wrote a bigquery integration tests which just queries some data from bigquery. however, i get a weired c-style error from cryptography. my co-workers successfully run the tests with exactly the same certificate and python environment, however it fails on my machine. sketching the code it works like this:

from google.cloud import bigquery

client = bigquery.Client.from_service_account_json(credentials_path)
client.query(query)

which yields this error:

free(): invalid next size (normal)
Fatal Python error: Aborted

Current thread 0x00007f661cd40740 (most recent call first):
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/cryptography/hazmat/backends/openssl/rsa.py", line 289 in _rsa_sig_sign
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/cryptography/hazmat/backends/openssl/rsa.py", line 490 in sign
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/auth/crypt/_cryptography_rsa.py", line 112 in sign
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/auth/jwt.py", line 113 in encode
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/oauth2/service_account.py", line 396 in _make_authorization_grant_assertion
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/oauth2/service_account.py", line 409 in refresh
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/auth/credentials.py", line 133 in before_request
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/auth/transport/requests.py", line 545 in request
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/_http/__init__.py", line 379 in _do_request
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/_http/__init__.py", line 341 in _make_request
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/_http/__init__.py", line 482 in api_request
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/api_core/retry.py", line 190 in retry_target
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/api_core/retry.py", line 283 in retry_wrapped_func
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 782 in _call_api
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py", line 510 in _begin
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1298 in _begin
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 3367 in do_query
  File "/home/me/my-project/.venv/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 3390 in query

Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.strptime, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.timestamps, pandas._libs.properties, pandas._libs.tslibs.offsets, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.tslib, pandas._libs.lib, pandas._libs.hashing, pyarrow.lib, pyarrow._hdfsio, pandas._libs.ops, pandas._libs.arrays, pandas._libs.index, pandas._libs.join, pandas._libs.sparse, pyarrow._compute, pandas._libs.reduction, pandas._libs.indexing, pandas._libs.internals, pandas._libs.writers, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.testing, pandas._libs.parsers, pandas._libs.json, pydantic.typing, pydantic.errors, pydantic.version, pydantic.utils, pydantic.class_validators, pydantic.color, pydantic.datetime_parse, pydantic.validators, pydantic.networks, pydantic.types, pydantic.json, pydantic.error_wrappers, pydantic.fields, pydantic.config, pydantic.parse, pydantic.schema, pydantic.main, pydantic.dataclasses, pydantic.annotated_types, pydantic.decorator, pydantic.env_settings, pydantic.tools, pydantic, sqlalchemy.cimmutabledict, greenlet._greenlet, sqlalchemy.cprocessors, sqlalchemy.cresultproxy, _cffi_backend, google.protobuf.pyext._message, grpc._cython.cygrpc (total: 87)

no idea how to solve this and research didn't lead to anything. whats wrong with my setup? apparently the code is right. let me know if you need more info on my machine.

[reaperhulk]

Poetry does not properly handle yanked releases, try manually forcing an install of cryptography 37.0.2. We yanked 37.0.3 due to a serious bug in OpenSSL 3.0.4 (which we bundled in the wheel) that does not have a released fix yet.

[reaperhulk]

See python-poetry/poetry#2453 for more details, but poetry will hopefully have support for this soon.