ARROW-14892: [Python][C++] GCS Bindings#12763

Merged

pitrou merged 85 commits intoapache:masterfrom emkornfield:gcsp

Jun 12, 2022

+772-103

Commits on Jun 11, 2022

parent a23c6dd

emkornfield
authored and
pitrou
committed
address PR comment pt 1

emkornfield
authored and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
pr comments pt2.

emkornfield
authored and
pitrou
committed
pr comments pt3.

emkornfield
authored and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update dev/archery/archery/cli.py

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
Apply suggestions from code review

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
pr review comments #4

emkornfield
authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
ninja format

emkornfield
authored and
pitrou
committed
more pr fixes

emkornfield
authored and
pitrou
committed
make ensure_metadata cpdef

emkornfield
authored and
pitrou
committed
remove build_absl_once

emkornfield
authored and
pitrou
committed
fix lint

emkornfield
authored and
pitrou
committed
cast expiration to system clock (mac)

emkornfield
authored and
pitrou
committed
try to remove separate testbench install

emkornfield
authored and
pitrou
committed
some simplication

emkornfield
authored and
pitrou
committed
simplify further

emkornfield
authored and
pitrou
committed
Avoid counting trailing slash in Depth

emkornfield
authored and
pitrou
committed
Revert "try to remove separate testbench install"

emkornfield
authored and
pitrou
committed
use latest version and remove DO NOT SUBMIT

emkornfield
authored and
pitrou
committed
Update python/pyarrow/tests/conftest.py

emkornfield
and
pitrou
committed
comment out GCS ON instead of set it to off

emkornfield
authored and
pitrou
committed
add gs/gcs to filesystemfromuri docs

emkornfield
authored and
pitrou
committed
remove duplicate code

emkornfield
authored and
pitrou
committed
remove duplicate PYARROW_WITH_GCS

emkornfield
authored and
pitrou
committed
remove duplicate cli.py

emkornfield
authored and
pitrou
committed
add smoke test for FileSystemFromUri

emkornfield
authored and
pitrou
committed
separate gcs and s3 variables in tasks.yml

emkornfield
authored and
pitrou
committed
make GcsOptions default constructible

emkornfield
authored and
pitrou
committed
run install_gcs_test_bench if it exists

emkornfield
authored and
pitrou
committed
turn of gcs on macos github workflow

emkornfield
authored and
pitrou
committed
install testbench on wheel test

emkornfield
authored and
pitrou
committed
fix error for calculating directory presence

emkornfield
authored and
pitrou
committed
Install the testbench using the right Python
pitrou
committed
add ARROW_EXPORT

emkornfield
authored and
pitrou
committed
fix alphabeetic order in build-pyarrow.sh

emkornfield
authored and
pitrou
committed
enable macOS 10.13 gcs build

emkornfield
authored and
pitrou
committed
use install_gcs_bench.sh in unix wheel test script

emkornfield
authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

authored and
pitrou
committed
fixup tests per feedback

emkornfield
authored and
pitrou
committed
make close idempotent

emkornfield
authored and
pitrou
committed
Use bundled google-cloud-cpp-storage

kou
authored and
pitrou
committed
Install test dependencies in Dockerfile

kou
authored and
pitrou
committed
Enable GCS on Debian and Fedora

kou
authored and
pitrou
committed
Don't enable GCS on Debian 10

kou
authored and
pitrou
committed
Update installing testing dependency in dev/tasks/python-wheels/

kou
authored and
pitrou
committed
Fix wrong Python use

kou
authored and
pitrou
committed
Make failures of testbench short lived

emkornfield
authored and
pitrou
committed
Add missing arch

kou
authored and
pitrou
committed
use 5 second timeout for tests

emkornfield
authored and
pitrou
committed
Try installing testbench on arm64 macOS

kou
authored and
pitrou
committed
Install python3-dev to build crc32c locally

kou
authored and
pitrou
committed
x86 and arm are only enabled

kou
authored and
pitrou
committed
Don't use wheel for grpcio on arm64 macOS

kou
authored and
pitrou
committed
Use grpcio 1.44.0

kou
authored and
pitrou
committed
Disable GCS on s390x

kou
authored and
pitrou
committed
up timeout to 20 seconds

emkornfield
authored and
pitrou
committed
add back conftest

emkornfield
authored and
pitrou
committed
add logging to equality for debugging

emkornfield
authored and
pitrou
committed
add logging for timepoint

emkornfield
authored and
pitrou
committed
accept nanos and use it for expiration

emkornfield
authored and
pitrou
committed
Revert "add logging for timepoint"

emkornfield
authored and
pitrou
committed
Revert "add logging to equality for debugging"

emkornfield
authored and
pitrou
committed
fix lint

emkornfield
authored and
pitrou
committed
Revert "fix lint"

emkornfield
authored and
pitrou
committed
Revert "accept nanos and use it for expiration"

emkornfield
authored and
pitrou
committed
pass timezone to datetime

emkornfield
authored and
pitrou
committed
increase timeout

emkornfield
authored and
pitrou
committed
Apply suggestions from code review

emkornfield
and
pitrou
committed
address code review feedback

emkornfield
authored and
pitrou
committed
bump client policy

emkornfield
authored and
pitrou
committed
Try to understand arch issues
pitrou
committed
Try to rationalize uses of arch
pitrou
committed
Revert "Try to rationalize uses of arch"
pitrou
committed
Revert "Try to understand arch issues"
pitrou
committed

Commits on Jun 12, 2022

Make error more informative in warnings check
pitrou
committed