ARROW-14229: [C++] WIP Bump versions of bundled dependencies #11340

bkmgit · 2021-10-06T14:43:16Z

No description provided.

github-actions · 2021-10-06T14:43:40Z

https://issues.apache.org/jira/browse/ARROW-14229

jonkeane · 2021-10-06T16:33:57Z

@github-actions crossbow submit test-r-offline-maximal

github-actions · 2021-10-06T16:35:29Z

Revision: 6ef432c

Submitted crossbow builds: ursacomputing/crossbow @ actions-899

Task	Status
test-r-offline-maximal

jonkeane · 2021-10-06T16:53:13Z

I triggered our offline-r build and it failed for the reasons stated in the ticket (we need to upload the new source(s)). But once that's done it would be good to re-reun this job since it exercises this dependency resolution in a unique way that has caught other issues in the past. And of course I'm happy to help debug any odd errors or outputs it has!

Merge branch 'ARROW-14229' of github.com:bkmgit/arrow into ARROW-14229

bkmgit · 2021-10-06T17:40:56Z

@jonkeane Thanks. As indicated in https://issues.apache.org/jira/browse/ARROW-6407 would you also consider having a mirror of https://github.com/ursa-labs/thirdparty on OSDN, GitLab or Gitee ?

kou · 2021-10-12T01:50:33Z

We can use https://apache.jfrog.io/ui/native/arrow/ such as https://apache.jfrog.io/ui/native/arrow/boost for mirror (or master).

pitrou · 2021-10-13T13:29:19Z

@github-actions crossbow submit -g cpp

github-actions · 2021-10-13T13:30:28Z

Revision: fabe24b

Submitted crossbow builds: ursacomputing/crossbow @ actions-932

Task	Status
test-conda-cpp
test-conda-cpp-valgrind
test-debian-11-cpp
test-fedora-33-cpp
test-ubuntu-18.04-cpp
test-ubuntu-18.04-cpp-release
test-ubuntu-18.04-cpp-static
test-ubuntu-20.04-cpp
test-ubuntu-20.04-cpp-14
test-ubuntu-20.04-cpp-17
test-ubuntu-20.04-cpp-thread-sanitizer

bkmgit · 2021-10-13T15:12:00Z

@pitrou Thanks for the build request. There was an error in the sha256sum for protobuf. Have updated this, but then one of the crossbow builds with previous sha256sum passed.

pitrou · 2021-10-13T15:14:41Z

@github-actions crossbow submit -g cpp

pitrou · 2021-10-13T15:15:25Z

Have updated this, but then one of the crossbow builds with previous sha256sum passed.

I may be mistaken, but I think CMake only uses the sha256sum for caching (?).

github-actions · 2021-10-13T15:15:47Z

Revision: e77786b

Submitted crossbow builds: ursacomputing/crossbow @ actions-936

Task	Status
test-conda-cpp
test-conda-cpp-valgrind
test-debian-11-cpp
test-fedora-33-cpp
test-ubuntu-18.04-cpp
test-ubuntu-18.04-cpp-release
test-ubuntu-18.04-cpp-static
test-ubuntu-20.04-cpp
test-ubuntu-20.04-cpp-14
test-ubuntu-20.04-cpp-17
test-ubuntu-20.04-cpp-thread-sanitizer

bkmgit · 2021-10-13T16:13:43Z

Ubuntu-18.04-cpp, Ubuntu-18.04-cpp-release, ubuntu-18.04-cpp-static
FAILED: thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build thrift_ep-install/lib/libthriftd.a
cd /build/cpp/thrift_ep-prefix/src/thrift_ep-build && /usr/bin/cmake -P /build/cpp/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-DEBUG.cmake && /usr/bin/cmake -E touch /build/cpp/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build
CMake Error at /build/cpp/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-DEBUG.cmake:16 (message):
Command failed: 1
Ubuntu-20.04-cpp-17
FAILED: debug/plasma-serialization-tests
ubuntu-20.04-cpp-thread-sanitizer
35 - arrow-compute-hash-join-node-test (Failed)

bkmgit · 2021-10-13T16:20:29Z

@jonkeane Any suggestions for the errors?

pitrou · 2021-10-13T18:03:47Z

@bkmgit The errors should be reproducible locally using the same docker command as in the CI job (don't forget environment variables), for example:

UBUNTU=18.04 archery docker run -e SETUPTOOLS_SCM_PRETEND_VERSION="6.0.0.dev468"  ubuntu-cpp

A prerequisite is to install Archery.

bkmgit · 2021-10-14T03:56:36Z

thanks

bkmgit · 2021-10-17T09:29:44Z

Build failures for Thrift versions 0.14 and 0.15 on Ubuntu 18.04 with libssl-dev ( OpenSSL 1.1.1f ) are due to use of deprecated commands, for example:
from /usr/include/openssl/err.h:13,
from /root/arrow/cpp/build/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/transport/TSSLSocket.cpp:48:
/usr/include/openssl/asn1.h:554:1: note: declared here
554 | DEPRECATEDIN_1_1_0(unsigned char *ASN1_STRING_data(ASN1_STRING *x))
| ^~~~~~~~~~~~~~~~~~

bkmgit · 2021-10-17T09:57:36Z

Suggest leaving Thrift at 0.13 until next release when OpenSSL requirement can be bumped to 1.1.1 from 1.0.2

bkmgit · 2021-10-17T11:41:26Z

@github-actions crossbow submit -g cpp

bkmgit · 2021-10-18T17:26:41Z

@github-actions crossbow submit -g nightly

github-actions · 2021-10-18T17:28:08Z

Revision: faac6f4

Submitted crossbow builds: ursacomputing/crossbow @ actions-987

Task	Status
almalinux-8-amd64
almalinux-8-arm64
amazon-linux-2-amd64
centos-7-amd64
centos-8-amd64
centos-8-arm64
conda-clean
conda-linux-gcc-py36-arm64
conda-linux-gcc-py36-cpu-r40
conda-linux-gcc-py36-cuda
conda-linux-gcc-py37-arm64
conda-linux-gcc-py37-cpu-r41
conda-linux-gcc-py37-cuda
conda-linux-gcc-py38-arm64
conda-linux-gcc-py38-cpu
conda-linux-gcc-py38-cuda
conda-linux-gcc-py39-arm64
conda-linux-gcc-py39-cpu
conda-linux-gcc-py39-cuda
conda-osx-arm64-clang-py38
conda-osx-arm64-clang-py39
conda-osx-clang-py36-r40
conda-osx-clang-py37-r41
conda-osx-clang-py38
conda-osx-clang-py39
conda-win-vs2017-py36-r40
conda-win-vs2017-py37-r41
conda-win-vs2017-py38
conda-win-vs2017-py39
debian-bookworm-amd64
debian-bookworm-arm64
debian-bullseye-amd64
debian-bullseye-arm64
debian-buster-amd64
debian-buster-arm64
example-cpp-minimal-build-static
example-cpp-minimal-build-static-system-dependency
homebrew-cpp
homebrew-r-autobrew
java-jars
nuget
python-sdist
test-build-vcpkg-win
test-conda-cpp
test-conda-cpp-valgrind
test-conda-python-3.10
test-conda-python-3.6
test-conda-python-3.6-pandas-0.23
test-conda-python-3.7
test-conda-python-3.7-dask-latest
test-conda-python-3.7-dask-master
test-conda-python-3.7-hdfs-2.9.2
test-conda-python-3.7-hdfs-3.2.1
test-conda-python-3.7-kartothek-latest
test-conda-python-3.7-kartothek-master
test-conda-python-3.7-pandas-0.24
test-conda-python-3.7-pandas-latest
test-conda-python-3.7-spark-branch-3.0
test-conda-python-3.8
test-conda-python-3.8-hypothesis
test-conda-python-3.8-pandas-latest
test-conda-python-3.8-pandas-nightly
test-conda-python-3.8-spark-master
test-conda-python-3.9
test-conda-python-3.9-pandas-master
test-debian-11-cpp
test-debian-11-go-1.15
test-debian-11-python-3
test-debian-c-glib
test-debian-ruby
test-fedora-33-cpp
test-fedora-33-python-3
test-r-arrow-backwards-compatibility
test-r-depsource-auto
test-r-depsource-system
test-r-devdocs
test-r-gcc-11
test-r-install-local
test-r-linux-as-cran
test-r-linux-rchk
test-r-linux-valgrind
test-r-minimal-build
test-r-offline-maximal
test-r-offline-minimal
test-r-rhub-debian-gcc-devel-lto-latest
test-r-rhub-ubuntu-gcc-release-latest
test-r-rocker-r-base-latest
test-r-rstudio-r-base-3.6-bionic
test-r-rstudio-r-base-3.6-centos7-devtoolset-8
test-r-rstudio-r-base-3.6-centos8
test-r-rstudio-r-base-3.6-opensuse15
test-r-rstudio-r-base-3.6-opensuse42
test-r-ubuntu-21.04
test-r-versions
test-ubuntu-18.04-cpp
test-ubuntu-18.04-cpp-release
test-ubuntu-18.04-cpp-static
test-ubuntu-18.04-python-3
test-ubuntu-18.04-r-sanitizer
test-ubuntu-20.04-cpp
test-ubuntu-20.04-cpp-14
test-ubuntu-20.04-cpp-17
test-ubuntu-20.04-cpp-thread-sanitizer
test-ubuntu-20.10-docs
test-ubuntu-c-glib
test-ubuntu-default-docs
test-ubuntu-ruby
ubuntu-bionic-amd64
ubuntu-bionic-arm64
ubuntu-focal-amd64
ubuntu-focal-arm64
ubuntu-hirsute-amd64
ubuntu-hirsute-arm64
wheel-macos-big-sur-cp310-arm64
wheel-macos-big-sur-cp310-universal2
wheel-macos-big-sur-cp38-arm64
wheel-macos-big-sur-cp39-arm64
wheel-macos-big-sur-cp39-universal2
wheel-macos-high-sierra-cp310-amd64
wheel-macos-high-sierra-cp36-amd64
wheel-macos-high-sierra-cp37-amd64
wheel-macos-high-sierra-cp38-amd64
wheel-macos-high-sierra-cp39-amd64
wheel-macos-mavericks-cp310-amd64
wheel-macos-mavericks-cp36-amd64
wheel-macos-mavericks-cp37-amd64
wheel-macos-mavericks-cp38-amd64
wheel-macos-mavericks-cp39-amd64
wheel-manylinux2010-cp310-amd64
wheel-manylinux2010-cp36-amd64
wheel-manylinux2010-cp37-amd64
wheel-manylinux2010-cp38-amd64
wheel-manylinux2010-cp39-amd64
wheel-manylinux2014-cp310-amd64
wheel-manylinux2014-cp310-arm64
wheel-manylinux2014-cp36-amd64
wheel-manylinux2014-cp36-arm64
wheel-manylinux2014-cp37-amd64
wheel-manylinux2014-cp37-arm64
wheel-manylinux2014-cp38-amd64
wheel-manylinux2014-cp38-arm64
wheel-manylinux2014-cp39-amd64
wheel-manylinux2014-cp39-arm64
wheel-windows-cp310-amd64
wheel-windows-cp36-amd64
wheel-windows-cp37-amd64
wheel-windows-cp38-amd64
wheel-windows-cp39-amd64

bkmgit · 2021-10-18T18:52:26Z

@github-actions crossbow submit -g nightly

github-actions · 2021-10-18T18:53:58Z

Revision: fe0622b

Submitted crossbow builds: ursacomputing/crossbow @ actions-989

Task	Status
almalinux-8-amd64
almalinux-8-arm64
amazon-linux-2-amd64
centos-7-amd64
centos-8-amd64
centos-8-arm64
conda-clean
conda-linux-gcc-py36-arm64
conda-linux-gcc-py36-cpu-r40
conda-linux-gcc-py36-cuda
conda-linux-gcc-py37-arm64
conda-linux-gcc-py37-cpu-r41
conda-linux-gcc-py37-cuda
conda-linux-gcc-py38-arm64
conda-linux-gcc-py38-cpu
conda-linux-gcc-py38-cuda
conda-linux-gcc-py39-arm64
conda-linux-gcc-py39-cpu
conda-linux-gcc-py39-cuda
conda-osx-arm64-clang-py38
conda-osx-arm64-clang-py39
conda-osx-clang-py36-r40
conda-osx-clang-py37-r41
conda-osx-clang-py38
conda-osx-clang-py39
conda-win-vs2017-py36-r40
conda-win-vs2017-py37-r41
conda-win-vs2017-py38
conda-win-vs2017-py39
debian-bookworm-amd64
debian-bookworm-arm64
debian-bullseye-amd64
debian-bullseye-arm64
debian-buster-amd64
debian-buster-arm64
example-cpp-minimal-build-static
example-cpp-minimal-build-static-system-dependency
homebrew-cpp
homebrew-r-autobrew
java-jars
nuget
python-sdist
test-build-vcpkg-win
test-conda-cpp
test-conda-cpp-valgrind
test-conda-python-3.10
test-conda-python-3.6
test-conda-python-3.6-pandas-0.23
test-conda-python-3.7
test-conda-python-3.7-dask-latest
test-conda-python-3.7-dask-master
test-conda-python-3.7-hdfs-2.9.2
test-conda-python-3.7-hdfs-3.2.1
test-conda-python-3.7-kartothek-latest
test-conda-python-3.7-kartothek-master
test-conda-python-3.7-pandas-0.24
test-conda-python-3.7-pandas-latest
test-conda-python-3.7-spark-branch-3.0
test-conda-python-3.8
test-conda-python-3.8-hypothesis
test-conda-python-3.8-pandas-latest
test-conda-python-3.8-pandas-nightly
test-conda-python-3.8-spark-master
test-conda-python-3.9
test-conda-python-3.9-pandas-master
test-debian-11-cpp
test-debian-11-go-1.15
test-debian-11-python-3
test-debian-c-glib
test-debian-ruby
test-fedora-33-cpp
test-fedora-33-python-3
test-r-arrow-backwards-compatibility
test-r-depsource-auto
test-r-depsource-system
test-r-devdocs
test-r-gcc-11
test-r-install-local
test-r-linux-as-cran
test-r-linux-rchk
test-r-linux-valgrind
test-r-minimal-build
test-r-offline-maximal
test-r-offline-minimal
test-r-rhub-debian-gcc-devel-lto-latest
test-r-rhub-ubuntu-gcc-release-latest
test-r-rocker-r-base-latest
test-r-rstudio-r-base-3.6-bionic
test-r-rstudio-r-base-3.6-centos7-devtoolset-8
test-r-rstudio-r-base-3.6-centos8
test-r-rstudio-r-base-3.6-opensuse15
test-r-rstudio-r-base-3.6-opensuse42
test-r-ubuntu-21.04
test-r-versions
test-ubuntu-18.04-cpp
test-ubuntu-18.04-cpp-release
test-ubuntu-18.04-cpp-static
test-ubuntu-18.04-python-3
test-ubuntu-18.04-r-sanitizer
test-ubuntu-20.04-cpp
test-ubuntu-20.04-cpp-14
test-ubuntu-20.04-cpp-17
test-ubuntu-20.04-cpp-thread-sanitizer
test-ubuntu-20.10-docs
test-ubuntu-c-glib
test-ubuntu-default-docs
test-ubuntu-ruby
ubuntu-bionic-amd64
ubuntu-bionic-arm64
ubuntu-focal-amd64
ubuntu-focal-arm64
ubuntu-hirsute-amd64
ubuntu-hirsute-arm64
wheel-macos-big-sur-cp310-arm64
wheel-macos-big-sur-cp310-universal2
wheel-macos-big-sur-cp38-arm64
wheel-macos-big-sur-cp39-arm64
wheel-macos-big-sur-cp39-universal2
wheel-macos-high-sierra-cp310-amd64
wheel-macos-high-sierra-cp36-amd64
wheel-macos-high-sierra-cp37-amd64
wheel-macos-high-sierra-cp38-amd64
wheel-macos-high-sierra-cp39-amd64
wheel-macos-mavericks-cp310-amd64
wheel-macos-mavericks-cp36-amd64
wheel-macos-mavericks-cp37-amd64
wheel-macos-mavericks-cp38-amd64
wheel-macos-mavericks-cp39-amd64
wheel-manylinux2010-cp310-amd64
wheel-manylinux2010-cp36-amd64
wheel-manylinux2010-cp37-amd64
wheel-manylinux2010-cp38-amd64
wheel-manylinux2010-cp39-amd64
wheel-manylinux2014-cp310-amd64
wheel-manylinux2014-cp310-arm64
wheel-manylinux2014-cp36-amd64
wheel-manylinux2014-cp36-arm64
wheel-manylinux2014-cp37-amd64
wheel-manylinux2014-cp37-arm64
wheel-manylinux2014-cp38-amd64
wheel-manylinux2014-cp38-arm64
wheel-manylinux2014-cp39-amd64
wheel-manylinux2014-cp39-arm64
wheel-windows-cp310-amd64
wheel-windows-cp36-amd64
wheel-windows-cp37-amd64
wheel-windows-cp38-amd64
wheel-windows-cp39-amd64