Skip to content

Improve Python UDTF arrow serializer performance #5401

Improve Python UDTF arrow serializer performance

Improve Python UDTF arrow serializer performance #5401

Triggered via push February 27, 2025 08:24
Status Cancelled
Total duration 10m 48s
Artifacts 3

build_main.yml

on: push
Run  /  Check changes
35s
Run / Check changes
Run  /  Base image build
1m 5s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 10s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
0s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
24s
Run / Run Spark UI tests
Matrix: Run / build
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, and dependencies
7m 35s
Run / Linters, licenses, and dependencies
Run  /  Documentation generation
7m 34s
Run / Documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

24 errors and 21 warnings
Run / Documentation generation
The run was canceled by @HyukjinKwon.
Run / Documentation generation
The operation was canceled.
Run / Linters, licenses, and dependencies
The run was canceled by @HyukjinKwon.
Run / Linters, licenses, and dependencies
The operation was canceled.
Run / Build modules: pyspark-connect
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-connect
The operation was canceled.
Run / Build modules: pyspark-pandas
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas
The operation was canceled.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
The operation was canceled.
Run / Build modules: pyspark-pandas-connect-part1
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas-connect-part1
The operation was canceled.
Run / Build modules: pyspark-pandas-connect-part3
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas-connect-part3
The operation was canceled.
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
The operation was canceled.
Run / Build modules: pyspark-pandas-connect-part2
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas-connect-part2
The operation was canceled.
Run / Build modules: pyspark-pandas-slow
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas-slow
The operation was canceled.
Run / Build modules: pyspark-pandas-connect-part0
The run was canceled by @HyukjinKwon.
Run / Build modules: pyspark-pandas-connect-part0
The operation was canceled.
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part1
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part1
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part3
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part3
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
The 'defaults' channel might have been added implicitly. If this is intentional, add 'defaults' to the 'channels' list. Otherwise, consider setting 'conda-remove-defaults' to 'true'.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part2
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part2
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-slow
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-slow
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part0
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-pandas-connect-part0
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
HyukjinKwon~spark~0D8CQA.dockerbuild
29.4 KB
HyukjinKwon~spark~2YT51P.dockerbuild
23.9 KB
HyukjinKwon~spark~XM6IWF.dockerbuild
26.1 KB