Skip to content
Build

Improve Python UDTF arrow serializer performance #5402

Sign in to view logs

Improve Python UDTF arrow serializer performance

Improve Python UDTF arrow serializer performance #5402

Triggered via push February 27, 2025 08:33
@HyukjinKwonHyukjinKwon
pushed ae78d98
SPARK-44856
Status Failure
Total duration 1h 18m 34s
Artifacts 15

build_main.yml

on: push
Run  /  Check changes
34s
Run / Check changes
Run  /  Base image build
1m 30s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 10s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
0s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
23s
Run / Run Spark UI tests
Matrix: Run / build
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, and dependencies
28m 44s
Run / Linters, licenses, and dependencies
Run  /  Documentation generation
32m 36s
Run / Documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 2 warnings
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Process completed with exit code 19.
Run / Build modules: pyspark-connect
Process completed with exit code 19.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
The 'defaults' channel might have been added implicitly. If this is intentional, add 'defaults' to the 'channels' list. Otherwise, consider setting 'conda-remove-defaults' to 'true'.

Artifacts

Produced during runtime
Name Size
HyukjinKwon~spark~DWKQB9.dockerbuild
23.6 KB
HyukjinKwon~spark~JLX9M5.dockerbuild
26.3 KB
HyukjinKwon~spark~YDYUZX.dockerbuild
29.7 KB
site
58.8 MB
test-results-pyspark-connect--17-hadoop3-hive2.3-python3.11
192 KB
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect--17-hadoop3-hive2.3-python3.11
206 KB
test-results-pyspark-pandas--17-hadoop3-hive2.3-python3.11
194 KB
test-results-pyspark-pandas-connect-part0--17-hadoop3-hive2.3-python3.11
147 KB
test-results-pyspark-pandas-connect-part1--17-hadoop3-hive2.3-python3.11
110 KB
test-results-pyspark-pandas-connect-part2--17-hadoop3-hive2.3-python3.11
81.5 KB
test-results-pyspark-pandas-connect-part3--17-hadoop3-hive2.3-python3.11
48.6 KB
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3-python3.11
172 KB
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.11
259 KB
unit-tests-log-pyspark-connect--17-hadoop3-hive2.3-python3.11
107 MB
unit-tests-log-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.11
51.8 MB