Skip to content

Commit

Permalink
[SPARK-50730][SQL][TESTS] Skip TPC-DS collation benchmark in branch-3.5
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
This PR aims to skip TPC-DS collation benchmark in branch-3.5

### Why are the changes needed?
TPS-DS collation benchmark was added by the following PR at Spark 4.0
- apache#45739

However, branch-3.5 daily CI is trying to run non-existing tests.
- https://github.com/apache/spark/actions/runs/12618956363/job/35162950623

<img width="366" alt="Screenshot 2025-01-05 at 2 48 54 PM" src="https://github.com/user-attachments/assets/80e4013a-132e-4e92-b4b9-4c5581295c43" />

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Check manually after merge.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#49360 from williamhyun/SPARK-50730.

Authored-by: William Hyun <william@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
  • Loading branch information
williamhyun authored and dongjoon-hyun committed Jan 5, 2025
1 parent 91f3fdd commit 24c9247
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1094,6 +1094,7 @@ jobs:
spark.sql.autoBroadcastJoinThreshold=-1
spark.sql.join.forceApplyShuffledHashJoin=true
- name: Run TPC-DS queries on collated data
if: inputs.branch != 'branch-3.5'
run: |
SPARK_TPCDS_DATA=`pwd`/tpcds-sf-1 build/sbt "sql/testOnly org.apache.spark.sql.TPCDSCollationQueryTestSuite"
- name: Upload test results to report
Expand Down

0 comments on commit 24c9247

Please sign in to comment.