Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-5622] Add new added Spark3.5 UTs in Gluten #5623

Merged
merged 1 commit into from
May 7, 2024

Conversation

yma11
Copy link
Contributor

@yma11 yma11 commented May 6, 2024

What changes were proposed in this pull request?

In Spark 3.5, there are some new added UTs vs Spark3.4 which haven't been added in Gluten yet. In this PR, we ported the ones under spark/sql but excluding folders like streaming, execution/command, execution/benchmark.

(Fixes: #5622)

How was this patch tested?

CI

Copy link

github-actions bot commented May 6, 2024

#5622

Copy link

github-actions bot commented May 6, 2024

Run Gluten Clickhouse CI

@yma11
Copy link
Contributor Author

yma11 commented May 7, 2024

@zhouyuan Please help review this PR. Thanks!

@zhouyuan zhouyuan merged commit eaa2761 into apache:main May 7, 2024
43 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_5623_time.csv log/native_master_05_06_2024_72e787c64_time.csv difference percentage
q1 35.97 36.58 0.610 101.69%
q2 23.67 23.74 0.066 100.28%
q3 35.50 38.97 3.463 109.75%
q4 37.78 38.09 0.308 100.82%
q5 69.64 68.56 -1.082 98.45%
q6 7.48 6.78 -0.696 90.70%
q7 84.20 83.29 -0.910 98.92%
q8 86.17 87.34 1.171 101.36%
q9 120.44 122.36 1.927 101.60%
q10 44.69 46.26 1.569 103.51%
q11 20.36 20.36 0.001 100.00%
q12 28.40 27.48 -0.924 96.75%
q13 56.43 54.80 -1.624 97.12%
q14 23.81 20.20 -3.617 84.81%
q15 30.07 30.34 0.265 100.88%
q16 13.63 15.88 2.247 116.48%
q17 103.76 101.90 -1.857 98.21%
q18 146.02 146.06 0.035 100.02%
q19 16.12 14.65 -1.462 90.93%
q20 27.13 26.35 -0.788 97.10%
q21 279.33 291.97 12.633 104.52%
q22 14.84 15.01 0.173 101.16%
total 1305.47 1316.98 11.509 100.88%

@yma11 yma11 deleted the spark35-ut branch May 31, 2024 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add new added Spark3.5 UTs in Gluten
3 participants