is this a global sort or sort by partition

[djouallah]

silly question

using this

df = sp.read_parquet("./lineitem/*.parquet")
df = df.repartition(3)
df = sp.partial_sql("SELECT * FROM {0} order BY l_shipdate", df)
df.write_parquet("output2/")

is it sorting all the data or just sorting inside every partition ?

[wangrunji0408]

Just sorting inside every partition.

We don't provide a global sorting api yet.