Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support complex types in sparksql hash and xxhash64 function #9414

Closed
wants to merge 5 commits into from
Closed

Support complex types in sparksql hash and xxhash64 function #9414

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
86622a0
support hash complex type
marin-ma Apr 3, 2024
86a2d26
remove virtual function call
marin-ma Apr 26, 2024
e6a49d1
address comments
marin-ma May 1, 2024
e2f4423
add benchmark
marin-ma May 9, 2024
6a270b3
revert switch
marin-ma May 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 0 additions & 9 deletions velox/docs/functions/spark/binary.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,30 +10,21 @@ Binary Functions

Computes the hash of one or more input values using seed value of 42. For
multiple arguments, their types can be different.
Supported types are: BOOLEAN, TINYINT, SMALLINT, INTEGER, BIGINT, VARCHAR,
VARBINARY, REAL, DOUBLE, HUGEINT and TIMESTAMP.


.. spark:function:: hash_with_seed(seed, x, ...) -> integer

Computes the hash of one or more input values using specified seed. For
multiple arguments, their types can be different.
Supported types are: BOOLEAN, TINYINT, SMALLINT, INTEGER, BIGINT, VARCHAR,
VARBINARY, REAL, DOUBLE, HUGEINT and TIMESTAMP.

.. spark:function:: xxhash64(x, ...) -> bigint

Computes the xxhash64 of one or more input values using seed value of 42.
For multiple arguments, their types can be different.
Supported types are: BOOLEAN, TINYINT, SMALLINT, INTEGER, BIGINT, VARCHAR,
VARBINARY, REAL, DOUBLE, HUGEINT and TIMESTAMP.

.. spark:function:: xxhash64_with_seed(seed, x, ...) -> bigint

Computes the xxhash64 of one or more input values using specified seed. For
multiple arguments, their types can be different.
Supported types are: BOOLEAN, TINYINT, SMALLINT, INTEGER, BIGINT, VARCHAR,
VARBINARY, REAL, DOUBLE, HUGEINT and TIMESTAMP.

.. spark:function:: md5(x) -> varbinary

Expand Down
Loading
Loading