-
Notifications
You must be signed in to change notification settings - Fork 28.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-14637][SQL] object expressions cleanup #12399
Conversation
Test build #55825 has finished for PR 12399 at commit
|
Test build #56164 has finished for PR 12399 at commit
|
} | ||
|
||
val value = unboxer(s"${obj.value}.$functionName($argString)") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Don't we need to do unboxing anymore here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We do, but I simplified it, see the callFunc
above.
Sorry this went stale. Do we still want to try and get this in? |
Test build #57408 has finished for PR 12399 at commit
|
retest this please. |
Test build #57410 has finished for PR 12399 at commit
|
retest this please |
Test build #57427 has finished for PR 12399 at commit
|
Thanks, merging to master and 2.0 |
## What changes were proposed in this pull request? Simplify and clean up some object expressions: 1. simplify the logic to handle `propagateNull` 2. add `propagateNull` parameter to `Invoke` 3. simplify the unbox logic in `Invoke` 4. other minor cleanup TODO: simplify `MapObjects` ## How was this patch tested? existing tests. Author: Wenchen Fan <wenchen@databricks.com> Closes #12399 from cloud-fan/object. (cherry picked from commit 0513c3a) Signed-off-by: Michael Armbrust <michael@databricks.com>
What changes were proposed in this pull request?
Simplify and clean up some object expressions:
propagateNull
propagateNull
parameter toInvoke
Invoke
TODO: simplify
MapObjects
How was this patch tested?
existing tests.