-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[fix](sink) The issue with 2GB limit of protocol buffer (#37990) #39112
Conversation
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
run buildall |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clang-tidy made some suggestions
RETURN_IF_ERROR(VExprContext::get_output_block_after_execute_exprs(_output_vexpr_ctxs, | ||
input_block, &block)); | ||
template <bool is_binary_format> | ||
Status VMysqlResultWriter<is_binary_format>::_write_one_block(RuntimeState* state, Block& block) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
warning: function '_write_one_block' exceeds recommended size/complexity thresholds [readability-function-size]
Status VMysqlResultWriter<is_binary_format>::_write_one_block(RuntimeState* state, Block& block) {
^
Additional context
be/src/vec/sink/vmysql_result_writer.cpp:148: 95 lines including whitespace and comments (threshold 80)
Status VMysqlResultWriter<is_binary_format>::_write_one_block(RuntimeState* state, Block& block) {
^
``` Fail to serialize doris.PFetchDataResult ``` If the size of `PFetchDataResult` is greater than 2G, protocol buffer cannot serialize the message.
run buildall |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clang-tidy made some suggestions
RETURN_IF_ERROR(VExprContext::get_output_block_after_execute_exprs(_output_vexpr_ctxs, | ||
input_block, &block)); | ||
template <bool is_binary_format> | ||
Status VMysqlResultWriter<is_binary_format>::_write_one_block(Block& block) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
warning: function '_write_one_block' exceeds recommended size/complexity thresholds [readability-function-size]
Status VMysqlResultWriter<is_binary_format>::_write_one_block(Block& block) {
^
Additional context
be/src/vec/sink/vmysql_result_writer.cpp:148: 95 lines including whitespace and comments (threshold 80)
Status VMysqlResultWriter<is_binary_format>::_write_one_block(Block& block) {
^
TeamCity be ut coverage result: |
If the size of
PFetchDataResult
is greater than 2G, protocol buffer cannot serialize the message.pick #37990