Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Including time spent on merging shard responses on coordinating node in the profiler #1259

Open
Poojita-Raj opened this issue Sep 20, 2021 · 0 comments
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request

Comments

@Poojita-Raj
Copy link
Contributor

Is your feature request related to a problem? Please describe.
A coordinating node that receives a search request executes it in 2 parts -

  1. Coordination fan-out phase: This is where the request is forwarded to data nodes that hold the data for execution.
  2. Coordination fan-in phase: This is where the individual data node results are returned and merged on the coordination node for the final result.

Currently, the profiler does not take this coordination time into account when profiling a search query. The profiler is meant to be used as a diagnostic tool to understand why certain requests are slow.

This coordination time would help in providing greater clarity to the end user on what could be causing their requests to be slow.

Describe the solution you'd like
Modify the profile response to include a coordination_time field that provides the user with additional information regarding-

  • coordination_fan_out : Time spent forwarding requests to other data nodes.
  • coordination_fan_in: Time spent receiving individual results from other data nodes and merged into final result.

Describe alternatives you've considered
N/A

Additional context
#705

@Poojita-Raj Poojita-Raj added the enhancement Enhancement or improvement to existing feature or request label Sep 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request
Projects
None yet
Development

No branches or pull requests

2 participants