-
Notifications
You must be signed in to change notification settings - Fork 314
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[REVIEW] MG (Batch) Betweenness Centrality #940
Conversation
Please update the changelog in order to start CI tests. View the gpuCI docs here. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Added ome minor questions/comments.
Please add a note on Batched processing in the .rst
file under doc
like after the Consolidation
section.
rerun tests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Need to investigate graph replication time compared to peak BW expected perf
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just add a FIXME comment, and thanks for the contribution!
rerun tests |
1 similar comment
rerun tests |
rerun tests |
This work adds Multi-GPU Batch Betweenness Centrality for both Vertices and Edges:
This version allows to use the same Graph for both Single GPU algorithms and algorithms supporting Multi GPUs Batch
processing.
Graphs can be loaded the same way they are with
cudf
for single GPU, and can leverage Multi GPUs Batch Processing by usingG.enable_mg_batch()
whereG
is aGraph
orDiGraph
. By enablingmg_batch
edge list and / or adjacency lists are replicated across device usingdask
andRAFT
's communicator. When enabled and when adding representations to the graph, replications of the representations are operated. Replication of the transposed adjacency list is not yet implemented.This also adds functions for replciation of
cudf.DataFrame
andcudf.Series
over multiple GPUs, and a notebook to show how to use Multi GPUs Batch Processing for Betweenness CentralityA boolean parameter is added at the C++ level to BFS to disable MG BFS path to be taken when called from MG Batch BC.