Calculating communication cost?

[Linardos]

When I run any experiment, the resulting dataframe looks like this:

My understanding is that time reflects the following, based on your instructions:

I am wondering whether I could break up this "time" into these 4 fundamental parts to figure out how much the communication cost is

[sarthakpati]

Nope, since this metric is integral during the performance evaluation of each submitted algorithm. You can add any metric written for PyTorch (for example, using torchmetrics) for validating your trained model.