added gemma_2b_it deepspeed baseline

Luca-Calabria · Luca-Calabria · commit 22a5e9827b1e · 2024-12-04T12:25:13.000+01:00
diff --git a/tests/baselines/gemma_2b_it.json b/tests/baselines/gemma_2b_it.json
@@ -25,6 +25,18 @@
                         "--dataset_config_name wikitext-2-raw-v1",
                         "--use_hpu_graphs_for_inference"
                     ]
+                },
+                "deepspeed": {
+                    "learning_rate": 8e-4,
+                    "train_batch_size": 4,
+                    "perplexity": 924.062,
+                    "train_runtime": 75.518,
+                    "train_samples_per_second": 81.097,
+                    "extra_arguments": [
+                        "--dataset_config_name wikitext-2-raw-v1",
+                        "--use_hpu_graphs_for_inference",
+                        "--deepspeed tests/configs/deepspeed_zero_2.json"
+                    ]
                 }
             }
         }

Original file line number	Diff line number	Diff line change
`@@ -25,6 +25,18 @@`
`25`	`25`	`"--dataset_config_name wikitext-2-raw-v1",`
`26`	`26`	`"--use_hpu_graphs_for_inference"`
`27`	`27`	`]`
	`28`	`+ },`
	`29`	`+ "deepspeed": {`
	`30`	`+ "learning_rate": 8e-4,`
	`31`	`+ "train_batch_size": 4,`
	`32`	`+ "perplexity": 924.062,`
	`33`	`+ "train_runtime": 75.518,`
	`34`	`+ "train_samples_per_second": 81.097,`
	`35`	`+ "extra_arguments": [`
	`36`	`+ "--dataset_config_name wikitext-2-raw-v1",`
	`37`	`+ "--use_hpu_graphs_for_inference",`
	`38`	`+ "--deepspeed tests/configs/deepspeed_zero_2.json"`
	`39`	`+ ]`
`28`	`40`	`}`
`29`	`41`	`}`
`30`	`42`	`}`