Skip to content

Commit 93264ba

Browse files
jiminharegisss
andauthored
Update llama-7b command to include eval (huggingface#665)
Co-authored-by: regisss <15324346+regisss@users.noreply.github.com>
1 parent 5d8cac7 commit 93264ba

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

examples/language-modeling/README.md

+4
Original file line numberDiff line numberDiff line change
@@ -370,6 +370,7 @@ python3 run_lora_clm.py \
370370
--max_grad_norm 0.3 \
371371
--logging_steps 1 \
372372
--do_train \
373+
--do_eval \
373374
--use_habana \
374375
--use_lazy_mode \
375376
--throughput_warmup_steps 3 \
@@ -380,6 +381,7 @@ python3 run_lora_clm.py \
380381
--dataset_concatenation \
381382
--max_seq_length 512 \
382383
--low_cpu_mem_usage True \
384+
--validation_split_percentage 4 \
383385
--adam_epsilon 1e-08
384386
```
385387

@@ -436,6 +438,7 @@ python ../gaudi_spawn.py \
436438
--max_grad_norm 0.3 \
437439
--logging_steps 1 \
438440
--do_train \
441+
--do_eval \
439442
--use_habana \
440443
--use_lazy_mode \
441444
--throughput_warmup_steps 3 \
@@ -447,6 +450,7 @@ python ../gaudi_spawn.py \
447450
--max_seq_length 512 \
448451
--ddp_bucket_cap_mb 50 \
449452
--adam_epsilon 1e-08 \
453+
--validation_split_percentage 4 \
450454
--low_cpu_mem_usage True
451455
```
452456

0 commit comments

Comments
 (0)