Code

Introduce TPU pod launcher#815

Code

Closed

muellerzr wants to merge 29 commits intomainhuggingface/accelerate:mainfrom tpu-pod-launchhuggingface/accelerate:tpu-pod-launchCopy head branch name to clipboard

+212-69

Commits

Commits on Nov 2, 2022

• TPU pod launcher

  muellerzr

  committed
  95e41a0

  Copy full SHA for 95e41a0

• Should be working now, just need final steps

  muellerzr

  committed
  b6d3f79

  Copy full SHA for b6d3f79

• Filter args

  muellerzr

  committed
  1c17bdc

  Copy full SHA for 1c17bdc

• Remove redundancy

  muellerzr

  committed
  adb2309

  Copy full SHA for adb2309

Commits on Nov 7, 2022

• Working WIP!

  muellerzr

  committed
  9552778

  Copy full SHA for 9552778

• Merge branch 'main' into tpu-pod-launch

  muellerzr

  authored
  962b771

  Copy full SHA for 962b771

• Fix arg

  muellerzr

  committed
  c694064

  Copy full SHA for c694064

• Merge branch 'tpu-pod-launch' of https://github.com/huggingface/accelerate into tpu-pod-launch

  muellerzr

  committed
  f46396b

  Copy full SHA for f46396b

• rm print

  muellerzr

  committed
  2d4b837

  Copy full SHA for 2d4b837

• Try with no_tpu_cluster

  muellerzr

  committed
  b07d053

  Copy full SHA for b07d053

• Switch to python3, use different branch

  muellerzr

  committed
  8164087

  Copy full SHA for 8164087

Commits on Nov 8, 2022

• Try with just this

  muellerzr

  committed
  ef36125

  Copy full SHA for ef36125

• With python

  muellerzr

  committed
  c98c71d

  Copy full SHA for c98c71d

Commits on Nov 15, 2022

• It's working!

  muellerzr

  committed
  0f0567d

  Copy full SHA for 0f0567d

• Merge branch 'main' into tpu-pod-launch

  muellerzr

  authored
  5fdd72f

  Copy full SHA for 5fdd72f

• Fixed up CLI, needs a change before final merge and ci redo is in

  muellerzr

  committed
  e8b694b

  Copy full SHA for e8b694b

• Merge branch 'main' into tpu-pod-launch

  muellerzr

  committed
  f03fbd3

  Copy full SHA for f03fbd3

• Merge with main

  muellerzr

  committed
  60665b5

  Copy full SHA for 60665b5

• Better doc

  muellerzr

  committed
  f3ace09

  Copy full SHA for f3ace09

Commits on Nov 17, 2022

• machine_type -> device_type

  muellerzr

  committed
  9623e06

  Copy full SHA for 9623e06

• Enable bf16 on TPUs through config

  muellerzr

  committed
  7d3066f

  Copy full SHA for 7d3066f

Commits on Dec 14, 2022

• Rm XRT_TPU_CONFIG for now

  muellerzr

  committed
  f5eb40c

  Copy full SHA for f5eb40c

Commits on Dec 19, 2022

• New version

  muellerzr

  committed
  ccb5291

  Copy full SHA for ccb5291

• Merge branch 'tpu-pod-launch' of https://github.com/huggingface/accelerate into tpu-pod-launch

  muellerzr

  committed
  d8add9a

  Copy full SHA for d8add9a

• Add training function

  muellerzr

  committed
  6bf5cb8

  Copy full SHA for 6bf5cb8

• With sudo option

  muellerzr

  committed
  679f636

  Copy full SHA for 679f636

• Push fix

  muellerzr

  committed
  d423b7b

  Copy full SHA for d423b7b

Commits on Feb 7, 2023

• Update with alpha option

  muellerzr

  committed
  7effca3

  Copy full SHA for 7effca3

Commits on Feb 8, 2023

• Add use_sudo

  muellerzr

  committed
  8a0b5c4

  Copy full SHA for 8a0b5c4