Code

Multiple calls to Trainer.fit()#948

Code

Merged

ravi-mosaicml merged 123 commits intomosaicml:devmosaicml/composer:devfrom ravi-mosaicml:trainer_fit_eval_signatureravi-mosaicml/ravi-composer:trainer_fit_eval_signatureCopy head branch name to clipboardMay 10, 2022

+1,900-916

Commits

Commits on Mar 25, 2022

• [Eval-Only]: Made the state.dataloader optional; removed state.steps_per_epoch.

  Show description for bd3e847
  ravi-mosaicml

  committed
  bd3e847

  Copy full SHA for bd3e847

Commits on Apr 12, 2022

• Restored dataloader_len on state

  ravi-mosaicml

  committed
  558f279

  Copy full SHA for 558f279

• Fixed tests

  ravi-mosaicml

  committed
  f5d0a1b

  Copy full SHA for f5d0a1b

• Merge branch 'dev' into i40_1

  ravi-mosaicml

  committed
  13c6e53

  Copy full SHA for 13c6e53

• Added dataloader_label; removed evaluators from State

  Show description for e4facaa
  ravi-mosaicml

  committed
  e4facaa

  Copy full SHA for e4facaa

• Merge branch 'dev' into i40_1

  ravi-mosaicml

  committed
  f3f47ea

  Copy full SHA for f3f47ea

• Fixed pyright

  ravi-mosaicml

  committed
  56fd87d

  Copy full SHA for 56fd87d

• Fixed pyright

  ravi-mosaicml

  committed
  b89c3bc

  Copy full SHA for b89c3bc

Commits on Apr 13, 2022

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  authored
  79a3094

  Copy full SHA for 79a3094

• Made max_duration optional

  ravi-mosaicml

  committed
  096b44c

  Copy full SHA for 096b44c

• Merge branch 'ravi/optional_dataloader' of github.com:mosaicml/composer into ravi/optional_dataloader

  ravi-mosaicml

  committed
  d102506

  Copy full SHA for d102506

Commits on Apr 14, 2022

• Addressed PR feedback; fixed Time type annotations

  ravi-mosaicml

  committed
  fe70133

  Copy full SHA for fe70133

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  authored
  7e6e7cf

  Copy full SHA for 7e6e7cf

• Fixed doctests

  ravi-mosaicml

  committed
  11544bc

  Copy full SHA for 11544bc

• Fixed selective backprop

  ravi-mosaicml

  committed
  1313a49

  Copy full SHA for 1313a49

• Inceased timeout

  ravi-mosaicml

  committed
  b5b6192

  Copy full SHA for b5b6192

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  authored
  ecc4a59

  Copy full SHA for ecc4a59

Commits on Apr 15, 2022

• Remove optimizers from state on init; clean up PR

  ravi-mosaicml

  committed
  d3408ba

  Copy full SHA for d3408ba

• Bind the schedulers to the state in __init__(), rather than on fit().

  Show description for 1470d11
  ravi-mosaicml

  committed
  1470d11

  Copy full SHA for 1470d11

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  committed
  7f00806

  Copy full SHA for 7f00806

Commits on Apr 20, 2022

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  committed
  a4b2697

  Copy full SHA for a4b2697

• Fixed the deepspeed schedulers

  ravi-mosaicml

  committed
  54d6b88

  Copy full SHA for 54d6b88

Commits on Apr 21, 2022

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  authored
  f067ed7

  Copy full SHA for f067ed7

• Multiple calls to fit/eval WIP

  ravi-mosaicml

  committed
  ebb9fe5

  Copy full SHA for ebb9fe5

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  3237c9d

  Copy full SHA for 3237c9d

• WIP

  ravi-mosaicml

  committed
  af7bc21

  Copy full SHA for af7bc21

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  committed
  59af154

  Copy full SHA for 59af154

• * Addressed PR Feedback

  Show description for 49e68e8
  ravi-mosaicml

  committed
  49e68e8

  Copy full SHA for 49e68e8

• Merge branch 'ravi/optional_dataloader' of github.com:mosaicml/composer into ravi/optional_dataloader

  ravi-mosaicml

  committed
  93dd36f

  Copy full SHA for 93dd36f

• Merge branch 'ravi/optional_dataloader' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  7d3a073

  Copy full SHA for 7d3a073

• WIP

  ravi-mosaicml

  committed
  a746b9c

  Copy full SHA for a746b9c

• Fixing the dataloader_len setter

  ravi-mosaicml

  committed
  da5bd40

  Copy full SHA for da5bd40

• Merge branch 'ravi/optional_dataloader' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  4d34efd

  Copy full SHA for 4d34efd

• Added docs

  ravi-mosaicml

  committed
  0b16878

  Copy full SHA for 0b16878

Commits on Apr 22, 2022

• Fix tests

  ravi-mosaicml

  committed
  42ab447

  Copy full SHA for 42ab447

• Merge branch 'dev' into ravi/optional_dataloader

  ravi-mosaicml

  authored
  8cac6be

  Copy full SHA for 8cac6be

• Merge branch 'ravi/optional_dataloader' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  f65e904

  Copy full SHA for f65e904

• Fixed style

  ravi-mosaicml

  committed
  3816438

  Copy full SHA for 3816438

• Fix tests

  ravi-mosaicml

  committed
  ff4f400

  Copy full SHA for ff4f400

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  ea25fb5

  Copy full SHA for ea25fb5

• Added Timer.reset

  Show description for 4b2c09e
  ravi-mosaicml

  committed
  4b2c09e

  Copy full SHA for 4b2c09e

• Multiple Evaluator Improvements

  Show description for c7b165d
  ravi-mosaicml

  committed
  c7b165d

  Copy full SHA for c7b165d

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  a2f4896

  Copy full SHA for a2f4896

Commits on Apr 25, 2022

• Fix merge

  ravi-mosaicml

  committed
  643c8b7

  Copy full SHA for 643c8b7

• Merge branch 'dev' into multi_eval_improvements

  ravi-mosaicml

  committed
  e436ea7

  Copy full SHA for e436ea7

• Fixed yaml

  ravi-mosaicml

  committed
  22a136f

  Copy full SHA for 22a136f

• Fixed doctests

  ravi-mosaicml

  committed
  964dd2d

  Copy full SHA for 964dd2d

• Test Cleanup

  Show description for 50ae29f
  ravi-mosaicml

  committed
  50ae29f

  Copy full SHA for 50ae29f

• Refactor

  ravi-mosaicml

  committed
  5471ef8

  Copy full SHA for 5471ef8

• Merge test-cleanup

  ravi-mosaicml

  committed
  a007ddd

  Copy full SHA for a007ddd

• Added eval only test cases

  ravi-mosaicml

  committed
  45b45d5

  Copy full SHA for 45b45d5

Commits on Apr 26, 2022

• Added eval_subset_num_batches and eval_interval tests.

  ravi-mosaicml

  committed
  5419804

  Copy full SHA for 5419804

• Fix test_memory_monitor

  ravi-mosaicml

  committed
  6f6c92f

  Copy full SHA for 6f6c92f

• Merge branch 'test-cleanup' into multi_eval_improvements

  ravi-mosaicml

  committed
  677389e

  Copy full SHA for 677389e

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  42e5c8a

  Copy full SHA for 42e5c8a

• Added trainer fit or eval tests

  ravi-mosaicml

  committed
  14e5e6a

  Copy full SHA for 14e5e6a

• More cleanup

  Show description for 46cf48e
  ravi-mosaicml

  committed
  46cf48e

  Copy full SHA for 46cf48e

• Fixed docs

  ravi-mosaicml

  committed
  231fe5e

  Copy full SHA for 231fe5e

• Merge branch 'dev' into test-cleanup

  ravi-mosaicml

  authored
  065186a

  Copy full SHA for 065186a

• Rename TestMetricsCallback to MetricsCallback

  ravi-mosaicml

  committed
  45befa9

  Copy full SHA for 45befa9

• Merge branch 'test-cleanup' of github.com:ravi-mosaicml/ravi-composer into test-cleanup

  ravi-mosaicml

  committed
  0c34f36

  Copy full SHA for 0c34f36

• Merge branch 'test-cleanup' into multi_eval_improvements

  ravi-mosaicml

  committed
  b3564f1

  Copy full SHA for b3564f1

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  1acfa4e

  Copy full SHA for 1acfa4e

• Fixed docstrings

  ravi-mosaicml

  committed
  f3d57a7

  Copy full SHA for f3d57a7

• Merge branch 'dev' into multi_eval_improvements

  ravi-mosaicml

  committed
  eb3331c

  Copy full SHA for eb3331c

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  9c4a7d9

  Copy full SHA for 9c4a7d9

• Fixed make style

  ravi-mosaicml

  committed
  a794b54

  Copy full SHA for a794b54

• Trigger Jenkins

  ravi-mosaicml

  committed
  65e0e75

  Copy full SHA for 65e0e75

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  486d2da

  Copy full SHA for 486d2da

Commits on Apr 27, 2022

• Merge branch 'dev' into multi_eval_improvements

  ravi-mosaicml

  committed
  3ce4012

  Copy full SHA for 3ce4012

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  cc0b0fa

  Copy full SHA for cc0b0fa

• Merge branch 'trainer_fit_eval_signature' of github.com:ravi-mosaicml/ravi-composer into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  58b905f

  Copy full SHA for 58b905f

• Require that optimizers are specified on Trainer.__init__()

  Show description for b2a5ca6
  ravi-mosaicml

  committed
  b2a5ca6

  Copy full SHA for b2a5ca6

Commits on Apr 28, 2022

• Syncronized the defaults between the hparams class and trainer class

  Show description for dab3e92
  ravi-mosaicml

  committed
  dab3e92

  Copy full SHA for dab3e92

• Merge branch 'dev' into multi_eval_improvements

  ravi-mosaicml

  authored
  3212408

  Copy full SHA for 3212408

• Merge branch 'dev' into multi_eval_improvements

  ravi-mosaicml

  committed
  4173204

  Copy full SHA for 4173204

• Merge branch 'multi_eval_improvements' of github.com:ravi-mosaicml/ravi-composer into multi_eval_improvements

  ravi-mosaicml

  committed
  a5553a6

  Copy full SHA for a5553a6

• Fixed docstrings

  ravi-mosaicml

  committed
  19c9b5d

  Copy full SHA for 19c9b5d

• Fixed checkpoint test merge

  ravi-mosaicml

  committed
  9d01e57

  Copy full SHA for 9d01e57

• Merge branch 'multi_eval_improvements' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  ba0c6a8

  Copy full SHA for ba0c6a8

• Fix a bad merge

  ravi-mosaicml

  committed
  663be21

  Copy full SHA for 663be21

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  134d4b3

  Copy full SHA for 134d4b3

Commits on Apr 29, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  f2010ec

  Copy full SHA for f2010ec

• Cleanup

  ravi-mosaicml

  committed
  6d17ff7

  Copy full SHA for 6d17ff7

• Added tests for multiple calls to fit

  ravi-mosaicml

  committed
  762be8d

  Copy full SHA for 762be8d

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  c72dab5

  Copy full SHA for c72dab5

Commits on May 2, 2022

• Fix FP16 Precision with DeepSpeed

  Show description for 87b5467
  ravi-mosaicml

  committed
  87b5467

  Copy full SHA for 87b5467

• Fix tests

  ravi-mosaicml

  committed
  afa8db4

  Copy full SHA for afa8db4

• Address PR feedback

  ravi-mosaicml

  committed
  ec3e662

  Copy full SHA for ec3e662

• Test DeepSpeed on all precisions

  ravi-mosaicml

  committed
  b87de7f

  Copy full SHA for b87de7f

• Testing all precisions

  ravi-mosaicml

  committed
  a3bedff

  Copy full SHA for a3bedff

Commits on May 3, 2022

• Fix tests

  ravi-mosaicml

  committed
  7f92f36

  Copy full SHA for 7f92f36

• Merge branch 'fix_deepspeed' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  70304fd

  Copy full SHA for 70304fd

• Addressed some PR feedback

  ravi-mosaicml

  committed
  732510b

  Copy full SHA for 732510b

• More changes

  ravi-mosaicml

  committed
  18b83dc

  Copy full SHA for 18b83dc

• More refactoring

  ravi-mosaicml

  committed
  0c4727d

  Copy full SHA for 0c4727d

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  5b0e683

  Copy full SHA for 5b0e683

• Fix tests

  ravi-mosaicml

  committed
  0965cb1

  Copy full SHA for 0965cb1

• Specify the train dataloader in init when using deepspeed

  ravi-mosaicml

  committed
  2662dc3

  Copy full SHA for 2662dc3

• Fix the precision

  ravi-mosaicml

  committed
  6b1cfea

  Copy full SHA for 6b1cfea

• Fixed docs build

  ravi-mosaicml

  committed
  977a8dd

  Copy full SHA for 977a8dd

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  e581acc

  Copy full SHA for e581acc

• Addressing PR feedback

  ravi-mosaicml

  committed
  a5ad524

  Copy full SHA for a5ad524

• Fixed duration in Trainer.fit

  Show description for 7bfba07
  ravi-mosaicml

  committed
  7bfba07

  Copy full SHA for 7bfba07

• Addressed more PR feedback

  ravi-mosaicml

  committed
  49b35f0

  Copy full SHA for 49b35f0

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  21f6f44

  Copy full SHA for 21f6f44

• Refactored grad_accum

  ravi-mosaicml

  committed
  71c5f65

  Copy full SHA for 71c5f65

• Refactored default scheduler frequency function

  ravi-mosaicml

  committed
  9bbc212

  Copy full SHA for 9bbc212

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  faea817

  Copy full SHA for faea817

• Fixed tests

  ravi-mosaicml

  committed
  06530a9

  Copy full SHA for 06530a9

Commits on May 4, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  8d6c0c3

  Copy full SHA for 8d6c0c3

• Fixed tests; addressed some PR feedback

  ravi-mosaicml

  committed
  c56179d

  Copy full SHA for c56179d

• Addressed more PR feedback

  ravi-mosaicml

  committed
  db3a7e3

  Copy full SHA for db3a7e3

• Added docs

  ravi-mosaicml

  committed
  8d1e908

  Copy full SHA for 8d1e908

• Fixed docs

  ravi-mosaicml

  committed
  87152b7

  Copy full SHA for 87152b7

• Fixed a bug with timing. Added tests

  ravi-mosaicml

  committed
  a578676

  Copy full SHA for a578676

Commits on May 5, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  e17bdca

  Copy full SHA for e17bdca

Commits on May 6, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  8a94b44

  Copy full SHA for 8a94b44

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  a8dc9be

  Copy full SHA for a8dc9be

Commits on May 7, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  committed
  64b8a43

  Copy full SHA for 64b8a43

Commits on May 9, 2022

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  96fdb93

  Copy full SHA for 96fdb93

• Merge branch 'dev' into trainer_fit_eval_signature

  ravi-mosaicml

  authored
  94e0476

  Copy full SHA for 94e0476

• Addressed PR feedback

  ravi-mosaicml

  committed
  f5b518f

  Copy full SHA for f5b518f