Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 29, 2023

• Script for full finetuning (Lightning-AI#187)

  Show description for cc4f760
  

  rasbt

  and

  awaelchli

  authored
  cc4f760

  Copy full SHA for cc4f760

• evaluate_*.py scripts for lora and adapter (Lightning-AI#202)

  rasbt

  authored
  f0ec91c

  Copy full SHA for f0ec91c

Commits on Apr 28, 2023

• Use the new Fabric.init_module() for finetuning (Lightning-AI#201)

  awaelchli

  authored
  4ba680f

  Copy full SHA for 4ba680f

• Set lightning master requirement also in setup.py (Lightning-AI#205)

  carmocca

  authored
  8ac0a9a

  Copy full SHA for 8ac0a9a

Commits on Apr 27, 2023

• Make Red Pajama prepare scripts use PackedDataset (Lightning-AI#199)

  lantiga

  authored
  58b6b36

  Copy full SHA for 58b6b36

Commits on Apr 26, 2023

• Add packed dataset (Lightning-AI#192)

  lantiga

  authored
  d3c0075

  Copy full SHA for d3c0075

• Update default values for max sequence length (Lightning-AI#194)

  awaelchli

  authored
  5f484dd

  Copy full SHA for 5f484dd

Commits on Apr 24, 2023

• Reference Lit-LLaMA articles and tutorials (Lightning-AI#190)

  rasbt

  authored
  bc79815

  Copy full SHA for bc79815

• Remove redundant checkpoint import (Lightning-AI#189)

  rasbt

  authored
  cc00a0e

  Copy full SHA for cc00a0e

• Automatically infer model from state_dict (Lightning-AI#160)

  Show description for 2d3f560
  

  3 peopleauthored
  2d3f560

  Copy full SHA for 2d3f560

Commits on Apr 21, 2023

• Fix .eval() merging of LoRA weights (Lightning-AI#185)

  awaelchli

  authored
  a1ff82d

  Copy full SHA for a1ff82d

• Add test_prepare_redpajama (Lightning-AI#184)

  lantiga

  authored
  2798552

  Copy full SHA for 2798552

• Fixes DATA_FILE_NAME with updated from DATA_FILE (Lightning-AI#183)

  lucas-ventura

  authored
  1a4d91d

  Copy full SHA for 1a4d91d

Commits on Apr 20, 2023

• Update README.md

  lantiga

  authored
  32b5ae9

  Copy full SHA for 32b5ae9

• Create initial howto for TPUs (Lightning-AI#181)

  carmocca

  authored
  5f31c36

  Copy full SHA for 5f31c36

• Compute the generation time per sample (Lightning-AI#178)

  carmocca

  authored
  9ff49e9

  Copy full SHA for 9ff49e9

• Add howto on customizing paths (Lightning-AI#172)

  carmocca

  authored
  9e4846e

  Copy full SHA for 9e4846e

• Add simple test asserting LLaMA can torch.compile (Lightning-AI#179)

  Show description for e274fb5
  

  awaelchli

  and

  carmocca

  authored
  e274fb5

  Copy full SHA for e274fb5

• TPU support (Lightning-AI#176)

  carmocca

  authored
  34700f3

  Copy full SHA for 34700f3

• Real ROPE (Lightning-AI#174)

  t-vi

  authored
  14a40ae

  Copy full SHA for 14a40ae

• Adding a quantized kernel through triton (Lightning-AI#173)

  t-vi

  authored
  5ee9b87

  Copy full SHA for 5ee9b87

• add dolly dataset script (Lightning-AI#143)

  Show description for a7366bc
  

  3 peopleauthored
  a7366bc

  Copy full SHA for a7366bc

Commits on Apr 19, 2023

• Add howto on customizing paths

  carmocca

  committed
  4f97b86

  Copy full SHA for 4f97b86

• Update howto guide to download weights (Lightning-AI#169)

  Show description for 30cd3fa
  

  carmocca

  and

  lantiga

  authored
  30cd3fa

  Copy full SHA for 30cd3fa

• Make adapter.LLaMA.from_name available (Lightning-AI#170)

  awaelchli

  authored
  863985c

  Copy full SHA for 863985c

• Fix generate_adapter.py (Lightning-AI#171)

  t-vi

  authored
  284a988

  Copy full SHA for 284a988

• Add lazyload from torchhacks (Lightning-AI#164)

  t-vi

  authored
  88ba008

  Copy full SHA for 88ba008

• Iterate only a single time per layer when converting the weights (Lightning-AI#168)

  LaurentMazare

  authored
  07c022b

  Copy full SHA for 07c022b

• Fix generate.py missing batch dimension for model (Lightning-AI#166)

  Show description for dd4030c
  

  awaelchli

  and

  lantiga

  authored
  dd4030c

  Copy full SHA for dd4030c

• Stop generating once <eos> token is triggered (Lightning-AI#153)

  Show description for 4e49673
  

  3 peopleauthored
  4e49673

  Copy full SHA for 4e49673

• Add Red Pajama conversion script for sample and full dataset (Lightning-AI#157)

  lantiga

  authored
  c232f7a

  Copy full SHA for c232f7a

• quantization: instantiate model on CPU (Lightning-AI#163)

  t-vi

  authored
  d77eb23

  Copy full SHA for d77eb23

• Remove batched generation support (Lightning-AI#162)

  carmocca

  authored
  f9885ff

  Copy full SHA for f9885ff

Commits on Apr 18, 2023

• Step by step guides (Lightning-AI#144)

  Show description for e214042
  

  awaelchli

  and

  lantiga

  authored
  e214042

  Copy full SHA for e214042

Commits on Apr 17, 2023

• Save and load only adapter weights (Lightning-AI#151)

  awaelchli

  authored
  c8502d0

  Copy full SHA for c8502d0

Pagination

Previous

Next