Code

doc: Add qLoRA README#322

Code

Merged

aluu317 merged 12 commits intofoundation-model-stack:mainfoundation-model-stack/fms-hf-tuning:mainfrom aluu317:qLora_READMEaluu317/fms-hf-tuning:qLora_READMECopy head branch name to clipboardSep 13, 2024

+66-1

Commits

Commits on Sep 13, 2024

• Add README

  Show description for 673a79c
  aluu317

  committed
  673a79c

  Copy full SHA for 673a79c

• fix: need to pass skip_prepare_dataset for pretokenized dataset due to breaking change in HF SFTTrainer (foundation-model-stack#326)

  Show description for 1a24940
  

  HarikrishnanBalagopal

  authored and

  aluu317

  committed
  1a24940

  Copy full SHA for 1a24940

• feat: install fms-acceleration to enable qlora (foundation-model-stack#284)

  Show description for c5f471a
  

  anhuong

  authored and

  aluu317

  committed
  c5f471a

  Copy full SHA for c5f471a

• Update for target modules

  Show description for 9f23d9e
  aluu317

  committed
  9f23d9e

  Copy full SHA for 9f23d9e

• feat: Migrating the trainer controller to python logger (foundation-model-stack#309)

  Show description for 8200504
  

  seshapad

  authored and

  aluu317

  committed
  8200504

  Copy full SHA for 8200504

• fix: remove fire for handling CLI args (foundation-model-stack#324)

  Show description for 761cde4
  

  2 peopleauthored and

  aluu317

  committed
  761cde4

  Copy full SHA for 761cde4

• dep: cap transformers version (foundation-model-stack#335)

  Show description for 25abbca
  

  anhuong

  authored and

  aluu317

  committed
  25abbca

  Copy full SHA for 25abbca

• deps: Add protobuf to enable compatibility with certain models (foundation-model-stack#336)

  Show description for e154334
  

  willmj

  authored and

  aluu317

  committed
  e154334

  Copy full SHA for e154334

• Add more details on qLORA

  Show description for 0c6c476
  aluu317

  committed
  0c6c476

  Copy full SHA for 0c6c476

• add enable_aim build args in all stages

  Show description for 427202f
  

  anhuong

  authored and

  aluu317

  committed
  427202f

  Copy full SHA for 427202f

• fix: remove lm_head post processing (foundation-model-stack#333)

  Show description for b15a07b
  

  2 peopleauthored and

  aluu317

  committed
  b15a07b

  Copy full SHA for b15a07b

• Merge branch 'main' into qLora_README

  aluu317

  authored
  5906436

  Copy full SHA for 5906436