Code

fsdp for bert#140

Code

Draft

jacobfulano wants to merge 5 commits intomosaicml:mainmosaicml/examples:mainfrom jacobfulano:jacob/bert-large-runsjacobfulano/examples:jacob/bert-large-runsCopy head branch name to clipboard

+16-2

Commits

Commits on Feb 9, 2023

• fsdp

  jacobfulano

  committed
  6ba08a3

  Copy full SHA for 6ba08a3

• fsdp wrapper for BertForMaskedLM

  jacobfulano

  committed
  dc0ecdd

  Copy full SHA for dc0ecdd

Commits on Feb 13, 2023

• Merge branch 'main' into jacob/bert-large-runs

  Show description for 19deb81
  jacobfulano

  committed
  19deb81

  Copy full SHA for 19deb81

• attention probs dropout prob

  jacobfulano

  committed
  8557571

  Copy full SHA for 8557571

• yaml comment

  jacobfulano

  committed
  78c9396

  Copy full SHA for 78c9396